• Womble@piefed.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 days ago

    Those apis are on 127.0.0.1, that’s a shorthand for “this local computer”. This is just different bits of the program communicating with each other.

    You can see that its not going over the internet as the responses are coming back in microseconds.

    • Skullgrid@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      I mean, the 127.0.0.1 makes sense, but It could be it being sent to that port from VS code… why does my local ollama have any kind of telemetry? is it for network users or if I serve to outside my local machine, so telemetry being sent to me? I think it’s disabled anyway.

      • Womble@piefed.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 days ago

        Yep, you can use it to serve models over a network, it essentially creates an api withe the same structure as openai’s ones then serves that. By default just to your machine for other programs to use, but I serve mine to my tailnet so I can use my desktop on my laptop or phone.