• Skullgrid@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      … Why the fuck is there telemetry on my local AI?? I tried Qwen3.5:2b

      spoiler
      slot launch_slot_: id  0 | task 17 | processing task, is_child = 0
      slot   operator(): id  0 | task 17 | new prompt, n_ctx_slot = 8192, n_keep = 4, task.n_tokens = 439
      slot   operator(): id  0 | task 17 | cached n_tokens = 258, memory_seq_rm [258, end)
      slot init_sampler: id  0 | task 17 | init sampler, took 0.15 ms, tokens: text = 439, total = 439
      [GIN] 2026/10/11 - 16:08:03 | 200 |     324.081µs |       127.0.0.1 | GET      "/api/ps"
      [GIN] 2026/10/11 - 16:08:03 | 200 |       71.38µs |       127.0.0.1 | GET      "/api/ps"
      [GIN] 2026/10/11 - 16:08:03 | 200 |     164.616µs |       127.0.0.1 | GET      "/api/ps"
      [GIN] 2026/10/11 - 16:08:03 | 200 |      96.902µs |       127.0.0.1 | GET      "/api/ps"
      [GIN] 2026/10/11 - 16:08:04 | 200 |      64.533µs |       127.0.0.1 | GET      "/api/ps"
      time=2026-10-11T16:08:04.525-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_capturingTokenCorrelationId
      time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_otelTraceContext
      time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_telemetryTurn
      [GIN] 2026/10/11 - 16:08:04 | 200 |  105.201776ms |       127.0.0.1 | GET      "/api/ps"
      time=2026-10-11T16:08:04.801-03:00 level=INFO source=sched.go:1338 msg="updated VRAM based on existing loaded models" gpu=0 library=Vulkan total="2.2 GiB" available="2.2 GiB"
      
      • Womble@piefed.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 days ago

        Those apis are on 127.0.0.1, that’s a shorthand for “this local computer”. This is just different bits of the program communicating with each other.

        You can see that its not going over the internet as the responses are coming back in microseconds.

        • Skullgrid@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 days ago

          I mean, the 127.0.0.1 makes sense, but It could be it being sent to that port from VS code… why does my local ollama have any kind of telemetry? is it for network users or if I serve to outside my local machine, so telemetry being sent to me? I think it’s disabled anyway.

          • Womble@piefed.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            2 days ago

            Yep, you can use it to serve models over a network, it essentially creates an api withe the same structure as openai’s ones then serves that. By default just to your machine for other programs to use, but I serve mine to my tailnet so I can use my desktop on my laptop or phone.