• Skullgrid@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    13 hours ago

    … Why the fuck is there telemetry on my local AI?? I tried Qwen3.5:2b

    spoiler
    slot launch_slot_: id  0 | task 17 | processing task, is_child = 0
    slot   operator(): id  0 | task 17 | new prompt, n_ctx_slot = 8192, n_keep = 4, task.n_tokens = 439
    slot   operator(): id  0 | task 17 | cached n_tokens = 258, memory_seq_rm [258, end)
    slot init_sampler: id  0 | task 17 | init sampler, took 0.15 ms, tokens: text = 439, total = 439
    [GIN] 2026/10/11 - 16:08:03 | 200 |     324.081µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |       71.38µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |     164.616µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |      96.902µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:04 | 200 |      64.533µs |       127.0.0.1 | GET      "/api/ps"
    time=2026-10-11T16:08:04.525-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_capturingTokenCorrelationId
    time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_otelTraceContext
    time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_telemetryTurn
    [GIN] 2026/10/11 - 16:08:04 | 200 |  105.201776ms |       127.0.0.1 | GET      "/api/ps"
    time=2026-10-11T16:08:04.801-03:00 level=INFO source=sched.go:1338 msg="updated VRAM based on existing loaded models" gpu=0 library=Vulkan total="2.2 GiB" available="2.2 GiB"
    
    • Womble@piefed.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      12 hours ago

      Those apis are on 127.0.0.1, that’s a shorthand for “this local computer”. This is just different bits of the program communicating with each other.

      You can see that its not going over the internet as the responses are coming back in microseconds.

      • Skullgrid@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 hours ago

        I mean, the 127.0.0.1 makes sense, but It could be it being sent to that port from VS code… why does my local ollama have any kind of telemetry? is it for network users or if I serve to outside my local machine, so telemetry being sent to me? I think it’s disabled anyway.

        • Womble@piefed.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          54 minutes ago

          Yep, you can use it to serve models over a network, it essentially creates an api withe the same structure as openai’s ones then serves that. By default just to your machine for other programs to use, but I serve mine to my tailnet so I can use my desktop on my laptop or phone.