• Womble@piefed.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    Yep, you can use it to serve models over a network, it essentially creates an api withe the same structure as openai’s ones then serves that. By default just to your machine for other programs to use, but I serve mine to my tailnet so I can use my desktop on my laptop or phone.