• Skullgrid@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    12 hours ago

    this is why I at least sanitise my inputs before using ddg’s ai stuff when I’m shit out of luck and can’t understand the documentation.

    Because it’s just another privacy violating hole.

    I *TRIED* to get a local model working (qwen2.5:1.5b, qwen2.5-coder:1.5b, it needs tooling and shit to be anywhere near useful, and the non coder version hallucinated files that don’t exist). My 8 year old laptop can’t fucking handle the AIs properly.

    Not sure WTF to do about this; in order to be actually useful these things need total context. Maybe some kind of additional submodel (I forget the proper name, LORA or RAG or finetuning or something) to not have it have to try to get me results in the moment.

    As an aside for my street cred, I was fucking around with local Stable diffusion in like Feb 2024 and fucked around with claude a bit back then too.

    Largely not worth it back then, and now, it needs shitloads of processing power to do anything.

    The tool is OK; if you don’t know something/have a skill it can help you achieve *something* but JESUS CHRIST the way they are using it is too fucking obscene.