• MangoCats@feddit.it
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 hour ago

    Whether it’s bombing a school in Iran because Claude fucked up the targeting

    I’m going to call user error on that, and I don’t think it matters what system they were using - they were going to make mistakes.

    an AI agent deleting your email inbox or your production database

    The real error there? Conducting risky operations without backups.

    creating a court case out of thin air

    That’s just big silicon-brass balls. Interns do it too, but you don’t hear about them. On the other hand, trusting the AI or the intern, that’s disbarment levels of reckless.

    It makes perfect sense not to trust this technology

    Or any technology, until we have figured out what it is, and isn’t, capable of doing reliably.

    But, plenty of people still play Russian Roulette, for one reason or another. Is that the revolver manufacturer’s fault?

    being that it’s already been trained on the entirety of recorded human knowledge, I’m not sure how it gets better either

    Better editing.