I think the bubble will not burst but deflate long before the tech disappears: Plenty of companies will burn cash and investors will get wrecked, but the genuinely useful products will stick around. Guardrails will improve too, because trust eventually becomes a competitive advantage.
Guardrails will improve too, because trust eventually becomes a competitive advantage.
Thing is, as an LLM user you don’t want guardrails usually. Someone else wants it to have guardrails so you can’t get all the information you want.
If you’re reverse engineering something, you don’t want the guardrails to say “hey this is copyrighted, I can’t do this”. I’m assuming terrorists don’t want the guardrails to stop the LLM from giving them info on chemical weapons. And if you’re religious, you probably don’t want guardrails to stop the LLM from talking about religion with you
You’re describing different guardrails: Most users don’t want arbitrary censorship, but almost everyone benefits from guardrails that reduce clearly harmful or illegal outputs. The real debate is not whether they exist, it is who decides where the line is drawn.
I think the bubble will not burst but deflate long before the tech disappears: Plenty of companies will burn cash and investors will get wrecked, but the genuinely useful products will stick around. Guardrails will improve too, because trust eventually becomes a competitive advantage.
Thing is, as an LLM user you don’t want guardrails usually. Someone else wants it to have guardrails so you can’t get all the information you want.
If you’re reverse engineering something, you don’t want the guardrails to say “hey this is copyrighted, I can’t do this”. I’m assuming terrorists don’t want the guardrails to stop the LLM from giving them info on chemical weapons. And if you’re religious, you probably don’t want guardrails to stop the LLM from talking about religion with you
You’re describing different guardrails: Most users don’t want arbitrary censorship, but almost everyone benefits from guardrails that reduce clearly harmful or illegal outputs. The real debate is not whether they exist, it is who decides where the line is drawn.