LLMs “know” how to do these things, but when you ask them to do the thing, they vibe instead of looking at best practices and following them. I’ve worked with a few humans I could say the same thing about. I wouldn’t put any of them in charge of production code.
You’re better off asking how a thing should be done and then doing it. You can literally have an LLM write something and then ask if the thing it wrote follows industry best practice standards and it will tell you no. Maybe use two different chats so it doesn’t know the code is its own output.
LLMs “know” how to do these things, but when you ask them to do the thing, they vibe instead of looking at best practices and following them. I’ve worked with a few humans I could say the same thing about. I wouldn’t put any of them in charge of production code.
You’re better off asking how a thing should be done and then doing it. You can literally have an LLM write something and then ask if the thing it wrote follows industry best practice standards and it will tell you no. Maybe use two different chats so it doesn’t know the code is its own output.