Surely if their code has deep issues, they’ll discover that eventually and maybe learn from it, right?

Maybe… but that’s definitely not a given, and if they’re not already an experienced developer it’s almost certainly something they’ll try to solve by prompting, “don’t make any mistakes” or similar.