s crazy that everyone else hasn’t introduced similar laws already.

Typically, there is already relatively big regulation on software used for critical activities. You can’t just deplpy a new software to process medical images or regulates the engine power of a plane.

Did the law needed to be uptaded in the era of AI most likely. However, I doubt you could have used a “AI” whatever it is, without any paperwork