

I had the same issue. OpenAI was just slamming my tiny little server, ignoring the robots.txt. I had to install a LLM black hole and put a very basic password protection around my git server frontend, since it kept getting slammed by the crawler.
As much as I dont like google, I did see them come in, look at the robot.txt and no other calls for a week. Thats how it should work.
Yep im also going to wait til its out to make a judgement call.