It’s kind of sort of already happening. Emdashes are fragments of it, a token saving strategy introduced by already trained on old books in their data sources. Model collapse is inevitable.
Yes exactly the point being made in the link. AI picks up unintended behaviours already, it’s not too hard to imagine that the general direction is towards model collapse.
You can only stave off model collapse so long.
It’s only a matter of time before most of the data going in to LLMs came out of one too.
Like I’m not even good at math or anything, much less computer science, but that seems obvious and inevitable to me.
Maybe someone smarter than me can chime in.
It’s kind of sort of already happening. Emdashes are fragments of it, a token saving strategy introduced by already trained on old books in their data sources. Model collapse is inevitable.
Idk. Prose books generally have tons of em dashes.
Yes exactly the point being made in the link. AI picks up unintended behaviours already, it’s not too hard to imagine that the general direction is towards model collapse.