I was going off the statement, “If you are using a generator that combines everything (both bad and good) on the net”. I think “the entire internet” is an OK paraphrase of “everything on the net”, but maybe you meant something else than what I understood.
The original public release of ChatGPT used a small army of humans to generate and curate training data, and it’s still the rule today. So what the average of what the model actually sees is quite far from the average of everything on the net.
The ability of the model to learn different contexts and tones means that all it takes to not land “right on the middle” is a slightly different context, which can all be contained in the instructions given to the model. Sure, the models have their stupid phrasings and stock phrases, but the context was producing a first draft. A competent human can reword those very easily.
I was going off the statement, “If you are using a generator that combines everything (both bad and good) on the net”. I think “the entire internet” is an OK paraphrase of “everything on the net”, but maybe you meant something else than what I understood.
The original public release of ChatGPT used a small army of humans to generate and curate training data, and it’s still the rule today. So what the average of what the model actually sees is quite far from the average of everything on the net.
The ability of the model to learn different contexts and tones means that all it takes to not land “right on the middle” is a slightly different context, which can all be contained in the instructions given to the model. Sure, the models have their stupid phrasings and stock phrases, but the context was producing a first draft. A competent human can reword those very easily.