They’re getting a little better about that as time goes on, but yeah, last year the time blindless was a major handicap at times.
On questions like geometrically constrained requirements, they’re pretty good at telling you when a problem is overconstrained such that there is no answer, but… in the fuzzier world of underspecified questions, they’ll stretch pretty far to make up an answer. In the world of computer programming, sometimes that’s a brilliant move - they “make up” some code, compile it, test it, and it works - it’s actually a functional solution.
The other day I challenged Gemini to find a person that I had a vague description of, Gemini went out and made up a name, job title, vague description of their publication history. When I pressed for actual evidence, its answers were evasive, and when I finally cornered it with a demand for anything concrete proving this person actually exists it came clean with “I hallucinated that.”
They’re getting a little better about that as time goes on, but yeah, last year the time blindless was a major handicap at times.
On questions like geometrically constrained requirements, they’re pretty good at telling you when a problem is overconstrained such that there is no answer, but… in the fuzzier world of underspecified questions, they’ll stretch pretty far to make up an answer. In the world of computer programming, sometimes that’s a brilliant move - they “make up” some code, compile it, test it, and it works - it’s actually a functional solution.
The other day I challenged Gemini to find a person that I had a vague description of, Gemini went out and made up a name, job title, vague description of their publication history. When I pressed for actual evidence, its answers were evasive, and when I finally cornered it with a demand for anything concrete proving this person actually exists it came clean with “I hallucinated that.”