Whenever I see these, I try them out. Sometimes I can reproduce them, this one I can’t. However, I remain extremely skeptical and believe that whenever one of these screenshots goes around, someone at LLM Company hard codes a fix for that specific fuck up. Against how many of these hard fixes does each LLM answer get checked nowadays?!
I tried it, and got similiar shorter answers but not the exact same answer. Sometimes it ends up getting it right at the end after fumbling a lot, and sometimes it just fails completely.
Searching on Google directly sometimes doesn’t produce the AI Overview on stuff like these in my experience, but passing the search to Google from DDG with the bang (!g) almost always produces the AI Overview.
edit: I tried it again and it grew the ability of humor:
There are 2 't’s in the word colonialism.
colt-a-ca-l-i-s-m (just kidding)
C-o-l-o-n-i-a-l-i-s-m:
t = 0
(If you were thinking of colonization, there is still only 1 ‘t’ in the word.)
Interestingly, on one of my attempts it used python to count the number of t’s and still ended up getting the “verbal” explanation wrong.
They are located at the end of the word: the t and i at the end of the sequence.
They usually include some randomness in the responses which is why they don’t always respond the same way (and sometimes will even often but not always get the answer correct, or visa versa).
That could be, but I think a lot of the models are the same because they can speak many languages pretty well. I’ve had a lot of success with talking to models I normally prompt in English using other languages. But I have also seen Chinese appear unprompted in response to English queries from certain Chinese models a few times.
Oh yeah, an LLM itself doesn’t make that much of a difference. But Google does. Features and “features” often show up later on non English Google. The AI summary took a few months to appear on German google – even if you set your language to English.
I think that’s because they have to wait for more testing to make sure the model/feature is “safe” for that region and take into consideration the linguistic and cultural differences. I believe it’s mostly legal stuff they need to make sure they won’t be breaking laws in different countries and see if they would face backlash from authorities or the public. But I think it’s mostly the same model with the same data everywhere.
Whenever I see these, I try them out. Sometimes I can reproduce them, this one I can’t. However, I remain extremely skeptical and believe that whenever one of these screenshots goes around, someone at LLM Company hard codes a fix for that specific fuck up. Against how many of these hard fixes does each LLM answer get checked nowadays?!
I tried it, and got similiar shorter answers but not the exact same answer. Sometimes it ends up getting it right at the end after fumbling a lot, and sometimes it just fails completely.
Searching on Google directly sometimes doesn’t produce the AI Overview on stuff like these in my experience, but passing the search to Google from DDG with the bang (!g) almost always produces the AI Overview.
edit: I tried it again and it grew the ability of humor:
Interestingly, on one of my attempts it used python to count the number of t’s and still ended up getting the “verbal” explanation wrong.
On the very long list of shitty things about AI is the fact that they are non-deterministic.
I was however able to get this fuckup on first try:
I’m sure it’s fine. After all, the AI triple-checked its answer!
Wow, you’re right. I got three different answers over five queries.
Right. Cause they aren’t answering the question. They are just determining the next most likely word.
I just tried this one and got:
They usually include some randomness in the responses which is why they don’t always respond the same way (and sometimes will even often but not always get the answer correct, or visa versa).
I am also trying from a non English speaking country, pretty sure that has an impact as well on behavior.
That could be, but I think a lot of the models are the same because they can speak many languages pretty well. I’ve had a lot of success with talking to models I normally prompt in English using other languages. But I have also seen Chinese appear unprompted in response to English queries from certain Chinese models a few times.
Oh yeah, an LLM itself doesn’t make that much of a difference. But Google does. Features and “features” often show up later on non English Google. The AI summary took a few months to appear on German google – even if you set your language to English.
I think that’s because they have to wait for more testing to make sure the model/feature is “safe” for that region and take into consideration the linguistic and cultural differences. I believe it’s mostly legal stuff they need to make sure they won’t be breaking laws in different countries and see if they would face backlash from authorities or the public. But I think it’s mostly the same model with the same data everywhere.