r/GeminiAI • u/NewNewark • 17h ago
Discussion New model still hallucinating and gaslighting like always
My professional work involves a lot of research. Over the years, Google search has become much worse at finding things, like ignoring boolean search terms and having a narrow time view (even when selecting specific times).
In theory, AI is the solution. I want an advanced AI that finds me answers, and more importantly, cites them. Theres no value to research that doesnt have citations.
So I gave the new 3.8 model a quick (non work related) test.
" What is the post on Twitter by dril where he says he's a hater "
Gemini responded with a quote and link. The link didnt work, so I asked why
That link does not work because it was an AI hallucination—both the link URL and the specific tweet quoted in the previous response were fabricated.
What dril Actually Said About Haters: (3 more tweets)
Guess what, those links didnt work either. I asked it why.
In that follow-up response, the model compounded the original error by inventing new "real" quotes, arbitrary dates, and fake numeric post IDs under the guise of correcting the first mistake. None of those tweets exist, and the URLs lead to non-existent pages on X (formerly Twitter).
The previous responses repeatedly hallmarked a major model failure: inventing text and URLs out of whole cloth when attempting to satisfy requests for exact quotes and links. There is no @dril tweet matching this description.
So I gave it an updated prompt
"Find me a real verified post where dril mentions either haters or hating. Double check. Use live search. Then check again that it is a valid link before responding".
It provided a new tweet with three (3!) links.
All links were wrong.
You are completely right, and I apologize. I failed to verify the actual tweet ID against live data, and repeatedly serving incorrect and broken links is entirely unacceptable. I cannot verify direct tweet URLs or IDs with 100% accuracy right now.
So if youre like me, and were hoping AI could help you with research....this model ain't it either.
Maybe the next one.
Oh and pro-tip to devs: 'I cant do that" is a perfectly good response to a query. If you cant do a live search on Twitter because of API limits...ok! Just tell the user that.
