Paytm CEO Tests Claude, Gemini, ChatGPT on iPhone Duo. Here Are The Results
Paytm CEO Vijay Shekhar Sharma tested several AI chatbots by asking about the unreleased 'iPhone Duo', revealing significant differences in how models handle factual queries versus hallucinations. While some bots correctly identified the lack of official information, others generated detailed, fabricated specifications.
Why it matters
This highlights the ongoing challenge of 'hallucinations' in generative AI and the varying reliability of different large language models when processing real-time or niche information.
Paytm founder Vijay Shekhar Sharma has shared screenshots of his conversations with different AI chatbots after asking them the same question about Apple's newly announced iPhone Duo.Sharma asked ChatGPT, SuperGrok, Gemini Flash and Claude, "Do you know about iPhone Duo?" The responses varied: some AI bots quickly identified the device as Apple's first foldable iPhone, while ChatGPT said it did not recognise the name as an official Apple product.Sharma posted screenshots of all four conversations on X and compared how the AI bots responded to the same question."@GeminiApp I expected. @claudeai surprised me. @grok is latest, always. And @ChatGPT gotta go to web before saying no!" he wrote.Do you know about iPhone Duo ?????????@GeminiApp I expected. @claudeai surprised me. @grok is latest , always. And @ChatGPT gotta go to web before saying no !
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in