Learn extra at:
Facepalm: Apple’s much-hyped Siri integration with ChatGPT could have added a ton of helpful performance, but it surely’s apparently executed little to enhance the digital assistant’s information of sports activities. A damning report highlights simply how abysmally Siri performs at recalling easy information like previous Tremendous Bowl winners.
In response to the report from One Foot Tsunami’s Paul Kafasis, when requested “Who gained Tremendous Bowl?” for every quantity from 1 via 60, Siri accurately supplied the winner for under 20 out of the 58 Tremendous Bowls which have been performed up to now. That interprets to successful charge of simply 34%.
The main points get much more embarrassing. Kafasis found that at its worst, Siri missed an unbelievable 15 Tremendous Bowl winners in a row from Tremendous Bowl XVII via XXXII. And in a baffling mishap, it erroneously credited the Philadelphia Eagles with a whopping 33 non-existent Tremendous Bowl wins.
Kafasis documented each single one in every of Siri’s incorrect solutions in a downloadable spreadsheet, which you’ll find on his weblog.
One other report by Daring Fireball’s John Gruber corroborated these findings. It discovered that AI assistants and search engines like google and yahoo from Google, Anthropic, and DuckDuckGo fared much better when requested related Tremendous Bowl trivia questions. Gruber even discovered they may all deal with not simply previous outcomes, however well dodge trick questions on future Tremendous Bowls that have not occurred but.
Siri’s poor efficiency would not cease at sports activities trivia both. Daring Fireball posed a extra obscure query – “Who gained the 2004 North Dakota highschool boys’ state basketball championship?” Extremely, each Kagi and ChatGPT supplied the absolutely right reply, with the latter incomes bonus factors for together with a hyperlink to video of the championship recreation. In the meantime, Siri as soon as once more received it incorrect.
What makes all this significantly damning is that Siri’s essentially powered by the identical ChatGPT that fares completely tremendous when used with out Siri.
The weblog additionally factors out that the outdated pre-AI variations of Siri a minimum of acknowledged limitations on such queries and supplied related net hyperlinks. However new Siri powered by Apple Intelligence with ChatGPT integration lies with confidence – a hallmark of unrefined AI – making it worse than its predecessor.
Each blogs conclude that Apple has extra work to do on this space. As Gruber bluntly states, Siri with ChatGPT is at present “an enormous regression” over the outdated Siri on the subject of dealing with easy factual prompts.
