Learn extra at:
A handful of dominant AI corporations have been quietly manipulating one of the vital influential public leaderboards for chatbot fashions, doubtlessly distorting perceptions of mannequin efficiency and undermining open competitors, in keeping with a brand new research.
The analysis, titled “The Leaderboard Phantasm,” was revealed by a crew of consultants from Cohere Labs, Stanford College, Princeton College, and different establishments. It scrutinized the operations of Chatbot Area, a broadly used public platform that enables customers to check generative AI fashions via pairwise voting on mannequin responses to person prompts.
The research revealed that main tech companies — together with Meta, Google, and OpenAI — got privileged entry to check a number of variations of their AI fashions privately on Chatbot Area. By selectively publishing solely the highest-performing variations, these corporations have been in a position to enhance their rankings, the research discovered.
