AI benchmark tool seen as biased toward tech giants
Thursday, May 1, 2025, 10:20 am
A new study claims that a prominent AI benchmarking system is skewed in favor of heavyweights like OpenAI, Google, and Meta—raising eyebrows over the integrity of its ratings. The system’s defenders, however, dismiss these allegations with a shrug.
Bluesky: @arstechnica.com
The popular AI vibe test may not be as fair as it seems.
Researchers say the ranking system favors major providers like OpenAI, Google, and Meta. LMArena disputes the claims. The article Popular AI benchmark LMArena allegedly favors large providers, study claims appeared first on THE DECODER.
Chatbot Arena is the most popular AI benchmarking tool, but new research says its scores are misleading and benefit a handful of the biggest companies.
permalink / 3 stories from sources in 9 days ago #ai #techpolicy #antitrust #aiethics
More Top Stories...
Google to Pay Billion-Dollar Settlement Over Texas Privacy Claims
Google has agreed to a settlement of roughly $1.375 billion to settle allegations of invasive data tracking practices in Texas. Both reports detail the breach of users’ sensitive geolocation and privacy rights, marking another hefty reminder that digital privacy demands serious oversight—even if enforcement sometimes seems as elusive as a mirage. More...
Apple Shifts iPhone Production to Brazil to Dodge U.S. Tariffs
Facing escalating U.S. tariffs, Apple appears to be quietly shifting iPhone production to Brazil through its Foxconn partnership. Despite Apple’s denials, industry insiders suggest this strategic relocation aims to stabilize prices and secure the supply chain, proving that when it comes to international trade, geography often trumps rhetoric. More...
Rippling Soars to $16.8 Billion Valuation Amid Financing Round
HR tech startup Rippling has astonished investors by reaching a $16.8 billion valuation following a $450 million Series G financing round. This meteoric rise, buoyed by savvy venture capital interest (YC reportedly being one of the backers), adds another chapter to today’s ever-expanding unicorn saga. More...
US border agents to photograph car exiters with facial recognition
U.S. Customs and Border Protection is set to capture every face of drivers leaving the country with high-tech facial recognition that matches travelers against their passports. The agency’s ambitious plan has security officials applauding while privacy advocates raise an eyebrow at this unprecedented surveillance move. More...
Samsung Galaxy S25 Edge Reveal Sparks Tech Buzz
Samsung has kicked off a high-profile unveiling of its long-anticipated superslim Galaxy S25 Edge, sparking excitement among tech enthusiasts. The event showcased the phone’s innovative design and cutting-edge features, setting the stage for a fiercely competitive market. Not exactly a revolution, but enough to make followers drool. More...
Related Tags
Artificial Intelligence
LegoGPT AI Brings Realistic, Stable Lego Creations to Life (18 hours ago)
Court Uses AI Deepfake for Deceased Victim's Impact Statement (22 hours ago)
Google Gemini API introduces caching to slash developer costs (23 hours ago)
Tech Policy
Trump Targets Digital Equity Act in Baffling Move (22 hours ago)
Senate Ends Free Wi‑Fi Funding for Schools and Libraries (44 hours ago)
Instagram Testifies on Threads Integration in Meta Antitrust Trial (45 hours ago)
Antitrust
Instagram Testifies on Threads Integration in Meta Antitrust Trial (45 hours ago)
Apple Battles Epic in Legal Tussle Over App Store Practices (2 days ago)
Microsoft wins big as FTC appeal fails in Activision deal (2 days ago)
AI Ethics
Court Uses AI Deepfake for Deceased Victim's Impact Statement (22 hours ago)
Google Gemini API introduces caching to slash developer costs (23 hours ago)
Bill Gates accuses Elon Musk of harming vulnerable children (2 days ago)