ZDNet

With AI models clobbering every benchmark, it's time for human evaluation

Artificial intelligence has traditionally advanced through automatic accuracy tests in tasks meant to approximate human knowledge. Carefully crafted benchmark tests such as The General Language ...
Time

AI Models Are Getting Smarter. New Tests Are Racing to Catch Up

Follow this section to personalize your feed and get instant alerts. WHY FOLLOW? Update your preferences in Account Settings Personalized Content Follow this tag to personalize your feed and get ...
Gizmodo

OpenAI Claims Its New Model Reached Human Level on a Test for ‘General Intelligence.’ What Does That Mean?

OpenAI’s o3 system scored 85% on the ARC-AGI benchmark, well above the previous AI best score of 55% and on par with the average human score. Reading time 4 minutes A new artificial intelligence (AI) ...
Nature

The Two Word Test as a semantic benchmark for large language models

Large language models (LLMs) have shown remarkable abilities recently, including passing advanced professional exams and demanding benchmark tests. This performance has led many to suggest that they ...
Android Police

OpenAI's simulated reasoning AI models matched human levels on ARC-AGI benchmark — Here's what that means for you

Benjamin is a business consultant, coach, designer, musician, artist, and writer, living in the remote mountains of Vermont. He has 20+ years experience in tech, an educational background in the arts, ...
UPI

AI model achieves human level performance on general intelligence test

Dec. 24 (UPI) --A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure "general intelligence". On December 20, OpenAI's o3 system scored 85% on ...
The Conversation

An AI system has reached human level on a test for ‘general intelligence’. Here’s what that means

A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure “general intelligence”. On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI ...
MIT Technology Review

AI benchmarks are broken. Here’s what we need instead.

One-off tests don’t measure AI’s true impact. We’re better off shifting to more human-centered, context-specific methods. For decades, artificial intelligence has been evaluated through the question ...