AIThe Decoder1h ago
Google's Gemini 4 Argon is closer to the AI frontier than any Google
Google's Gemini 4 Argon is closer to the AI frontier than any Google model in months
TL;DRGoogle's new AI model scores high on one benchmark but much lower on standard tests.
Why it matters: Reveals the gap between cherry-picked benchmarks and real-world AI performance; affects how we evaluate AI progress claims.
Google Deepmind's Gemini 4 Argon scored 97.5 percent on the ARC-AGI-3 benchmark, making Google the second lab after OpenAI to cross the 95 percent mark. But the results swing wildly depending on the test setup: in the standard harness, the score drops to just 49.8 percent. Argon…
Read full articleSource: The Decoder · Opens in new tab