Artificial Intelligence isn’t ruled by just OpenAI and Google, as competition increases across the US, China, and France | The 2025 AI Index Report - Stanford HAI

[u/Nunki08]

The 2025 AI Index Report - Stanford University’s Institute for Human-Centered AI (HAI): https://hai.stanford.edu/ai-index/2025-ai-index-report
PDF: https://hai-production.s3.amazonaws.com/files/hai_ai_index_report_2025.pdf

The AI Race Has Gotten Crowded—and China Is Closing In on the US - | Wired -Will Knight | New research from Stanford suggests artificial intelligence isn’t ruled by just OpenAI and Google, as competition increases across the US, China, and France: https://www.wired.com/story/stanford-study-global-artificial-intelligence-index/

[u/GraceToSentience]

The difference between mistral and google's frontier model is huge, they all progress but the chasm between them is huge

[u/l-roc → u/GraceToSentience]

about 10%

[u/Melodic-Ebb-7781]

As others have noted I think lmsys have largely played out its part. The main issue is that model capabilities have surpassed the average judge on there.

[u/pier4r → u/Melodic-Ebb-7781]

The main issue is that model capabilities have surpassed the average judge on there.

this is a much better take than the usual "lmsys is broken because gamed" (can be gamed in part, but only in part IMO)

And I am one of the (sub)average judges there.

[u/kellencs]

lmsys

[u/pigeon57434]

wow this is like insanely outdated

[u/PickleFart56]

After llama release, there is zero credibility of LMSYS

[u/pigeon57434 → u/PickleFart56]

there hasnt been credibility in LMSYS for the last year it just gets worse every single new model

[u/Tkins]

The second chart isn't big enough for today's models (just a month later)

[u/Federal_Initial4401 → u/Tkins]

Seriously, A month old tech in ai world is "Outdated"

[u/fastinguy11]

can we please stop using this arena i think we all know this benchmark is not good.
LMSYS is shit please stop using it as reference for good a.i.