A difficult set of open-ended real-world prompts evaluated with automated judges and style controls.
These scores are reproduced from the linked primary source. They have not been re-evaluated or adjusted by Shareof.ai.
Arena-Hard v2.0 uses 500 hard prompts and 250 creative-writing prompts, with GPT-4.1 and Gemini 2.5 used as automated judges in the published configurations.
Reported metric: Win rate. A higher score represents stronger measured performance within this benchmark.
These are automated-judge results, not the human-vote LMArena leaderboard. Judge choice and style controls materially affect scores.
Use the leaderboard to compare configurations evaluated under this exact methodology. Do not compare these values directly with a similarly named metric from another benchmark.
A transparent, reproducible evaluation of general language-model capabilities across a curated collection of difficult scenarios.
A standardized collection of safety evaluations spanning violence, fraud, discrimination, harassment, sexual content and deception.
A reproducible evaluation of how reliably models reason over long documents, conversations and multi-hop evidence.
A healthcare-focused evaluation framework grounded in real clinical tasks, including reasoning and patient communication.
Run a live visibility check and compare your brand with the companies appearing in the same AI answers.
Benchmark my business →