CategoryWeight: 1.0x

Long Reasoning

Multi-step logic puzzles, extended chain-of-thought, and complex analytical reasoning tasks requiring sustained coherence over many steps.

Best Score

0.0

Avg Score

0.0

Tests

Performance Over Time — All Models

Model Rankings

Claude Sonnet 5

Category score

View

51.6BEST

Tokens16.6k

Total16.6k

Grok 4.5

Category score

View

46.4-5.2 pts

Tokens60.0k

Total60.0k

Claude Opus 5

Category score

View

46.2-5.4 pts

Tokens14.3k

Total14.3k

GPT-5.6 Sol

Category score

View

39.8-11.8 pts

Tokens47.5k

Total47.5k

Rank	Model	Score	Tokens	vs. Best	Details
1	Claude Sonnet 5	51.6	16.6k	BEST	View
2	Grok 4.5	46.4	60.0k	-5.2 pts	View
3	Claude Opus 5	46.2	14.3k	-5.4 pts	View
4	GPT-5.6 Sol	39.8	47.5k	-11.8 pts	View

Test Breakdown

Multi-step Logic Puzzle

Complex optimization with 8+ constraints across multiple variables

Claude Sonnet 5

57.2

Grok 4.5

47.2

Claude Opus 5

56.0

GPT-5.6 Sol

17.0

Legal Reasoning Chain

Contract dispute analysis requiring multi-party obligation tracking

Claude Sonnet 5

20.0

Grok 4.5

12.0

Claude Opus 5

5.0

GPT-5.6 Sol

25.0

Mathematical Proof

Prove divisibility properties using induction and modular arithmetic

Claude Sonnet 5

77.5

Grok 4.5

79.9

Claude Opus 5

77.5

GPT-5.6 Sol

77.5