SI Index Data as of Oct 9, 2026

Claude Sonnet 3.7: Price, Context, Benchmarks, and Release Details

Anthropic provisional listing · first seen Oct 8, 2026 · score computed Oct 9, 2026, 01:50 UTC
48.9
SI Score (method si-v3-retained-evidence-2)
#109 of 140 ranked
100% confidence 100 percent, Full confidence — 6 of 9 expected sources in
Coverage 80% of expected source weight · 100% confidence at 80% coverage

Pillar breakdown

Coding (weight 40 percent) 60.7
Math (weight 15 percent) 70.9
Preference (weight 15 percent) 62.2
Reasoning (weight 30 percent) 14.4

Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.

Facts

Input price / 1M
not yet reported
Output price / 1M
not yet reported
Context window
200Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Max output
64Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Released
Feb 19, 2025models.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Open weights
Nomodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
text, image, pdfmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗

Benchmark results

31 results
Benchmark Raw result Normalized (0–100) Pillar
aider polyglot 60.4%Aider polyglotPublished source fact [variant] Aider polyglot; 225 cases; 2 attemptsPublished Feb 24, 2025 Retrieved Oct 9, 2026 · Apache-2.0
Open source ↗ 		60.4 coding
arc agi v1 semi private 13.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		13.6 reasoning
arc agi v1 semi private 28.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 16KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		28.6 reasoning
arc agi v1 semi private 11.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 1KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		11.6 reasoning
arc agi v1 semi private 21.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 8KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		21.2 reasoning
arc agi v2 public eval 0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.0 reasoning
arc agi v2 public eval 0.8%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 16KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.8 reasoning
arc agi v2 public eval 0.8%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 1KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.8 reasoning
arc agi v2 public eval 0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 8KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.0 reasoning
arc agi v2 semi private 0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.0 reasoning
arc agi v2 semi private 0.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 16KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.7 reasoning
arc agi v2 semi private 0.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 1KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.4 reasoning
arc agi v2 semi private 0.9%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] Claude 3.7 Thinking 8KPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		0.9 reasoning
gpqa diamond 66.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 24, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		66.0 reasoning
gpqa diamond 76.8%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished Feb 26, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		76.8 reasoning
gpqa diamond 76.8%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 32KPublished Mar 10, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		76.8 reasoning
gpqa diamond 78.5%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 64KPublished May 26, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		78.5 reasoning
hle scale 8.0%Humanity’s Last ExamThinking budget: 16,000 tokens. Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. [variant] Published Apr 10, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		8.0 reasoning
lmarena text 1299.5 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 2, 2026 Retrieved Oct 9, 2026 · CC-BY-4.0
Open source ↗ 		62.2 preference
math level 5 68.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 24, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		68.2 math
math level 5 86.3%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished Feb 26, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		86.3 math
math level 5 90.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 32KPublished Mar 12, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		90.0 math
math level 5 91.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 64KPublished Mar 13, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		91.2 math
otis mock aime 2024 2025 21.9%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 25, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		21.9 math
otis mock aime 2024 2025 46.7%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished Feb 26, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		46.7 math
otis mock aime 2024 2025 53.3%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 32KPublished Mar 12, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		53.3 math
otis mock aime 2024 2025 57.8%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 64KPublished Mar 13, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		57.8 math
swe bench verified 61.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 4, 2026 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		61.0 coding
swe bench verified 66.4%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] Aime-coder v1Published May 14, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		66.4 coding
swe bench verified 52.8%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] mini-SWE-agent; 0.0.0Published Jul 20, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		52.8 coding
swe bench verified 63.2%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] ToolsPublished Feb 24, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		63.2 coding

Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.

Sources: in and pending

in Reported (6)

  • Aider polyglot · arrived Oct 8, 2026
  • ARC Prize · arrived Oct 8, 2026
  • Epoch AI Benchmarking · arrived Oct 8, 2026
  • Humanity’s Last Exam · arrived Oct 8, 2026
  • LMArena / Arena · arrived Oct 8, 2026
  • SWE-bench Verified · arrived Oct 8, 2026

pending Awaiting (3)

  • Official model cards via models.dev · carries 4% of expected weight
  • LiveBench · carries 11% of expected weight
  • Terminal-Bench · carries 5% of expected weight

The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.