SI Index Data as of Oct 8, 2026

GPT-5.4: Price, Context, Benchmarks, and Release Details

OpenAI · first seen Oct 8, 2026 · score computed Oct 8, 2026, 22:13 UTC
61.9
SI Score (method si-v2-absolute-shrinkage-1)
#50 of 115 ranked
69% confidence 69 percent, Medium confidence — 4 of 7 expected sources in
Coverage 55% of expected source weight · 100% confidence at 80% coverage

Pillar breakdown

Coding (weight 40 percent) 62.9
Math (weight 15 percent) 82.9
Preference (weight 15 percent) 77.9
Reasoning (weight 30 percent) 74.1

Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.

Facts

Input price / 1M
not yet reported
Output price / 1M
not yet reported
Context window
1.1Mmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
Max output
128Kmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
Released
Mar 5, 2026OpenAI API changelogPublished source fact Retrieved Oct 8, 2026 · factual citation
Open source ↗
Open weights
Nomodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
text, image, pdfmodels.devPublished source fact Retrieved Oct 8, 2026 · MIT
Open source ↗

Benchmark results

43 results
Benchmark Raw result Normalized (0–100) Pillar
arc agi 2 73.3%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] VerifiedPublished Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		73.3 reasoning
arc agi v1 public eval 95.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-highPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		95.6 reasoning
arc agi v1 public eval 80%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-lowPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		80.0 reasoning
arc agi v1 public eval 92%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-mediumPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		92.0 reasoning
arc agi v1 public eval 96.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-xhighPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		96.4 reasoning
arc agi v1 semi private 92.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-highPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		92.7 reasoning
arc agi v1 semi private 68.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-lowPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		68.2 reasoning
arc agi v1 semi private 86.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-mediumPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		86.2 reasoning
arc agi v1 semi private 93.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-xhighPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		93.7 reasoning
arc agi v2 public eval 75.8%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-highPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		75.8 reasoning
arc agi v2 public eval 23.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-lowPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		23.2 reasoning
arc agi v2 public eval 58.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-mediumPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		58.2 reasoning
arc agi v2 public eval 84.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-xhighPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		84.2 reasoning
arc agi v2 semi private 67.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-highPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		67.5 reasoning
arc agi v2 semi private 29.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-lowPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		29.2 reasoning
arc agi v2 semi private 55.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-mediumPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		55.4 reasoning
arc agi v2 semi private 74.0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] gpt-5-4-xhighPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		74.0 reasoning
arc agi v3 semi private 0.2%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] openai-gpt-5-4-2026-03-05-highPublished Oct 6, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		0.2 reasoning
frontiermath tier 1 3 47.6%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] Tier 1-3Published Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		47.6 math
frontiermath tier 4 27.1%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] Tier 4Published Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		27.1 math
gpqa diamond 92.8%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] Published Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		92.8 reasoning
hle 39.8%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] no toolsPublished Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		39.8 reasoning
hle tools 52.1%Official model cards via models.devLab-reported; metric accuracy; transcribed by MIT models.dev catalog; not independently evaluated [variant] with toolsPublished Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		52.1 reasoning
livebench coding code completion 2026_06_25 80.4%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		80.4 coding
livebench coding code generation 2026_06_25 74.6%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		74.6 coding
livebench coding javascript 2026_06_25 68.2%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		68.2 coding
livebench coding python 2026_06_25 50%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		50.0 coding
livebench coding typescript 2026_06_25 43.3%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		43.3 coding
livebench math amps hard 2026_06_25 98%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		98.0 math
livebench math integrals with game 2026_06_25 93%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		93.0 math
livebench math math comp 2026_06_25 94.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		94.1 math
livebench math olympiad 2026_06_25 91.5%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		91.5 math
livebench math simplify 2026_06_25 70%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		70.0 math
livebench reasoning connections 2026_06_25 100%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		100.0 reasoning
livebench reasoning consecutive events 2026_06_25 86.2%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		86.2 reasoning
livebench reasoning logic with navigation 2026_06_25 68%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		68.0 reasoning
livebench reasoning spatial 2026_06_25 98%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		98.0 reasoning
livebench reasoning theory of mind 2026_06_25 88.5%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		88.5 reasoning
livebench reasoning zebra puzzle 2026_06_25 98%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 8, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		98.0 reasoning
lmarena text 1452.2 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 2, 2026 Retrieved Oct 8, 2026 · CC-BY-4.0
Open source ↗ 		77.9 preference
swe bench pro public 59.1%Official model cards via models.devLab-reported; metric resolve rate; transcribed by MIT models.dev catalog; not independently evaluated [variant] public Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		59.1 coding
swe bench pro public 43.4%SWE-bench Pro (public)Published steward score [variant] Published Apr 8, 2026 Retrieved Oct 8, 2026 · factual citation
Open source ↗ 		43.4 coding
terminal bench v2 0 75.1%Official model cards via models.devLab-reported; metric success rate; transcribed by MIT models.dev catalog; not independently evaluated [variant] 2.0Published Apr 23, 2026 Retrieved Oct 8, 2026 · factual citation; MIT transcription
Open source ↗ 		75.1 coding

Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.

Sources: in and pending

in Reported (4)

  • ARC Prize · arrived Oct 8, 2026
  • Official model cards via models.dev · arrived Oct 8, 2026
  • LiveBench · arrived Oct 8, 2026
  • LMArena / Arena · arrived Oct 8, 2026

pending Awaiting (3)

  • Epoch AI Benchmarking · carries 25% of expected weight
  • Humanity’s Last Exam · carries 13% of expected weight
  • Terminal-Bench · carries 6% of expected weight

The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.