SI Index Data as of Oct 9, 2026

DeepSeek V4 Flash 0731: Price, Context, Benchmarks, and Release Details

DeepSeek provisional listing open weights · first seen Oct 8, 2026 · score computed Oct 9, 2026, 01:49 UTC
61.0
SI Score (method si-v3-retained-evidence-2)
#60 of 140 ranked
69% confidence 69 percent, Medium confidence — 4 of 7 expected sources in
Coverage 55% of expected source weight · 100% confidence at 80% coverage

Pillar breakdown

Coding (weight 40 percent) 59.7
Math (weight 15 percent) 71.3
Preference (weight 15 percent) —
Reasoning (weight 30 percent) 82.9

Pillar weights: reasoning 30% · math 15% · coding 40% · preference 15%. Benchmark results use fixed 0–100 scales before averaging; incomplete evidence is shrunk toward 50.

Facts

Input price / 1M
not yet reported
Output price / 1M
not yet reported
Context window
1Mmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Max output
384Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Released
Jul 31, 2026models.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Open weights
YesHugging Face HubPublic Hub repo with weight files; gating/repo upload date is not release date Retrieved Oct 9, 2026 · factual metadata; model-specific licenses
Open source ↗
License
mitHugging Face HubPublished source fact Retrieved Oct 9, 2026 · factual metadata; model-specific licenses
Open source ↗
Input modalities
textmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Popularity rank
#8 by usageOpenRouter rankingsPublished source fact; tokens processed; page default period; excludes catalog and endpoint statistics Retrieved Oct 9, 2026 · CC-BY-4.0
Open source ↗

Benchmark results

33 results
Benchmark Raw result Normalized (0–100) Pillar
arc agi v1 public eval 92.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		92.5 reasoning
arc agi v1 public eval 93%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		93.0 reasoning
arc agi v1 public eval 94.8%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		94.8 reasoning
arc agi v1 semi private 87%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		87.0 reasoning
arc agi v1 semi private 84%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		84.0 reasoning
arc agi v1 semi private 89%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		89.0 reasoning
arc agi v2 public eval 59.9%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		59.9 reasoning
arc agi v2 public eval 47.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		47.4 reasoning
arc agi v2 public eval 63.9%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		63.9 reasoning
arc agi v2 semi private 56.0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'high' reasoning effort. [variant] deepseek-v4-flash-0731-highPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		56.0 reasoning
arc agi v2 semi private 46.0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'low' reasoning effort. [variant] deepseek-v4-flash-0731-lowPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		46.0 reasoning
arc agi v2 semi private 61.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. Evaluation conducted with 'max' reasoning effort. [variant] deepseek-v4-flash-0731-maxPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 		61.4 reasoning
frontiermath tier 4 v2 24.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		24.4 math
frontiermath tiers 1 3 v2 57.5%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		57.5 math
gpqa diamond 91.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		91.0 reasoning
livebench coding code completion 2026_06_25 73.9%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		73.9 coding
livebench coding code generation 2026_06_25 76.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		76.1 coding
livebench coding javascript 2026_06_25 63.6%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		63.6 coding
livebench coding python 2026_06_25 50%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		50.0 coding
livebench coding typescript 2026_06_25 26.7%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		26.7 coding
livebench math amps hard 2026_06_25 97%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		97.0 math
livebench math integrals with game 2026_06_25 65%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		65.0 math
livebench math math comp 2026_06_25 96.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		96.1 math
livebench math olympiad 2026_06_25 89.1%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		89.1 math
livebench math simplify 2026_06_25 58.4%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		58.4 math
livebench reasoning connections 2026_06_25 97.3%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		97.3 reasoning
livebench reasoning consecutive events 2026_06_25 89.4%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		89.4 reasoning
livebench reasoning logic with navigation 2026_06_25 70%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		70.0 reasoning
livebench reasoning spatial 2026_06_25 90%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		90.0 reasoning
livebench reasoning theory of mind 2026_06_25 86.5%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		86.5 reasoning
livebench reasoning zebra puzzle 2026_06_25 100%LiveBenchLiveBench subtask result; dataset edition 2026_06_25; publication time is HTTP Last-Modified of the score CSV, not the dataset edition or individual evaluation date [variant] 2026_06_25Published Oct 7, 2026 Retrieved Oct 9, 2026 · factual citation; Apache-2.0 code
Open source ↗ 		100.0 reasoning
otis mock aime 2024 2025 94.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] maxPublished Aug 2, 2026 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 		94.4 math
terminal bench v2 1 82.7%Official model cards via models.devLab-reported; metric pass@1; transcribed by MIT models.dev catalog; not independently evaluated [variant] max; 2.1 Retrieved Oct 9, 2026 · factual citation; MIT transcription
Open source ↗ 		82.7 coding

Normalization uses fixed absolute 0–100 scales for each unit, independently of other models that have a result on each benchmark. Coverage and evidence breadth still affect the composite; compare the evaluation conditions before reading a small score gap as decisive. “lab-reported” marks the provider's own published figure.

Sources: in and pending

in Reported (4)

  • ARC Prize · arrived Oct 8, 2026
  • Epoch AI Benchmarking · arrived Oct 8, 2026
  • Official model cards via models.dev · arrived Oct 8, 2026
  • LiveBench · arrived Oct 8, 2026

pending Awaiting (3)

  • Humanity’s Last Exam · carries 13% of expected weight
  • LMArena / Arena · carries 25% of expected weight
  • Terminal-Bench · carries 6% of expected weight

The confidence % rises as pending sources publish. Some sources never cover some models — that is why 100% confidence arrives at 80% of expected weight, not at full coverage.