SUDOKU BENCHMARK · REASONING MEDIUM

GPT-6 Luna

Openai · released 2026-09-22 · route gpt-6-luna · Model profile · Chess results

Results

Score
095%: 0 to 9
Grids solved
0 of 42
Blank cells filled correctly
8.6%
Wrong cells / empty cells / changed a given / no grid
3 / 5 / 20 / 14
Broke the rules (complete grid repeating a digit)
3
Near misses (three cells or fewer wrong)
0
Average stated confidence
8%
Average confidence when it had not solved it
8%
Sure but wrong (90% or more, unsolved)
3
Calibration (Brier, lower is better)
0.075
API-equivalent cost per grid
$0.0024
API-equivalent cost per solved grid
n/a
Seconds per grid
24
Tokens per grid (in / out)
56,078 / 1,779
Reasoning tokens per grid
1,234
Retries for an unreadable reply
24
Aborted on our side (not counted)
0

By tier

TierNeedsSolvedOutput tokensSeconds
CozySingles only0 of 61,82623
GentleScanning0 of 61,48520
SteadyLocked candidates0 of 61,97127
TrickyHidden pairs and triples0 of 61,74824
DeviousWings and fish0 of 61,83624
ExpertDeep wings and fish0 of 62,20330
BeyondNo human technique finishes it0 of 61,38122

Cells by the technique they needed

Each blank cell is tagged with the simplest technique that fills it, given everything a solver could fill before it.

TechniqueCellsFilled correctly
Last free cell33117.5%
Scanning49812.8%
Locked candidates10417.3%
Hidden pairs and triples1565.1%
Wings and fish13514.1%
Deep wings and fish540.0%
Search19912.1%

Every answer

Cozy #1Left cells empty 0 of 50 cells0% sure · 1,615 tokens · $0.0023Cozy #2Left cells empty 0 of 48 cells0% sure · 2,854 tokens · $0.0029Cozy #3Changed a given digit 11 of 49 cells100% sure · 53 tokens · $0.0009Cozy #4Changed a given digit 16 of 50 cells0% sure · 2,920 tokens · $0.0027Cozy #5No readable grid 0 of 49 cells0% sure · 1,932 tokens · $0.0036Cozy #6Changed a given digit 12 of 39 cells0% sure · 1,583 tokens · $0.0012Gentle #1Changed a given digit 12 of 56 cells0% sure · 1,270 tokens · $0.0020Gentle #2Changed a given digit 15 of 51 cells0% sure · 1,205 tokens · $0.0014Gentle #3Changed a given digit 7 of 52 cells100% sure · 53 tokens · $0.0002Gentle #4Left cells empty 0 of 51 cells0% sure · 1,480 tokens · $0.0018Gentle #5Wrong cells 5 of 56 cells0% sure · 2,558 tokens · $0.0026Gentle #6No readable grid 0 of 52 cells2,344 tokens · $0.0033Steady #1Changed a given digit 0 of 53 cells0% sure · 2,356 tokens · $0.0036Steady #2No readable grid 0 of 53 cells0% sure · 2,072 tokens · $0.0028Steady #3Changed a given digit 15 of 49 cells0% sure · 905 tokens · $0.0022Steady #4No readable grid 0 of 54 cells0% sure · 2,445 tokens · $0.0036Steady #5No readable grid 0 of 53 cells2,571 tokens · $0.0028Steady #6No readable grid 0 of 54 cells0% sure · 1,476 tokens · $0.0024Tricky #1Changed a given digit 0 of 55 cells0% sure · 1,120 tokens · $0.0019Tricky #2No readable grid 0 of 57 cells0% sure · 2,107 tokens · $0.0041Tricky #3Changed a given digit 10 of 57 cells0% sure · 1,312 tokens · $0.0014Tricky #4Changed a given digit 0 of 54 cells0% sure · 1,142 tokens · $0.0024Tricky #5Changed a given digit 11 of 55 cells0% sure · 2,857 tokens · $0.0040Tricky #6No readable grid 0 of 56 cells0% sure · 1,950 tokens · $0.0027Devious #1Changed a given digit 0 of 55 cells0% sure · 1,848 tokens · $0.0029Devious #2Changed a given digit 0 of 55 cells0% sure · 1,485 tokens · $0.0024Devious #3No readable grid 0 of 49 cells0% sure · 3,058 tokens · $0.0030Devious #4Wrong cells 24 of 40 cells0% sure · 1,216 tokens · $0.0012Devious #5Wrong cells 15 of 47 cells0% sure · 1,801 tokens · $0.0018Devious #6Changed a given digit 0 of 54 cells0% sure · 1,610 tokens · $0.0018Expert #1No readable grid 0 of 58 cells0% sure · 3,434 tokens · $0.0051Expert #2No readable grid 0 of 53 cells0% sure · 2,533 tokens · $0.0041Expert #3Left cells empty 0 of 54 cells0% sure · 1,588 tokens · $0.0016Expert #4No readable grid 0 of 57 cells0% sure · 1,689 tokens · $0.0020Expert #5Left cells empty 0 of 58 cells0% sure · 1,405 tokens · $0.0016Expert #6No readable grid 0 of 54 cells0% sure · 2,569 tokens · $0.0029Beyond #1Changed a given digit 14 of 60 cells0% sure · 2,184 tokens · $0.0024Beyond #2Changed a given digit 5 of 57 cells0% sure · 1,715 tokens · $0.0036Beyond #3Changed a given digit 0 of 56 cells0% sure · 1,068 tokens · $0.0012Beyond #4Changed a given digit 12 of 57 cells100% sure · 53 tokens · $0.0002Beyond #5Changed a given digit 7 of 59 cells0% sure · 1,367 tokens · $0.0016Beyond #6No readable grid 0 of 57 cells0% sure · 1,901 tokens · $0.0035