Gemma 3 4B
Google · open weights · released 2025-03-12 · route gemma3:4b · Model profile · Chess results
Results
- Score
- 095%: 0 to 20 · 7 of 42 grids so far
- Grids solved
- 0 of 7
- Blank cells filled correctly
- 6.7%
- Wrong cells / empty cells / changed a given / no grid
- 0 / 0 / 5 / 2
- Broke the rules (complete grid repeating a digit)
- 0
- Near misses (three cells or fewer wrong)
- 0
- Average stated confidence
- 96%
- Average confidence when it had not solved it
- 96%
- Sure but wrong (90% or more, unsolved)
- 7
- Calibration (Brier, lower is better)
- 0.925
- API-equivalent cost per grid
- n/a
- API-equivalent cost per solved grid
- n/a
- Seconds per grid
- 18
- Tokens per grid (in / out)
- 464 / 177
- Reasoning tokens per grid
- n/a
- Retries for an unreadable reply
- 2
- Aborted on our side (not counted)
- 0
By tier
| Tier | Needs | Solved | Output tokens | Seconds |
|---|---|---|---|---|
| Cozy | Singles only | 0 of 1 | 142 | 16 |
| Gentle | Scanning | 0 of 1 | 295 | 15 |
| Steady | Locked candidates | 0 of 1 | 133 | 14 |
| Tricky | Hidden pairs and triples | 0 of 1 | 259 | 37 |
| Devious | Wings and fish | 0 of 1 | 132 | 7 |
| Expert | Deep wings and fish | 0 of 1 | 149 | 24 |
| Beyond | No human technique finishes it | 0 of 1 | 127 | 14 |
Cells by the technique they needed
Each blank cell is tagged with the simplest technique that fills it, given everything a solver could fill before it.
| Technique | Cells | Filled correctly |
|---|---|---|
| Last free cell | 61 | 11.5% |
| Scanning | 79 | 10.1% |
| Locked candidates | 46 | 0.0% |
| Hidden pairs and triples | 1 | 100.0% |
| Wings and fish | 22 | 9.1% |
| Deep wings and fish | 34 | 14.7% |
| Search | 33 | 9.1% |
Every answer
Cozy #1Changed a given digit 4 of 50 cells95% sure · 142 tokens · localGentle #1No readable grid 0 of 56 cells99% sure · 295 tokens · localSteady #1Changed a given digit 2 of 53 cells95% sure · 133 tokens · localTricky #1No readable grid 0 of 55 cells99% sure · 259 tokens · localDevious #1Changed a given digit 6 of 55 cells95% sure · 132 tokens · localExpert #1Changed a given digit 7 of 58 cells95% sure · 149 tokens · localBeyond #1Changed a given digit 7 of 60 cells95% sure · 127 tokens · local