World Cup Predictor
19:52 GMT-4
Scorecard

How the model is doing

Across 104 matches, the model's most-likely outcome happened 65% of the time — a Brier score of 0.493 vs 0.642 for the base rates alone.

A prediction tool is only as good as its record. Every figure here scores the model's own pre-match calls against what actually happened — no hindsight.

65%
Favourite hit-rate
the model's top pick was the result
0.493
Brier score
lower is better · 0.642 = no skill
+23%
Skill vs base rates
Brier improvement over the averages

Calibration

When the model says it's X% sure, does it happen X% of the time? Predicted vs actual, by confidence bucket.

40–50%
Pred
46%
Real
41%
22
50–60%
Pred
55%
Real
71%
21
60–70%
Pred
63%
Real
64%
14
70–80%
Pred
75%
Real
94%
18
80–100%
Pred
85%
Real
67%
21

The pre-tournament call

The model had Spain — the eventual champion — 1st in its pre-tournament title odds, at 29%.

25/32

25 of the 32 teams that reached the Round of 32 were in the model's pre-tournament top 32.

Brier is the mean squared error of the pre-match win/draw/loss probabilities vs the result (a knockout level after 90 counts as a draw). Calibration buckets the model's confidence in its top pick. The pre-tournament call replays the model with no results.

Continua a esplorare

GitHub