Model Backtest

The Crystal Ball

How well does the WFS predictor actually predict? Every game since 1980, scored against our pre-game forecast.

55.5%
Predicted W/D/L matched actual
Outright correct
59.5%
Higher-rated team avoided defeat
Favourite correct
0.161
Lower = better calibrated
Brier score
38,048
Every historical prediction
Backtested games

Model Calibration

When the model predicts a 60% chance, does the favourite really win 60% of the time? Perfect calibration follows the diagonal. The shaded band is the Wilson 95% interval.

Accuracy by Decade

How model accuracy has shifted across eras. More games per team in the modern era means stronger ratings and sharper predictions.

Accuracy by Rating Gap

Confidence scales with the rating delta. Narrow gaps are coin-flips; wide gaps are near-certain calls.

Accuracy by Tournament Type

1World
61.6%
2Continental
59.7%
3Minor
56.4%
4Major
55.4%
5Friendly
49.9%
6Friendly Tournament
48.6%
7Regional
48.2%

The Biggest Upsets

Games where the model gave the eventual winner the lowest pre-game probability. The percentage badge is what the model thought of their chances.

0.1%
0 - 3
South Pacific Games 22 Aug 1983
0.1%
1 - 0
Friendly 1 Apr 2000
0.2%
2 - 0
Friendly 6 Jun 1982
0.2%
2 - 1
CFU Caribbean Cup 6 May 1990
0.2%
1 - 0
Friendly 6 Oct 1981
0.3%
3 - 2
Friendly Tournament 22 Jun 1981
0.3%
0 - 3
Friendly Tournament 3 Aug 1998
0.4%
3 - 2
Friendly 9 May 1980
0.4%
0 - 1
FIFA World Cup 11 Oct 2016
0.4%
1 - 2
FIFA World Cup 10 Sep 2008
0.4%
1 - 0
Friendly 22 Mar 1998
0.5%
2 - 3
Africa Cup of Nations 15 Jun 2012