Top Shelf

The Scorecardhow wrong we were

The Scorecard · graded on 2024-25

How wrong
we were

We hid the 2024-25 season from the model, projected it anyway, and then graded the result against what actually happened. Every miss is on this page, including the twelve we got most wrong, by name.

603 players graded

82.6%
of players finished inside the range we gave them.
We promised 80%. Being right far more often than that would also be a failure: it would mean we made the range wide enough never to be wrong, which tells a reader nothing. That figure is an average, and it runs from 73% to 98% depending on the player. The breakdown below shows where.
9.01 points, our average miss.
A drafter using last year's totals misses by 10.47.
65% landed within 10 points.
Last year's totals get 62%.

The twelve we got most wrong

Not a sample. These are the twelve largest misses in the whole graded set, worst first.

PlayerWe saidActual MissInside the range?
Mathew Barzal68.120.0+48.1MISSED BAND
Dylan Holloway16.363.0-46.7MISSED BAND
Kirill Kaprizov97.556.0+41.5MISSED BAND
Rickard Rakell33.070.0-37.0MISSED BAND
Aliaksei Protas29.166.0-36.9MISSED BAND
Matias Maccelli53.818.0+35.8MISSED BAND
Elias Pettersson80.245.0+35.2MISSED BAND
Matthew Tkachuk91.657.0+34.6MISSED BAND
Joel Eriksson Ek63.329.0+34.3MISSED BAND
Ryan Donato27.962.0-34.1MISSED BAND
Drew Doughty50.517.0+33.5MISSED BAND
Miro Heiskanen58.025.0+33.0MISSED BAND
The full breakdown, group by group

Players split into ten groups from lowest projection to highest. If the ranges only worked for one kind of player, it would show here.

GroupTypical projection How often the range was right How wide the range was
18.098%19
212.285%22
315.387%23
418.283%24
523.177%27
628.973%29
736.273%32
844.385%36
955.878%41
1078.685%51

Where it does not hold. Coverage is not flat. Across the ten groups it runs from 73% to 98%, and the headline 82.6% is an average of that spread rather than a description of any one group. Too narrow for groups 5 to 7 and 9, around 23 to 56 projected points, where only 73% to 78% of players landed inside. Those are middle-of-the-board players, which is where most picks actually go. Too wide for group 1, the lowest projections, at 98%. A range that is almost never wrong is not being careful, it is declining to say anything. Both directions are failures on the standard above, and both are ours to fix.

What we said we could not do. Games played is deliberately not a per-player prediction here. It lost to the league average on a season the model never saw, so it is published as a population expectation with a band. That band covered 85.7% of actuals, and on average we were off by 12.5 games. Most of the big misses above are availability rather than talent, which is the honest shape of this problem.

The projections this page grades are free.

A free Beyond the Metric account opens the full board: every skater and goalie, what each is worth over the next man up at his position, and which position runs dry first. Your draft follows you from your laptop to your phone on draft night.

See what an account opens