← Projections · model rush-20261020-1640, trained through 2026 week 6
Reading the Backtest
Accuracy vs actual carries
Each season from 2018 to 2025 was predicted by a model that only saw earlier seasons. Each
week of the current season was predicted by a model that only saw earlier weeks. MAE is the
average miss in carries, and RMSE punishes big misses more. Both are measured on RB and QB
player-games (WR and TE carries are near zero and would flatter every model).
Factor ablation
To judge each factor family from the original design (game script, run rate over expected,
situational tendencies, drive-sustain rates, RB workload, defensive fronts, trench grades),
the model is refit without that family on 2022–2025. "Delta" is how much worse the held-out
error gets without it. A bigger positive delta means the family matters more. Near zero means
the other inputs already carry that information.
Over / under the closing line
For every player-game since 2023 with a posted rush-attempts prop, the closing line (45
minutes before kickoff, The Odds API historical snapshot) is compared with the official carries.
Consensus is the most common line across books; Pinnacle is the sharpest book; Hard Rock exists
from September 2026. Over% and Under% exclude pushes. Only players who recorded a box-score line
are counted. A player listed with a line who then sat is a void at the book, not an under.
Model vs the close
The model never sees betting lines. The diagnostic compares its out-of-sample P(Over) with
the de-vigged closing price on the same rows (Brier score, lower is better). If the market's
Brier is lower, the closing line is the better forecast and the model is a projection tool,
not a betting signal.
Accuracy vs actual carries
Held-out seasons 2018, 2019, 2020, 2021, 2022, 2023, 2024, 2025,
plus 2026 week by week. RB and QB player-games with at least one prior game.
Live model: Team × share + trees. It beats every baseline on both MAE and RMSE:
yes.
Model MAE
2.69
carries per player-game, n=18,961
Last-4 avg MAE
2.91
7.6% worse than the model
2026 MAE
2.52
week-by-week, bias -0.18
80% range coverage
80.5%
held-out, target 80%
Model
n
MAE
RMSE
Mean pred
Mean actual
2026 MAE
2026 RMSE
Team × share + trees
18,961
2.694
3.853
5.96
5.99
2.516
3.625
Team × share + trees (bias-corrected)
18,961
2.698
3.855
5.99
5.99
2.517
3.624
Team carries × share
18,961
2.694
3.855
5.97
5.99
2.518
3.622
One-stage trees (LightGBM)
18,961
2.707
3.872
5.96
5.99
2.535
3.643
Average of all three
18,961
2.726
3.880
6.09
5.99
2.530
3.638
One-stage Poisson regression
18,961
2.895
4.140
6.36
5.99
2.593
3.732
Last-4-game average
18,961
2.915
4.254
6.01
5.99
2.923
4.173
Team L4 carries × L4 share
18,961
2.918
4.262
6.00
5.99
2.914
4.156
Season average
18,961
2.913
4.270
5.87
5.99
2.920
4.236
Per season (MAE, RB + QB)
Season
n
Model
Last-4
Season avg
Volume
2018
2,295
2.69
2.83
2.83
2.83
2019
2,280
2.55
2.73
2.71
2.73
2020
2,374
2.72
2.98
2.98
3.00
2021
2,452
2.80
3.11
3.11
3.11
2022
2,416
2.76
2.95
2.93
2.96
2023
2,405
2.68
2.94
2.95
2.93
2024
2,365
2.73
2.96
2.97
2.96
2025
2,374
2.61
2.82
2.80
2.82
2026
752
2.52
2.92
2.92
2.91
Calibration (held-out RB + QB)
Projected
n
Mean pred
Mean actual
0-1
2,256
0.36
0.42
1-3
5,106
2.08
2.16
3-6
5,021
4.23
4.17
6-9
2,116
7.36
7.41
9-12
1,611
10.48
10.66
12-15
1,707
13.45
13.59
15-18
1,153
16.29
16.03
18+
383
19.56
19.35
Team stage: team carries per game
Model
n
MAE
RMSE
Team model
4,454
5.82
7.21
Last-4 average
4,454
6.45
8.01
Season average
4,454
6.31
7.85
Over / under the closing line
Every player-game since 2023 with a posted rush-attempts prop, closing line vs official carries.
Over% and Under% exclude pushes. Players without a box-score line (did not play) are excluded.
Out-of-sample model on the same player-games. The model's average miss is 3.20 carries
vs 3.07 for the closing line itself. When the model is above the line, the over hit
53.6% of the time it leaned (both directions combined). By the gap between the model's and the market's over probability:
|Model − no-vig|
n
Overs / unders
Model's side hit
Flat-stake ROI at the close
0.00-0.03
737
330 / 407
53.5%
+0.1% ± 3.5
0.03-0.06
705
256 / 449
48.9%
-8.3% ± 3.5
0.06-0.10
839
248 / 591
53.2%
-0.4% ± 3.2
0.10-1.00
2,060
334 / 1726
55.0%
+3.8% ± 2.1
Break-even at standard −110 juice is 52.4%. ROI uses the closing price of the side the model favors (± one standard error). For reference, betting every under at the close returned
-1.2%. These are out-of-sample model numbers, but the closes cover only 2023 onward. Treat a bucket as real only if it holds season after season. It is not a guarantee.
Players vs their closing line
Consensus close, 2023 only, at least 4 lines. Sorted by over rate.