How much should the week 1 results impact your projections for team wins in 2012? That’s what this post will attempt to answer.
Let’s start with the basics. Before the season, if you knew nothing about a team other than how many games it won the prior year, how many wins should you project for such team this year? This is a relatively simple question to answer giving enough historical data and a program to perform a regression analysis. After doing just that, I can tell you that you should project each team to win 5.28 games plus 0.34 times the number of games they won in the previous season. So a 4-win team projects to 6.6 wins, a 6-win team projects to 7.3 wins, and an 11-win team should drop down to 9.0 wins. There is a significant regression to the mean force at play here, unsurprisingly. Even a 15-win team projects to “only” 10.4 wins.
Of course, this is far from perfect. The R^2 of this model is just 0.11, an indication that there are significantly more factors at play in determining a team’s record than their amount of wins the prior year. Well, duh. However, we can improve on that 0.11 number. If we use SRS ratings as inputs instead of wins, that R^2 goes to 0.15. This is not surprising, and this is exactly what I mean when I say that the SRS is more predictive of future performance than wins. What’s the best-fit formula?
Each team should win 8.05 games plus or minus 0.196 wins for every point a team had in the SRS in the prior season. This means that a team that was 5 points better than average should be projected to win 9.0 games the next season, while a team that was 11 points below average in 2010 projects as a 5.9-win team in 2011.
At this point, you might think: okay, great, now let’s combine them both! Let’s use both SRS ratings and team wins as inputs and Year N+1 wins as outputs. Well, doing that adds nothing to the predictive power of the model. This is another reason not to use actual records for predictive purposes. For illustrative purposes, I performed such a regression, and the model tells us that the “record” variable has a p-value of 0.61, making it nowhere near statistically significant (and the weight on the variable was -0.04, making it practically insignificant as well). In layman’s terms, what this means is that if we already know a team’s SRS ratings, also knowing their won-loss record is not helpful to predicting their future performance.
Now have a simple way to project each team’s number of wins in a given season: 8.05 + 0.196*each team’s SRS rating from the prior year. You might wonder why that number is at 8.05 and not 8.00; that’s because I didn’t simply use the standard, regular season SRS ratings, but rather I calculated each team’s SRS score based on all of their games, postseason included. Therefore, the average is slightly higher than 8.00 since the best teams played the most games. There’s no good reason to ignore the postseason when projecting future performance (other than laziness, in which case I approve). I didn’t put special weight on games from the 2011 playoffs, but simply counted them as additional games. Anyway, the table below shows the SRS ratings from each team in 2011 and their projected 2012 wins based on the above formula:
2012 Proj W
You might be surprised to see the Packers only third on this table, since Green Bay won 15 games last year. But the 2011 Packers did not have great underlying statistics — they had a Pythagorean record of 11.9 – 4.1 against a pretty easy regular season schedule — and then they dropped a bit once you include the playoff loss to the Giants.
The key for purposes of this post is we now have baseline projections against which we can compare. Now that week 1 is in the books, what can we make of it?Let’s take the Jets as an example. Before the season, we projected them at 8.3 wins, based on them being 1.2 points above average in 2011. Now they won their first game. Even if we thought that week 1 had zero predictive meaning, we still wouldn’t project the Jets at 8.3 wins in 2012 today. Instead, we would project them to win 8.8 games. Why is that? At 8.3 wins, that means the Jets projected to win 51.9% of their games. Well, we already know they won the first game, so we give them a full win for that. Projecting the them to win 51.9% of their remaining 15 games means we’d give them 7.8 more wins; therefore, our end-of-season projection should be revised to 8.8 wins even if we think there is nothing predictive we can drive from week 1 results.
And that’s precisely what I wanted to test. The Jets surprised everyone by beating Buffalo by 20 points; we know it is a surprise because they were only a 3-point favorite, meaning they covered by 17 points. We can test to see whether the Jets exceeding expectations by 17 points in week 1 has any predictive meaning.
Here’s what I did. I performed a regression using the following two input variables: (1) Team SRS score in Year N-1 and (2) the amount of points by a team covered in week 1 of Year N. The output variable was how many wins a team earned over their last 15 games of Year N. The results? Both variables were statistically significant at even p=0.001. In other words, yes, in fact, how much a team exceeds expectations in week 1 does help us in predicting how they end up performing over the duration of the year.
The best fit formula was:
7.55 + 0.183*Year_N-1_SRS + 0.031*Week_1_Cover
What does that mean? For the Jets, they would project to win 8.3 wins over the rest of the season, or 9.3 wins for the year. Had the Jets simply won by 3 points (and therefore covered by 0 points), their end-of-year projection would remain at 8.8 wins. So the blowout, to the extent recognized by the amount of points by which they covered, means we would want to project the Jets to win 1 more game this year than we would a few days ago. Half of that is due to the fact that they netted one win already, and half is due to the blowout.
What about the Saints? New Orleans was projected to win 10.2 games, although our formula knows nothing about the Saints stressful offseason. The Saints covered by -16 points, a result of an 8-point loss despite being 8-point favorites. Those inputs gives New Orleans only 9.1 projected wins the rest of the way and for this season.
Here are the full results:
Wk 1 W/L
Wk 1 Cover
The last column there shows how much our 2012 wins projections change after this weekend’s games. Based on week 1, the Bengals, Saints, Packers, and Titans should all be projected for at least one fewer win in 2012, while the Ravens, Redskins, Jets, Falcons, and Buccaneers should move the same amount in the other direction. By virtue of their lopsided win over the Titans and their great SRS score last year, this system projects the Patriots as the team with the most wins in 2012; San Francisco isn’t far behind for the same reasons. The Giants drop from first to last in the NFC East. They were projected to win only 1.7 more games than the Redskins; following a bad week 1 for New York and an excellent performance by the Redskins, Washington actually has jumped the Giants in projected wins.
A lot of the movement is based on simply netting a win. The Eagles move from 9.1 to 9.3 wins even though they looked terrible, because they got a full win. Essentially moving from having a 57% chance of winning 16 games is less advantageous than having 1 guaranteed win and a 55% chance of winning each of their remaining 15 games. So the Eagles project to be less strong in 2012 — dropping from 57% to 55% likely to win their games — but jump in the projected wins column.
Anyway, there are many caveats that need to be taken, and a system with only two inputs is a system that can’t tell us too much. But the key takeaway for me: you certainly should revise total year-end projections based on actual win-loss results in week 1, and the data indicates that you should also revise them based on how team’s exceeded expectations, as well.