≡ Menu

Andrew Healy, frequent contributor here and at Football Outsiders, is back for another guest post. You can also view all of Andrew’s guest posts at Football Perspective at this link, and follow him on twitter @AndHealy.


For a stats guy, the Wells Report is gripping reading, particularly the appendices provided by the consulting firm Exponent. The conclusion there is pretty simple. Compared to referee Walt Anderson’s pregame measurements, the Patriots’ footballs dropped significantly further in pressure than the Colts’ footballs did. Therefore, even if Tom Brady’s involvement is unclear, a Patriots’ employee probably deflated the balls.

At first glance, that evidence seems pretty convincing, maybe even strong enough to conclude more definitively that tampering occurred. And it is kind of awesome that the officials even created a control group. But there is a problem with making firm conclusions: timing. As Exponent acknowledges, the measured pressure of the balls depends on when the gauging took place. The more time that each football had to adjust to the warmer temperature of the officials’ locker room at halftime, the higher the ball pressure would rise.

And, not surprisingly given the Colts’ accusations, the officials measured the Patriots’ footballs first. This means that the New England footballs must have had less time to warm up than the Indianapolis footballs. Is that time significant? We will get to that, but it does make for a good argument that the Indianapolis footballs are not an adequate control group for the New England footballs. Given the order of events, we would expect the drop of pressure from Anderson’s initial measurements to be lower for the Colts’ balls that had more time indoors at halftime. As the Wells report notes, the likely field temperature was in the 48-50 degree range, compared to the 71-74 degree range for the room where the footballs were measured.

So, how much lower? Here it gets a little fuzzy. The report is clear that the Patriots footballs were gauged first during halftime, but it is unclear about whether the second step was to reinflate the Patriots’ balls or to measure the four Colts’ balls. In Appendix 1 (see p. 2 of the appendix), Exponent notes “although there remains some uncertainty about the exact order and timing of the other two events, it appears likely the reinflation and regauging occurred last.” If events unfolded this way, it would make the Indianapolis footballs at least a better sort of control group. [continue reading…]

{ 34 comments }

Weekend Trivia: Supplemental Draft

Given that the NFL draft and the lead-up to the draft have become so remarkably over-exposed, is there anything about the NFL that is under-exposed at this point? Or at least not over-exposed? Maybe the answer is no, but today’s trivia questions at least look at the hidden part of the draft: the supplemental draft.

After producing Steve Young and Bernie Kosar in the 1980s, the supplemental draft mostly went dead at producing quarterbacks from 1990 until Terrelle Pryor in 2011. Who is the only quarterback that was drafted in the supplemental during that time?

Trivia hint 1 Show


Trivia hint 2 Show


Trivia hint 3 Show


Click 'Show' for the Answer Show

Just as only one quarterback was selected in the supplemental draft in the 90s, there was only one quarterback chosen in the supplemental draft in the 1970s. Can you name him?

Trivia hint 1 Show


Trivia hint 2 Show


Trivia hint 3 Show


Click 'Show' for the Answer Show

{ 6 comments }

Last year, I wrote a post on the plays that had the biggest impact on the eventual Super Bowl champion. These were the plays that affected the Super Bowl win probability by the biggest amount among teams that did not win the title. At the time, the Buffalo Bills were on the short end of the most influential play in the Super Bowl era. When Frank Reich put the ball down for Scott Norwood, I estimated that the Bills had a 45% chance on winning the Super Bowl. [1]Recent research by Chase suggests something similar. After the kick went wide right, the Bills’ win probability fell to zero. The 45 percentage point fall was the biggest change for a non-champion of any play in the Super Bowl era. Over 48 years, a bunch of plays fell in that range, but no team could point to a single play as having lowered its championship chances by so large an amount.

A couple weeks ago, that long-held record got broken kind of like Michael Johnson broke the 200-meter record in the Atlanta Olympics. Malcolm Butler’s pick obliterated the old mark. My estimate has the Butler interception as increasing the Patriots’ chances of winning by 0.87. There is no doubt that what some have called the Immaculate Interception is on an island by itself as the most influential play in NFL history.

To get that change in win probability from Butler’s play, I am going to assume that the Seahawks would have run on third and fourth down. I am going to give a run from the one a 60% chance of working. That might seem high, but the Patriots were the worst team in football in stuffing the run in important short-yardage situations either on third or fourth down, or down by the goal line. And their limited success mostly came against terrible running teams. It is not a huge sample, but against teams outside the worst quarter of rushing teams by DVOA, the Patriots had allowed opponents to convert 16 of 17 times with two yards or less to go for a first down or touchdown. If we add the playoffs, they actually had three more stops against good running teams (Baltimore and Seattle), albeit in games where the opponent had a good amount of success on the ground. [2]Note that the stop against Baltimore should not even count. In an otherwise great game for Gary Kubiak, he called for a reverse to Michael Campanaro on third-and-1 in the second quarter. The run was … Continue reading With Seattle being the best rushing team in football by a mile and the Patriots being at best not great in run defense in that situation, it seems hard to think that Seattle had anything less than a 0.60 chance of scoring on a run. [continue reading…]

References

References
1 Recent research by Chase suggests something similar.
2 Note that the stop against Baltimore should not even count. In an otherwise great game for Gary Kubiak, he called for a reverse to Michael Campanaro on third-and-1 in the second quarter. The run was stopped for a loss. The Patriots basically could not stop Justin Forsett, making the reverse call very unnecessary.
{ 31 comments }
Brady likes the second half of the season

Brady likes the second half of the season

When we think about the most dominant teams of all time, the New England Patriots of the last few years don’t leap immediately to mind. Yet, their performance late in the year has been mind-bogglingly good. From 2010-13, New England went 29-3 in the final eight games of each season, a record that no other team since 1960 can match over any four-year period. Including their three games this year, the Patriots are on a 32-3 run in regular-season games in the second half of the season. From 2010-2013, the Patriots also have the biggest four-year point differential in second-half games in the history of football.

Part of that huge point differential comes from the higher point totals that teams have than they did in the past, and from New England’s offensive-centric philosophy. As a result, when we look at Pythagenpat records, the Patriots are not as dominant. [1]I used 0.251 as the value in the Pythagenpat formula to find exponents for each team-year. Here are the hundred best late-season teams over any four-year period, according to Pythagenpat record. The Patriots from 2010-13 rank only 38th on the list, behind four other recent Patriots’ runs, some of those overlapping with 2010-13. The Patriots have been great and it is an unlikely outcome that they’d have no Super Bowls in the decade so far, but they also have not been quite as strong in terms of their true strength as their second-half records would suggest. As a high-scoring team, we would have expected them to lose more of their regular season games than they have. [continue reading…]

References

References
1 I used 0.251 as the value in the Pythagenpat formula to find exponents for each team-year.
{ 3 comments }

Andrew Healy joining Football Outsiders

Congrats to Andrew Healy, who is now working with Football Outsiders. His first post went up today.

Since 1979, teams have covered the point spread by more than 17 points almost exactly 10 percent of the time. Going back to 2003, the New England Patriots have now done it half the time (5 out of 10) after losing the previous game by more than 14 points. We want to be cautious with this kind of split given the small sample size, but this is pretty remarkable given how rarely teams exceed expectations by so much….

To put how unusual this is into context, take an average team that beats the spread by 17-plus points exactly 10 percent of the time. What is the chance that team would beat the spread by 17-plus points five (or more) times out of ten? 0.2 percent! So this is a case where a small sample size really does tell us something. Over the last decade, the Patriots have been completely on their own island in their propensity for following big losses with surprisingly strong wins. And it looks like more than randomness. Note that I am counting 2008, too. If we only include the Brady era, following big losses the Patriots have beaten the point spread by more than 17 points four out of seven times.

You can read the full article here. And you can view all of Andrew’s posts at Football Perspective here or here.

And again, congrats Andrew! I’m sure he would appreciate some love from you guys in the comments, either here or over at FO.

{ 10 comments }

In the third quarter on Monday night, I texted my Patriots fan buddy Matt, “Is it possible that we suck? Maybe the run is finally over.” Bill Barnwell mused on this, and Aaron Schatz also wrote about it. It was hard not to think that, given the way the Patriots were manhandled by a mediocre team playing without several key players. It looked every bit as bad as the 41-14 score and maybe worse.

I remember the last time I wondered if the Pats were done. In a 34-14 loss to the Browns in 2010, the Patriots looked pretty impotent. In that game, as in the Chiefs one, the Pats had just under 300 yards of offense. Peyton Hillis ran over the Patriots. Of course, that wasn’t the end. Maybe this time is different, though. If anything the Chiefs game was even worse, so it’s possible this time really is the end. [1]And those Pats were 6-1 at the time of the loss to the Browns.

Will the Patriots offense be good later this year? To provide a little insight into this, I went back and looked at performance trends for quarterbacks who have had long careers. The first table looks at quarterbacks since 1969 who have the biggest single-season drops in adjusted net yards per attempt (ANY/A) from the previous five year trend. I look just at quarterbacks with at least 100 attempts in a season and I weight by the number of attempts when calculating the average ANY/A over the previous five years.

[continue reading…]

References

References
1 And those Pats were 6-1 at the time of the loss to the Browns.
{ 20 comments }

I am getting some well-deserved crap from people about just how bad my predictions have been so far. The Arizona Cardinals have already somehow outperformed the number of wins I gave them. The Jacksonville Jaguars, my pick to win the AFC South at 8-8, at one point in the game against the Colts had been outscored 112-13 over a stretch of about nine quarters. And my pick to win the NFC North at 14-2 could be 0-3 if Marty Mornhinweg let his head coach call the timeouts. [1]We are talking about the Jets here so they probably would have blown that game, anyway.

But I did win my first Stone-Cold Mega-Lock of the Week with my very comfortable tease of the Bengals and Falcons. So things are looking up and I’m taking that as license to check out some historical betting data for anything that might seem appealing after three weeks.

Last year’s Carolina Panthers are the inspiration for the analysis here. After three weeks, they were a 1-2 team with a big positive point differential. The Panthers last year lost 12-7 to Seattle and 24-23 to Buffalo before annihilating the Giants 38-0. Despite VOA liking the Panthers even after just three games, the betting market came around later in at least one way. The Panthers were at 3/1 to make the playoffs last year after three weeks, even though Football Outsiders had their playoff odds at over 50% at that time.

Is it possible that teams like the 2013 Panthers have historically been undervalued? It seems likely that Carolina was a little undervalued last year after three weeks. By looking at point spread data, we can see if teams that have likely been better than their records have been good bets in the early part of the season. Specifically, I’m going to look at whether betting on early-season underachievers (teams with deceptively poor records) or against overachievers has been profitable now and in the past.

Data and Methods

Feel free to skip this part, but here’s the background for those interested. I have put together Pro Football Reference’s point spread data for all games from 1979 to 2012. This sample is good enough for the tests of long-term and recent betting strategies that I want to do.

I’m going to look at betting outcomes in games 4-8 for teams that are either losing teams (winning percentage below 0.5) with strong Pythagorean records or winning teams with weak Pythagorean records. I will keep things simple and define Pythagorean wins here as:

Pythagorean Wins = (Previous Points Scored ^2.53)/(Previous Points Scored^2.53 + Previous Points Allowed^2.53)

In a continuing effort to avoid unnecessary complications, I’m just going to split the data up over time, looking separately at results before and after 2000.

Betting On and Against Pythagorean Outliers

Below is how you would have done over time if you bet on or against two kinds of teams:

  • Overachievers: Teams with winning records with bad point differentials for their records
  • Underachievers: Teams with losing records with good point differentials for their records

An overachiever is more specifically a team with a winning record that has a Pythagorean winning percentage at least 25 percentage points worse than their actual winning percentage. An underachiever has a Pythagorean winning percentage at least 25 percentage points better than actual.

YearsOverachieving TeamsUnderachieving Teams
1979-1999174-142-11 (55.1%)141-146-5 (50.9%)
2000-2012109-99-4 (52.4%)108-100-8 (52.0%)

The results show that, before 2000, you would have won most of the time betting on overachieving teams, teams that were not as good as their records would suggest. I was surprised by that and it even made me wonder if I made a coding mistake. I certainly expected that any tendency away from an even split would have been in favor of betting against teams with good records and relatively poor point differentials. Note that the even split occurred in the past for the underachievers, the teams with good point differentials and poor records.

More recently, the data come pretty close to an even split for betting both on the overachievers and the underachievers. Betting on the overachievers and the underachievers has been successful about 52% of the time since 1999.

So the overall message is that there is little value now or in the past in identifying Pythagorean outliers and either riding the teams with deceptively poor records or fading the teams with misleadingly good ones. In fact, the only pattern from the past suggested it was a good idea to ride the teams with misleadingly good records. I tried to check this out a bit to just see if it was just betting on teams with good records that was profitable, but betting on all teams with winning percentages over .750 has gone almost exactly dead even over time. It would be great to hear any thoughts you might have in the comments for this pattern. I feel like I’m missing something.

Overall, the message here is the one that we get most of the time if we try to find patterns that might lead to a consistently profitable and simple betting strategy. It just ain’t there. That doesn’t make this a bad post, though: as Chase once noted, an answer of “not useful” is often just as meaningful as any other answers.

The Stone-Cold (I Think There May Be a 60% Chance This Bet Will Win) Mega-Lock of the Week

So I am now 33% on my Stone-Cold Mega Locks of the Week. If I get the next two, I will be at 60%. If I get the next two after that, I’ll be at 71%. I kind of think I should be able to claim extra points already, Chris Berman-style, for my tease last week, since the Falcons and Bengals won by a combined 89-21 score that wasn’t that close. But I will instead put my faith in the always reliable larger sample size that will bear out these predictions living up to their title. [2]Note that no mega-lock promises were made on the season predictions.

Two-team teaser: Pittsburgh down to -1.5 and Indianapolis down to -1.5

This week, I like another two-team teaser of two home teams, this time down to 1.5 points. I particularly like the Steelers down to 1.5 points. I do not understand how they could be the same offense for quarters 3-8 of this season as they were for the other high-efficiency ones. Still, I like the Steelers (#10 in DVOA) at home against the Buccaneers (#32).

I’m a little less sure about the other side of the tease, where I have Indianapolis (#21) over Tennessee (#25). In fact, I mainly just wanted to get the Pittsburgh end of the tease. I may be getting that queasy-knees feeling come Sunday. It’s hard to feel that way about Andrew Luck, but I didn’t imagine I’d ever be going into the water tethered to a Ryan Grigson-led team.

Season record: 1-2

References

References
1 We are talking about the Jets here so they probably would have blown that game, anyway.
2 Note that no mega-lock promises were made on the season predictions.
{ 7 comments }

Here is graphic video of a famous football player performing an act of cowardly violence against a defenseless victim. The offender did not receive any penalty for his actions. After committing that crime, the assailant showed no remorse at the condition of the victim, who lay prostrate on the ground. Not disciplined for earlier acts of violence, that player struck again, this time paralyzing his defenseless victim. That victim would eventually die far too young, in part as a consequence of that attack.

For this perpetrator, the response was much worse than insufficient punishment or radio silence. Jack Tatum was celebrated for many of his hits, perhaps most notably the one on Sammy White in Super Bowl XI. The Ray Rice punch makes all of us cringe, but the hit on White―and even more so the one on Darryl Stingley ― should also make us cringe. [continue reading…]

{ 21 comments }

Betting Bad: Thinking About Uncertainty in Prediction

Barack Obama was not the only winner in the 2012 presidential election. Nate Silver, now founder and editor in chief of Five Thirty Eight, and other stats-y election forecasters basked in the praise that came when the returns matched their predictions.

But part of the praise was overstated. At the very end, Silver’s models essentially called Florida a toss-up, with the probability of an Obama win going just a few tenths of a percentage point above 50%. But because his model gave Obama the slightest of edges in Florida, his forecast in most of the media essentially became a predicted Obama win there. In addition to accurately forecasting the national popular vote, Silver then received credit for predicting all fifty states correctly.

I am all in favor of stats winning, but the flip side of this is the problem. If Obama had not won Florida, Silver’s prediction―which, like that of other forecasters such as Sam Wang of the Princeton Election Consortium, was excellent―would have been no less good. [1]This is a column about football, but you might want to check out some of the stuff through that link on the differences between Silver and Wang on the upcoming midterm elections. They both know way … Continue reading And if stats folks bask too much in the glow when everything comes up on the side where the probabilities leaned, what happens the next time when people see a 25% event happening and say that it invalidates the model? [2]Of course, maybe Football Outsiders has already run into that with the 2007 Super Bowl prediction. Perhaps sports people are ahead of politics on this stuff.

Lots of people have made this point before — heck, Silver wrote about this in his launch post at the new 538 — but it is really useful to think carefully about the uncertainty in our predictions. Neil has done that with his graphs depicting the distribution of team win totals at 538, and Chase did so in this post last Saturday. Football Outsiders does this in its Almanac every year, with probabilities on different ranges of win totals. [continue reading…]

References

References
1 This is a column about football, but you might want to check out some of the stuff through that link on the differences between Silver and Wang on the upcoming midterm elections. They both know way more than I do, but for the small amount that it is worth, I lean more towards Wang on this one.
2 Of course, maybe Football Outsiders has already run into that with the 2007 Super Bowl prediction. Perhaps sports people are ahead of politics on this stuff.
{ 12 comments }

Red Zone Diaries: Week 1 Review

Football is back. Oh my goodness gracious. Football is back.

The return of football also means the return of TV’s greatest channel and one of the five most important innovations of the 21st century. The Red Zone Channel has simultaneously rendered obsolete commercials, bad games, bad moments of good games, and halitosis. Let’s celebrate with a running diary. Below is what I was thinking as I watched the RedZone through the early games on Sunday.

Allow me to make one gambling note right off the bat. My stone-cold mega-lock of the week was a two-team tease of the Raiders (to +11.5) and the Bears (to -1). I feel completely queasy about the Bears part of this bet. I’m sticking with it, but every instinct in my body is crying out: “Why take Jay Cutler down to 1 point when I can take Peyton Manning down to 2? You know you will regret this.” So if I sound extra emotional about Raiders-Jets and Bills-Bears, that’s why.

One more note: I was writing this as the games were still going on so the time is approximate in some cases. You can pick most of those out by the times that are whole numbers that end in :00 or :30.

Week 1 Red Zone Diaries

Pregame: Ten years of redzone? I didn’t know about this until 2010 or so. Clearly I am getting old. Maybe I’m remembering that wrong, anyway, since I am getting old. Oh so good to see Andrew Siciliano. Is it possible he’s the median man in America? Dark hair, white, average handsomeness, only his ears seem anything other than completely average. If he’s the median man, here’s the Andrew Siciliano of restaurants and the Andrew Siciliano of American incomes. [continue reading…]

{ 4 comments }

Which team will be the biggest surprise in 2014? Last year, the Houston Texans shocked Vegas and analytics fiends alike. Before the season, the Texans’ over/under win total was 10.5. Football Outsiders Almanac projected them to have 9.3 wins and gave them a 67% chance of making the playoffs. Basically nobody saw the 2013 Texans’ implosion to 30th in DVOA coming. Interestingly, though, the Texans are part of a larger trend in the kinds of teams that have been having enormous drop-offs in performance.

Consider the graph below. It looks at the change in DVOA for good-but-not-great teams, those that ranked between 6th and 15th in the previous year. [1]Before 1989, I use Andreas Shepherd’s estimated DVOA. I thank him for sharing his data.

AH Fig 1

Historically, the good-but-not-great teams have regressed a little bit. From 1985 to 2010, those teams dropped on average between two and four points of DVOA. The trend was relatively stable for each five year period. While we would expect some regression from good teams, the size of that regression has changed since 2010. Over the last four years, the good-but-not-great teams have dropped an average of ten points of DVOA, the biggest regression by far since the merger. Note that if we drop 1983 to account for regression coming out of the strike-shortened 1982 season, we get a DVOA change for 1980-1984 of about four points of DVOA, making 2010-2013 even more clearly on its own island. This idea leads into my first prediction for the season. [continue reading…]

References

References
1 Before 1989, I use Andreas Shepherd’s estimated DVOA. I thank him for sharing his data.
{ 30 comments }

Projecting Success for New Head Coaches

In 1995, Football Outsiders graded the Eagles special teams as the worst in the NFL. The next two years, Philadelphia ranked 20th and 26th, respectively. In 1998, after hiring a new special teams coordinator, the team still finished just 25th. But, over the next eight years, the Eagles’ special teams flipped dramatically, ranking as the second-best in football during that period. In fact, from 2000-2004, Philadelphia ranked in the top five in the Football Outsiders’ special teams ratings each season.

When the Ravens hired the coordinator of those special teams, John Harbaugh, as their head coach in 2008, Baltimore turned one of the more surprising coaching hires in recent history into one of the best. Based on where the team was when it hired him, Harbaugh’s first three years were about the best since 1990 of any coach not named Harbaugh, at least according to DVOA. The Ravens made the playoffs in Harbaugh’s first five seasons, winning the Super Bowl in the last of those. Harbaugh’s success even caused Chase to wonder whether it would change the way teams hired head coaches.

Since Harbaugh was so successful as a coordinator, does that mean he was a good bet to be a successful head coach? At first glance, you might think just about every coordinator who gets promoted or poached to become a head coach was very successful in his previous job. As it turns out, that’s not always the case. Once we correct for expectations, a little more than one in four hired head coaches actually underperformed in their previous jobs, at least according to DVOA.

Consider one man who performed particularly poorly as a coordinator: Eric Mangini. The 2005 New England defense had a DVOA that was 15.2 points lower than we would have predicted based on the Patriots’ performance in the preceding seasons. He was not so much of a (Man)genius to have a good defense in 2005, and that may have given some hint that he was not the greatest bet to succeed as a head coach, either. [1]Always a bonus when painful Jets memories come up organically. There are always other coaching greats like Joe Walton for Jets fans to remember fondly, at least for epic nasal invasions.

This leads to an obvious question: on average, have teams done better when they have hired head coaches who were actually good in their previous jobs (either as coordinators or head coaches)? Let’s take this to the data. [continue reading…]

References

References
1 Always a bonus when painful Jets memories come up organically. There are always other coaching greats like Joe Walton for Jets fans to remember fondly, at least for epic nasal invasions.
{ 10 comments }

Prop Joe’s Favorite NFL Prop Bets

I think I’m one of eight billion people who love “The Wire” and “Breaking Bad.” Those are the two best TV shows I’ve seen and it isn’t particularly close. [1]“Seinfeld” is all alone in third with a pretty big gap after that, too. “The Wire” had an amazing volume of unforgettably vivid characters. Below is my list of memorable “Wire” characters. To be a real test of unforgettableness, it’s got to be off the top of my head, so I’m sure I’m going to forget somebody, but here goes and I’ll include the first thought that jumps to mind:

Omar (“man’s gotta have a code”), Bunk (“f***”), McNulty (“f***”), DeAngelo (library), Stringer (mastermind), Avon (winner), Brother Mouzone (bow tie), Cedric (good posture), Garcetti (that’s actually the mayor of LA, I mean the Baltimore mayor), Clay Davis (“sheeeeeet”), Bunny (“New Hamsterdam”), Keisha (car chase scene), Lester (wood carving), Bodie (corner), Prop Joe (large), …

Ah, Prop Joe. Prop Joe was a very large and very reasonable drug kingpin. His name apparently stemmed from saying “I’ve got a proposition for you,” so we could certainly see him getting into prop bets. So, in honor of Prop Joe, I’ll cover some intriguing season prop bets. [2]The actor who played Prop Joe, Robert F. Chew, sadly passed away in January 2013. Most of these bets are only available online, which continues to be a legal gray area. Like Prop Joe, I would never directly touch anything slightly questionable, so I will be referring to bets made by my good friend Rawls. [3]Definitely not this Rawls who is the enemy of all that is good. We’ll start with his favorite prop bet for 2014 and go from there in descending order.

Rawls’s Prop Bet #1: $76 On Any Team To Win at Least 14 Games (Odds: 3/1)

At first glance this bet seems to have a lot of merit. Since the 1987 strike, at least one team won 14 games 15 out of 26 times (57.7%). In the last 15 years, it’s even better, hitting 10 out of 15 times (66.7%). The bet only needs to win 25% of the time to break even, so this looks fantastic.

But Chase brought up a point that Rawls missed: schedule strength. The years without a 14-game winner in the last 15 years include 2012 and 2013. Rawls dismissed that as a blip, but it comes in part from two of the best teams in football playing in the same division. Moreover, the last run of years without a 14-game winner (1993-1997) also happened during a time of NFC dominance, at least until ‘97. The Cowboys played the Packers and Niners every year during that span, for example. This season, the best teams in football may have it even tougher. The Niners and Seahawks have to play each other twice, and each has one of the four hardest schedules in football this year. The Broncos get the NFC West, the Saints have the sixth-hardest schedule, and the Packers have above-average schedule strength. Only the Patriots have an easy schedule amongst the main threats to win 14 games. [continue reading…]

References

References
1 “Seinfeld” is all alone in third with a pretty big gap after that, too.
2 The actor who played Prop Joe, Robert F. Chew, sadly passed away in January 2013.
3 Definitely not this Rawls who is the enemy of all that is good.
{ 8 comments }
Gronk can catch, block, and spike. But can he do all that without getting injured?

Gronk can catch, block, and spike. But can he do all that without getting injured?

In the 2011 AFC Championship Game against the Ravens, Bernard Pollard happened to Rob Gronkowski. And the Patriots offense ground to a halt for the rest of the game before being held to just 17 points in the Super Bowl. [1]Yes, a very limited Gronk played in SB XLVI, but he had only two catches and jumped like me when battling Chase Blackburn on Brady’s underthrown fourth quarter pick. In 2012, it was a freak injury on an extra point and then a reinjury in the divisional playoffs against the Texans. After that, the Patriots offense put up only 14 against the Ravens in the 2012 AFC Championship Game. Last year against the Browns, he took one of those horrible hits that make you cringe and want to keep him away from running seam routes in any regular season game. [2]The link is of Gronk shopping for groceries instead of the hit, because who wants to see that again? And the Pats put up 16 points against a mediocre and banged-up Broncos defense in the AFC Championship game. [3]The only two games all season where the Broncos gave up fewer points were against Houston and Oakland.

The Gronkowski injuries provide a tantalizing set of what-ifs. The Patriots have been within two games of a title the last three years. A healthy Gronkowski could have made the difference in any of those years. The Football Outsiders’ Almanac shows that the Pats’ offense was actually pretty good late in the season without Gronk, but they were terrible early in the year―they actually had a negative DVOA without him. Over the last two regular seasons, the Pats have averaged 34 PPG with Gronkowski, but six points fewer in New England’s 14 Gronk-less games.

And as much as I believe in stats, I’m not sure we really need them to tell us that Gronkowski is one of the most important non-quarterbacks in football. If he’s healthy through the playoffs, the Patriots seem likely to be neck-and-neck with the Broncos. With a defense that may be one of the best in football, I’d argue that the Pats should be a little better than the Broncos, even. [4]Unless Manning is just much better than Brady, I guess. I’m not seeing that. Denver’s only other big advantage is at receiver. Fine, but a healthy Gronkowski seems to even up a fair bit of that. … Continue reading Regardless, the Pats offense has been uniformly excellent with a healthy Gronkowski since 2010. Taking just the games where Gronk played, the Pats have ranked 1st, 3rd, 1st, and 2nd in offensive DVOA over the last four years.

That means one of the most important questions in the NFL in 2014 is whether we’ll see a healthy Gronkowski through the end of the season and into the playoffs. At this point, I think the reflexive answer is to assume that the answer is “no.” It certainly doesn’t feel like he’s going to be healthy. But previous examples of players getting hurt can provide some insight into Gronkowski’s actual chances.

Recovery for Injured Young-and-Excellent Players

In his second year, Gronkowski had an Approximate Value (AV) of 14. He then played only parts of the next two seasons due to injury. Considering players who started their careers since 1970, there have been 34 who had an AV season of at least 13 in their first two years and who then did not start at least 25% of the games in the following two years. This is a reasonable list of young-and-excellent players who then missed significant time in years 3 & 4. Most of these players missed time due to injuries, although some of those cases were a bit debatable. [5]In addition, I omitted two players who were obviously benched for other reasons: Shaun King and Derek Anderson. And Joe Cribbs, who went to the USFL for the fifth year of his pro career. Regardless, the conclusions are pretty much the same if we drop some of those cases. [continue reading…]

References

References
1 Yes, a very limited Gronk played in SB XLVI, but he had only two catches and jumped like me when battling Chase Blackburn on Brady’s underthrown fourth quarter pick.
2 The link is of Gronk shopping for groceries instead of the hit, because who wants to see that again?
3 The only two games all season where the Broncos gave up fewer points were against Houston and Oakland.
4 Unless Manning is just much better than Brady, I guess. I’m not seeing that. Denver’s only other big advantage is at receiver. Fine, but a healthy Gronkowski seems to even up a fair bit of that. And then there’s Brandon LaFell’s impending record-breaking season. I’m about to get shouted down. [Chase note: I don’t know how much longer I can stomach Andrew writing for Football Perspective.]
5 In addition, I omitted two players who were obviously benched for other reasons: Shaun King and Derek Anderson. And Joe Cribbs, who went to the USFL for the fifth year of his pro career.
{ 6 comments }

Some teams, like the Rams have done a good job of fielding a very young roster; others, like the Raiders, have made a conscious effort to head in the other direction. Overall, the Rams are more representative of the current trend. NFL teams have made a shift towards younger players in the last three years, although you might be surprised by just how dramatic and sudden the change has been. The drop in Approximate Value (AV)-weighted ages of NFL rosters in the last three years is more than 50% larger than in any other three-year period in NFL history.

healy 1

Looking at the graph, there are two seismic shifts that changed the age distribution of the NFL in the Super Bowl era: the increase that started in the late ‘80s and the decrease in the last five years. These changes tell us about how changes in the collective bargaining agreement can change the NFL landscape in both subtle and dramatic ways.

First, the increase in NFL roster age in the 1980s coincides pretty closely with the introduction of Plan B free agency in 1989. It looks like the increase maybe starts a year too early. Remember, though, that the 1987 age may be skewed a bit by the three games with replacement players. Taking that point in mind, the increase from 1988 through 1993 coincides exactly with the introduction of limited free agency. [continue reading…]

{ 15 comments }

In the Super Bowl era, there has been just one team that was both the youngest in the league and one of the five best teams in football: the 2012 Seattle Seahawks. As friend of Football Perspective Neil Paine recently pointed out, being young and great has historically been a good predictor of teams that have become dynasties. Consider the table below. It captures every team since 1966 that ranked amongst the five youngest teams by Approximate Value (AV)-weighted age and had at least 12 Pythagenpat wins, adjusting everything to a 16-game schedule. [1]My AV-weighted age calculations are very similar to Chase’s, but not always exactly the same. For example, I have Seattle third in 2013, while he has them second. We both had Seattle at 26 years, … Continue reading

TeamYearPyth WinsAV-wtd ageAge Rank
PIT197213.525.65
DAL199212.626.42
DAL199312.426.74
STL199914.226.65
CHI200112.426.55
SDG200612.626.55
IND200712.826.74
SEA201212.625.81
SEA201313.1263

There are seven unique teams on this list, not counting the two repeaters. When trying to predict what’s going to happen with the Seahawks, there are two different ways to look at this list. The first looks good for their dynasty potential. The first two teams on the list, the ’72 Steelers and the ’92 Cowboys went on to win multiple Super Bowls. The closest comparison in terms of age also looks pretty good. Teams used to be younger, so the best comparison probably isn’t the ’72 Steelers, who were even younger by age but were only the fifth-youngest team in 1972, but the ’92-’93 Cowboys. They are the only other team on this list to be so young and so good.

Of course, even the Cowboys had a pretty short run. Their stay at the top was nothing like the ’70s Steelers or ’80s Niners, who were also quite young. [2]They were the third-youngest team in 1981, their first championship year. Free agency helped to minimize their time on top. The ’90s Cowboys were the first great team in the free agency era. Players gained full freedom of movement only in the year after their first Super Bowl. Plan B free agency allowed limited movement starting in 1989.

Free agency and the salary cap help to explain the path of the other four teams on the list. They point towards a more cautious prediction about the Seahawks’ dynasty hopes. Between them, the ’99 Rams, ’01 Bears, ’06 Chargers, and ’07 Colts won one Super Bowl and played in two others. Within three years of their great-and-young season, only the Chargers were significantly better than league-average.

These more recent examples may do a better job of predicting the Seahawks future success. Before the beginning of full free agency in 1993, good-and-relatively-young teams appear to have generally followed a clear and sustained upwards trajectory over the long term. Since then, however, success has generally been less sustainable. The table below looks at teams’ strengths over time according to PFR’s Simple Rating System. [3]I thank Bryan Frye for sharing his SRS dataset. Here I’ve made the cutoff any team that was in the five youngest teams in a given year and also had a SRS rating of at least 6. The table shows the trend in strength for the previous season and the following three seasons.

TeamYearSRS (t-1)SRS (t)SRS (t+1)SRS (t+2)SRS Wins (t+3)AV-wtd ageAge Rank
PIT1972-3.6108.26.814.225.65
BAL1975-8.78.69.85-8.825.95
SFO1981-6.26.2-2.48.712.725.83
NOR1987010.11.54.6-1.3264
DAL19924.49.99.610.19.726.42
Average-2.828.965.347.045.325.943.8
TeamYearSRS (t-1)SRS (t)SRS (t+1)SRS (t+2)SRS (t+3)AV-wtd ageAge Rank
DAL19939.99.610.19.72.426.74
IND1999-5.46.17.9-3.81.225.61
STL1999-2.311.93.113.4-3.326.65
IND20006.17.9-3.81.2726.33
CHI2001-6.37.9-5.3-3.5-8.226.55
BAL2003-2.16.36.1-1.89.326.43
IND20031.2711.410.85.926.54
SDG2004-6.89.19.910.28.826.52
BAL20046.36.1-1.89.3-6.726.73
SDG20059.19.910.28.8526.85
JAX20064.87.56.8-2.5-6.526.52
SDG20069.910.28.856.626.55
SDG200710.28.856.64.826.42
IND20075.9126.55.92.926.74
SEA20120.812.21325.81
SEA201312.213263
Average3.349.095.864.952.0926.413.25

One surprising pattern in these data is just how infrequently young teams won in the past. From 1966-1992, only five teams were among the five youngest and still had an SRS of at least 6. Since 1993, it’s happened 16 times. In the past, teams had more of an opportunity to gradually build strength. So it looks like there was a greater share of young teams building for something and old teams trying to stay on top. Since 1993, the standard deviation of team ages is about 20% smaller than it was before that. In the last ten years, the standard deviation is about 30% smaller than it was before 1993. The ages of rosters are more compressed than they used to be.

The other thing to take away from these tables is the dropoff in years 2 and 3 since full free agency. For the pre-1993 teams, the good-and-young teams held much of their value. After starting at an average SRS of 8.96, they were still at 7.04 two years later and then 5.3 three years later. Since 1993, teams have deteriorated more quickly. From an average of 9.09, the more recent high quality young teams fell to 4.95 two years later and all the way to 2.09 three years later.

Since there are only five teams in the pre-1993 group, we want to be careful with interpreting too much into the earlier data. It’s possible that the ’72 Steelers and ’81 Niners are anomalies. At the same time, the success three years later is skewed downwards by the ’75 Colts, who would have been much stronger in ’78 if they had a healthy Bert Jones.

With the bigger set of more recent teams, the clear takeaway is that in the current era, even very good and young teams are just slightly better than average than three years later. The Seahawks may buck this trend, but they probably won’t. With Russell Wilson to sign and long-term cap hits for players like Richard Sherman and Earl Thomas, they’re more likely to have a brief run than a long one.

Another alternative may be available, though. If Wilson makes the leap into the Brady-Manning class (he may) and Pete Carroll turns out to be a truly elite coach (also possible), they may be able to fashion a New England-kind of dynasty. That sort of dynasty is not really built on youth. Consider the aging patterns of the last five teams of the decade.

healy age

The ‘60s Packers, ‘70s Steelers, ’80s Niners, ‘90s Cowboys all showed the same pattern of being relatively young and then progressively aging during their runs. On the other hand, the Patriots show an entirely different pattern. They’re the only dynasty to actually not age as their run progressed. They started old and stayed old through their Super Bowl years. While the Seahawks are starting off younger than those Patriots teams, excellence at QB and coach still offers them their best hope of building a dynasty in the current NFL. The benefits of being young and good are much more fleeting than they used to be.

References

References
1 My AV-weighted age calculations are very similar to Chase’s, but not always exactly the same. For example, I have Seattle third in 2013, while he has them second. We both had Seattle at 26 years, but I have Cleveland also at 26, instead of 26.1.
2 They were the third-youngest team in 1981, their first championship year.
3 I thank Bryan Frye for sharing his SRS dataset.
{ 12 comments }

Not-Entirely-Awful NFL Futures Bets

In the 1990s, there was a hedge fund called Long Term Capital Management that almost brought down the world economy. LTCM made enormous bets on very arcane things such as the spread between two kinds of bonds. Their whole reason-for-being was that they would find small inefficiencies in prices and borrow like crazy to take advantage of those brief opportunities. Other hedge funds did similar things, but these guys thought that they were smarter than everyone else. And, to some extent, they may have even been right. But they were also a little contradictory. What made this hedge fund interesting was not just that it employed two Noble Prize-winning economists, but two who made their name arguing that markets for financial assets were efficient. If their research was right, the inefficiencies on which they were betting should not have existed in the first place.

Now, these guys are way smarter than me, but you may have noticed that I recently wrote about how the NFL betting market appears to be pretty efficient. If that’s right, there shouldn’t be any chances to make profitable NFL bets. If the prices are right, all I’m doing is paying the commission every time I make a bet. Like the guys at LTCM, however, I think I’m smart enough to find bets that are mispriced and that offer some opportunity to make money. I’m probably overconfident and wrong about that, but it’s too much fun to try. And if I fail, which the LTCM guys spectacularly did when some of their billion dollar bets went wrong, at least the implications will not send shock waves to central bankers in Peru.

Bets I Sort of Liked But Decided Not to Pull the Trigger On

There were a series of bets on season win totals that I liked but decided did not quite make sense in the end. Some of the reasons were hard-headedly analytical and others were more visceral. Most notably, I couldn’t commit actual dollars to betting on Ryan Fitzpatrick, even though I came pretty close. [continue reading…]

{ 11 comments }

A few days ago, I was in Vegas with friends and without a car. So I took the chance to shop NFL futures odds to the extent that I felt it was worth it to walk to a given sportsbook. I decided the 3+ mile walk to the Superbook was not worth the opportunity cost in the 105 degree heat, so I didn’t get their numbers. But I did get numbers from three of the major oddsmakers: William Hill, Cantor Gaming, and MGM. Tomorrow, I’ll talk about some bets that seem potentially attractive. As I described recently, the numbers are pretty good now and don’t leave obvious opportunities for the most part, I think.

Yes, I still did like some bets. I only found one season win total I really wanted to bet on, and it’s not one of the ones I would have bet back in March. I made a few bets at the William Hill sportsbook, just a little hole in the wall at the Hooters’ Casino a little ways off the Strip, which could just as easily have been in Nevada towns forgotten by time like Laughlin or Mesquite as in Las Vegas. Then I made a few bets not too far from the beautiful people at the Cantor book in the Cosmopolitan. I spent way too much time thinking about all this stuff, which might not have been necessary if I only had that time machine and could have bet on the initial lines. But there’s also some cool stuff by looking at the teams’ odds that have changed the most in both directions.

Season Win Totals

Some interesting movements have happened in the numbers that Cantor Gaming released in March. Those changes reflect everything that happened in free agency and the draft, but also maybe some numbers that people would have bet on anyway even if nothing had changed personnel-wise.  Below are the opening numbers along with the numbers I gathered during the last week. The Cantor numbers are mostly from 6/18 because their books that I went to would only give me the numbers one at a time. I gathered about eight of those numbers because I was at least considering them as wagers. For those teams, the most recent line is the one that I posted. The other companies’ books gave me complete printouts of all their season win-total lines.

A note on the odds: Lines like -140 mean that you would wager $140 to win $100. Lines like +130 mean you wager $100 to win $130. The numbers are usually split by 20 on either side, which represents the vig, or Vegas’s commission. For example, Denver being at -115 for the over would usually go with -105 on the under. For bigger odds, the over and under can be split by more. Also, the MGM has a slightly larger vig, with a 30 split between the over and under. [continue reading…]

{ 2 comments }

The Smarter (Sigh) Football Betting Market

Economists (I am one) have historically been trained to believe in the efficiency of markets. The simplest way to think of this is that market prices capture all relevant information. Of course, this is sometimes not quite right, or even close to right. All the mortgage-backed securities that helped bring down our economy were horrendously mispriced, for example, despite lots of people seeing the warning signs. Even then, people betting against those securities provided information about their true value. They were just drowned out for too long by people clamoring to buy that worthless stuff.

The sports betting market, though, is a case that we might actually expect to work better. Unlike mortgage-backed securities, everyone making a wager in Las Vegas is incentivized to get the price right. There’s nobody who’s pushing a bad wager on their clients, for example. [1]These perverse incentives have been going on a long time, too. Check out Michael Lewis’s Liar’s Poker for fascinating stories of investment bankers pushing junk on their clients. Therefore, we might expect efficient markets to mostly work in Vegas and that the odds would converge to the correct number.

Mostly, it seems like that’s what’s going on. Whatever information is not contained in the initial odds may be quickly corrected as people swoop in to take advantage. I’ve experienced this first-hand. Last year, I went to Vegas about a week after the first season win-totals for 2013 came out. I found the numbers online and came up with this list of wagers I was interested in. [continue reading…]

References

References
1 These perverse incentives have been going on a long time, too. Check out Michael Lewis’s Liar’s Poker for fascinating stories of investment bankers pushing junk on their clients.
{ 18 comments }

Previewing the World Cup by NFL Divisions

The Super Bowl is a football competition decided by a series of single-elimination playoff games played after 32 teams attempt to qualify from eight groups of four teams each. That’s the World Cup, too!

And just like the NFL, there are some not-so-good AFC South-ish groups and some very good NFC West-like groups. So let’s assign each World Cup group its doppelganger of an NFL division, and then every team to one of the NFL teams in that division.

That gives us our NFL World Cup Bracket. The AFC South is Group E, which contains no great team and at least one candidate to be the Jacksonville Jaguars of the World Cup. The NFC West is Group B, which has three legitimate contenders to win the whole thing, one of which will not even make it out of the group.

Each team is listed in its predicted order of finish within the group according to my highly scientific NFL-based World Cup prediction machine. Teams with a * are predicted to advance out of the group.

NFL WC Bracket [continue reading…]

{ 19 comments }

Bush played with some talented teammates at USC.

Bush played with some talented teammates at USC.

Last week, I wrote about whether having great college teammates might cause quarterbacks and wide receivers to be overvalued in the NFL draft. The results were inconclusive on the impact of teammates on quarterbacks, but they indicated that wide receivers who played with first-round QBs in college tended to underperform in the NFL relative to their draft position. Receivers such as Mike Williams of USC (#10 in 2005) and Marcus Nash of Tennessee (#30 in 1998) may have gone too high in the draft in part because they played with great college QBs who made them look good.

Today, I look at running backs drafted since 1984. I use a slightly different way of looking at the data that I think is a little better. I also revisit the QBs and WR/TEs with that method. Instead of considering the number of first-round college teammates that a player has, I consider the total draft value of college teammates at different positions, as determined by Chase’s chart. [1]I thank commenter Stuart for suggesting this approach in the comments to last week’s post. Going this way makes it possible to look at the entire offensive line’s value, for example, rather than just the number of players who were high picks.

For example, according to PFR’s Approximate Value (AV), Ki-Jana Carter is the biggest underachiever at RB relative to his draft position (since 1984). After being drafted #1 in 1995, he generated just nine points of AV in his first five years. [2]Carter averaged 3.3 yards on 227 carries over his first five injury-plagued seasons. Carter also had a lot of help from his friends in college. He ranks 10th out of 104 RBs picked in the top 32 in terms of the total value of his college offensive linemen according to my measure. His tight end also went in the top ten in 2005; Carter would be 2nd in total line value if we included TEs. Two of his offensive lineman went in the first round in the following year. Two Penn State fullbacks were drafted that year, too. [3]Two Penn State halfbacks were drafted in 1996, as well. One of them was Stephen Michael Pitts, who went to Middletown High School South (NJ), a school that also graduated Knowshon Moreno and, only … Continue reading Could Carter have looked better than he was because he ran behind those great college blockers? Or is the NFL success of the running back who ranks fourth in terms of offensive line help (Warrick Dunn) more representative of RBs, in general?

In addition to looking at the offensive line, I’ll consider whether the total value of college teammates at other offensive positions predicts that running backs become overvalued in the draft. While we might think that RBs are particularly dependent on line help, it actually appears that having a great QB is again the one clear predictor for players being overvalued. [continue reading…]

References

References
1 I thank commenter Stuart for suggesting this approach in the comments to last week’s post.
2 Carter averaged 3.3 yards on 227 carries over his first five injury-plagued seasons.
3 Two Penn State halfbacks were drafted in 1996, as well. One of them was Stephen Michael Pitts, who went to Middletown High School South (NJ), a school that also graduated Knowshon Moreno and, only slightly less famously, me.
{ 3 comments }

Bradford had a lot of surrounding talent in Norman.

Bradford had a lot of surrounding talent in Norman.

Do players get too much credit when teammates make them look good? Take Johnny Manziel. In the last thirty years, no quarterback has had teammates around him drafted so highly. Last year, his left tackle (Luke Joeckel) was the second pick in the draft. This year, his new left tackle (Jake Matthews) was the sixth pick in the draft and his talented wide receiver went immediately after. That’s three top seven picks from his offense in two drafts. Does this means, perhaps, that Manziel was riding those players’ coattails? Or is it Manziel who helped make his teammates look better?

The first round quarterback with the closest comparable surrounding college talent — a left-handed former Florida QB drafted in 2010 — doesn’t appear to be a very promising comparison. Tim Tebow’s top wide receiver was drafted 22nd overall (Percy Harvin) in 2009, and successive linemen Pouncey brothers were drafted in the top 20 the next two years (Maurkice went #18 in 2010 and Mike #15 in 2011). [1]And he had a talented tight end go in the fourth round in 2010, too. Like Tebow, he is also no longer playing football. Let’s move on. Tebow is obviously very different from Manziel, most notably in lacking the important skill for a quarterback of being able to throw a football well. But Tebow may have looked better as a college player in part because of the great talent around him, a situation which may be similar to Manziel.

In general, does having better college teammates cause QBs like Manziel to be overvalued in the draft? Or, do better QBs cause their college teammates to be overdrafted? To check these ideas out, I compared how draft picks performed in their first five years (according to PFR’s Approximate Value) relative to their expected value given their draft position. [2]I did this by running a regression of a player’s value in the first five years on a fifth-order polynomial in draft position. This is pretty much the same thing as looking at the value a player … Continue reading I then compared performance relative to expectation for players who had the benefit of teammates who were drafted in the first round to those who weren’t so lucky. The results are certainly not what I expected: by the end of this post, it might be Bucs fans who worry the most that they overvalued a high pick in the 2014 draft.

Quarterbacks

I first considered the value above expectation (VAE) for quarterbacks drafted in the first three rounds since 1984. It looks like having a lineman drafted in the first round either in the same or subsequent draft has no clear impact on the QB’s VAE. Those QBs who played with first-round linemen do about 1.8 points worse in VAE than QBs (relative to a baseline of 22.2), but this difference isn’t close to being distinguishable from zero. [3]The p-value is 0.70

Here’s the list of QBs from the first three rounds who had at least one lineman drafted in the first round of the same or subsequent draft. [4]All analysis in this post ignores the supplemental draft. The VAE for the last few entries is missing because those players have not finished their first five seasons. Keep in mind that the VAEs cannot be too low for third-round picks like Bobby Hoying, since little was expected of them given their draft position.

QuarterbackYearVAESchoolOL
Boomer Esiason198441.3MarylandRon Solt
Chuck Long1986-18.7IowaMike Haight
Todd Marinovich1991-21.2USCPat Harlow
Matt Blundin1992-19.2VirginiaRay Roberts
Billy Joe Hobert1993-8.4WashingtonLincoln Kennedy
Rick Mirer1993-5.8Notre DameAaron Taylor
Kerry Collins1995-6.8Penn St.Jeff Hartings; Andre Johnson
Todd Collins1995-10MichiganTrezelle Jenkins
Bobby Hoying1996-9.6Ohio St.Orlando Pace
Charlie Batch199814.9East. MichiganL.J. Shelton
Eli Manning20049.5MississippiChris Spencer
Brian Brohm2008-15.7LouisvilleEric Wood
Chad Henne20086.4MichiganJake Long
Matt Ryan200837.9Boston Col.Gosder Cherilus
Sam Bradford20100OklahomaTrent Williams
Tim Tebow20100FloridaMaurkice Pouncey; Mike Pouncey
Andrew Luck20120StanfordDavid DeCastro
Ryan Tannehill20120Texas A&MLuke Joeckel
Russell Wilson20120WisconsinKevin Zeitler; Travis Frederick

There are definitely some classic failures on this list, notably Todd Marinovich, but there are some big successes, too. And, for the more recent QBs, Andrew Luck and Russell Wilson will more than balance out Tebow. Overall, there’s little reason to think getting to play with a first-round lineman causes QBs to be overdrafted in general. As a result, Manziel critics may not have much support if they want to point to Matthews and Joeckel as the reason for Manziel’s college success.

But what about the presence of Mike Evans? Does having an elite wide receiver or tight end mean that a QB might be overvalued in the draft? I ran a separate regression looking at whether having a first-round WR/TE predicts a QB to succeed or flop relative to his expectation. Here, there’s more reason to think there might be something going on, but there is still not clear evidence that teammates make the QB. Part of this is just the relatively small number of QBs with first-round WR/TEs in the sample. On average, QBs with first-round WR/TE teammates in college do 6.5 points worse relative to expectation than other QBs. That gap is still indistinguishable from zero, however. [5]p = .20

Below are the QBs since 1984 who had at least one WR/TE teammate in the same or following year drafted in the first round.

QuarterbackYearVAESchoolWR/TE
Vinny Testaverde1987-4.5Miami (FL)Michael Irvin
Tony Sacca1992-17.7Penn St.O.J. McDuffie
Rick Mirer1993-5.8Notre DameIrv Smith
Kerry Collins1995-6.8Penn St.Kyle Brady
Kordell Stewart199519.9ColoradoMichael Westbrook
Bobby Hoying1996-9.6Ohio St.Terry Glenn; Rickey Dudley
Peyton Manning199840.5TennesseeMarcus Nash
Marques Tuiasosopo2001-14.2WashingtonJerramy Stevens
Chris Simms2003-2.3TexasRoy Williams
Matt Schaub200410.9VirginiaHeath Miller
JaMarcus Russell2007-30.5LSUDwayne Bowe; Craig Davis
Sam Bradford20100OklahomaJermaine Gresham
Brandon Weeden20120Oklahoma St.Justin Blackmon
Robert Griffin20120BaylorKendall Wright
Geno Smith20130West VirginiaTavon Austin

The repeats from the earlier list who were blessed with great help both on the line and at WR/TE were Rick Mirer, Kerry Collins and Sam Bradford. [6]All of those first-rounders were actually TEs (Irv Smith, Kyle Brady and Jermaine Gresham, respectively), although Collins also threw to a second-round WR in Bobby Engram. As you can see, Peyton Manning swings this upwards, but JaMarcus Russell swings it down just as much. Both of those would seem to be anecdotes that fit the story of teammates potentially inflating another player’s perceived value, with the QB inflating the WR (the instantly forgotten Marcus Nash) in Manning’s case and the WR (Dwayne Bowe) perhaps inflating the QB in Russell’s case.

Overall, though, it’s unclear whether WRs in general tend to inflate their QBs, making them overvalued in the draft. The effect size is substantial and just three of the 11 QBs have positive VAE, but it could be driven by random chance given the small sample size. [7]Kordell Stewart is one of those three and he did play a little WR in his first few years, too, but almost all of his value was at QB Given what I find below for predicting WR success, I suspect that the Manning-Nash example may happen more often than the Russell-Bowe situation.

Wide Receivers

Do great college quarterbacks cause NFL talent evaluators to reach for their wide receiver and tight end teammates? It seems like the answer to this question might be yes. Receivers selected in rounds 1-3 who come from schools with first-round QBs drafted the same or following year do 6.4 points worse relative to expectation from their draft position. Here, we have more data and the results are statistically significant that having a first-round college QB has led to their wide receivers being overvalued in the draft. [8]The p-value for this effect is .01 WRs drafted in the first three rounds without a top QB generated an average value in their first five years of 17.6, so the predicted drop in value is down to about 11.2. Having a first round QB thus predicts a WR gets taken a little more than a round too early. [9]For wide receivers, I estimate 17.6 as being the expected value generated by about the 46th pick, with 11.2 the expected value generated by the 89th pick

In fact, from 1984 to 2009, only 20% of the round 1-3 WR/TEs who played with first-round QBs had a positive VAE.

WR/TEYearVAESchoolQB
Jonathan Hayes1985-11.9IowaChuck Long
Flipper Anderson198817.3UCLATroy Aikman
Mike Bellamy1990-16.9IllinoisJeff George
Derek Brown1992-26.7Notre DameRick Mirer
Irv Smith1993-14.9Notre DameRick Mirer
Cory Fleming1994-10.4TennesseeHeath Shuler
Malcolm Floyd1994-7.9Fresno St.Trent Dilfer
Tydus Winans1994-9.8Fresno St.Trent Dilfer
Kyle Brady1995-20.4Penn St.Kerry Collins
Bryan Still1996-10.9Virginia TechJim Druckenmiller
Joey Kent1997-15.7TennesseePeyton Manning
Marcus Nash1998-21.1TennesseePeyton Manning
Patrick Johnson1998-8.7OregonAkili Smith
Kevin Johnson199910.6SyracuseDonovan McNabb
Jabar Gaffney2002-1.1FloridaRex Grossman
Reche Caldwell20022.7FloridaRex Grossman
Taylor Jacobs2003-16.2FloridaRex Grossman
Mike Williams2005-25.8USCMatt Leinart
Anthony Fasano2006-2.3Notre DameBrady Quinn
David Thomas2006-2.5TexasVince Young
Dominique Byrd2006-10.7USCMatt Leinart
Maurice Stovall2006-6.1Notre DameBrady Quinn
Craig Davis2007-15.1LSUJaMarcus Russell
Dwayne Bowe200713.4LSUJaMarcus Russell
Fred Davis2008-2.3USCMark Sanchez
Jordy Nelson200812.8Kansas St.Josh Freeman
Juaquin Iglesias2009-10.1OklahomaSam Bradford
Mohamed Massaquoi2009-2.9GeorgiaMatthew Stafford
Patrick Turner2009-10.4USCMark Sanchez
Percy Harvin200917FloridaTim Tebow
Jermaine Gresham20100OklahomaSam Bradford
Coby Fleener20120StanfordAndrew Luck
Justin Blackmon20120Oklahoma St.Brandon Weeden
Kendall Wright20120BaylorRobert Griffin

And at least one of the successes on this list is an exception that fits the broader idea. Percy Harvin played with a QB who just maybe was a slight reach as a first round pick. It’s hard to think that Tim Tebow made Percy Harvin look good. [10]I’d argue the same for Dwayne Bowe and JaMarcus Russell, but Russell at least was a legitimately excellent passer in 2006 At least based on these results, having a great college QB has caused wide receivers to be drafted much too highly over the last thirty years.

Conclusion

So it seems like Bucs fans might have more to worry about than Browns fans. The evidence is unclear on whether QBs such as Manziel generally become overvalued from playing with first-round receiver talent, although there might be something going on there. But the evidence is much clearer that WRs such as Evans become overvalued from playing with premier college QBs. Perhaps it’s not surprising from what we know about the NFL that there’s a pretty good chance that Manziel’s excellence helped inflate Evans’s value.

Of course, the last example of a 6’5 receiver drafted in the top ten who played with a first-round Heisman-winning QB doesn’t bode well for Evans, either. [11]The similarities don’t stop there. Mike Williams is listed at 229 lbs and ran a 4.56 40 at the combine. Evans is at 231 and ran a 4.53. And they’re both named Mike. And while Evans will likely still be in the NFL after six years unlike Mike Williams, it is likely that he would have gone lower in the draft if he played with a quarterback not quite so good as Johnny Football.

References

References
1 And he had a talented tight end go in the fourth round in 2010, too. Like Tebow, he is also no longer playing football. Let’s move on.
2 I did this by running a regression of a player’s value in the first five years on a fifth-order polynomial in draft position. This is pretty much the same thing as looking at the value a player generates compared to their expected value according to Chase’s chart, except I also control for whether a player went to a major football school.
3 The p-value is 0.70
4 All analysis in this post ignores the supplemental draft.
5 p = .20
6 All of those first-rounders were actually TEs (Irv Smith, Kyle Brady and Jermaine Gresham, respectively), although Collins also threw to a second-round WR in Bobby Engram.
7 Kordell Stewart is one of those three and he did play a little WR in his first few years, too, but almost all of his value was at QB
8 The p-value for this effect is .01
9 For wide receivers, I estimate 17.6 as being the expected value generated by about the 46th pick, with 11.2 the expected value generated by the 89th pick
10 I’d argue the same for Dwayne Bowe and JaMarcus Russell, but Russell at least was a legitimately excellent passer in 2006
11 The similarities don’t stop there. Mike Williams is listed at 229 lbs and ran a 4.56 40 at the combine. Evans is at 231 and ran a 4.53. And they’re both named Mike.
{ 37 comments }

The NFL Draft and the Wisdom of Crowds

[Chase note: Take a look at the name at the top of this post. Our good friend Andrew continues to desire to post here, and we thank him for that.]

Not the focus of Galton's experiment.

Not the focus of Galton's experiment.

In 1906, Sir Francis Galton probably wasn’t thinking about the NFL draft when he asked almost 800 fair goers to guess the weight of an ox. No one person accurately guessed its weight, and the guesses were all over the map, but the mean of all the guesses (1197 lbs) was within one pound of the actual weight of the ox. As I looked through endless mock drafts leading up to last Thursday night, I wondered if there was anything to be gained by looking at the wisdom of the crowds. Could we do a better job of predicting the NFL draft if we took all the knowledge and tried to put it together?

And the answer appears to be yes… to an extent. The NFL draft is not exactly a place where we’d expect the wisdom of crowds to be particularly strong. The power of the wisdom of crowds comes from lots of people bringing their own independent information to the table. For example, prediction markets appear to do a great job of predicting events like a president’s chances of being reelected. Sports prediction markets (a.k.a sportsbooks) similarly succeed in predicting game outcomes. And the stock market often reveals companies’ true values. In each case, every individual transaction represents a piece of information which gets reflected in the price.

Of course, the crowd is not always so wise. Stock markets can go haywire. Betting lines can be affected by people’s biases. The wisdom of crowds can break down when groupthink occurs and people stop having independent opinions. The NFL draft certainly looks like such a case. All the mock drafts are out there and the experts have the implicit pressure to not be too different. [1]In some cases, there may be incentives to stand out from the crowd with an original prediction, too. Overall, there are incentives that can make predictions depend on those made by others. In those circumstances, we could lose in a haze of groupthink much of the original information that people have. [continue reading…]

References

References
1 In some cases, there may be incentives to stand out from the crowd with an original prediction, too. Overall, there are incentives that can make predictions depend on those made by others.
{ 9 comments }

Drafting Diamonds in the Rough

Guest blogger Andrew Healy, an economics professor at Loyola Marymount University, is back and the author of today’s post. As a reminder, there a tag at the site where you can find all of his great work.


Small school defender takes down big school quarterback

Small school defender takes down big school quarterback.

Asante Samuel. Jahri Evans. Robert Mathis. These three players share something in common that offers a hint to finding steals in the middle rounds of the draft. All three eventually made Pro Bowls. Each was drafted in Round 4 or later. And each played for a notable football powerhouse in college: Central Florida [1]In 2003, Central Florida went 3-9 in the MAC. While the Blake Bortles Knights may not be a football powerhouse, either, the 2013 UCF team that went 12-1 in the American Conference bears little … Continue reading, Bloomsburg, Alabama A&M.

The success of these smaller college players relative to their marquee school competitors turns out to be a much more general phenomenon. In the middle rounds of the NFL draft, players from outside the traditional power conferences have been more than twice as likely to eventually make the Pro Bowl as players from the most famous programs. On defense, small school players have been even more likely to make the Pro Bowl than their major school counterparts.

Let’s use the 2003 draft as an example. Only 5% (6 out of 116) of the major college players selected in round 4 or later eventually made it to a Pro Bowl. At the same time, 12% (6 out of 50) of small college players would eventually be selected for Hawaii. At the very least, if you were watching the draft and wanting to know what the chances are that your team drafted a future star, those chances increased in the middle of the draft when your team picked a player from a school like Bloomsburg than when it picked another player from the SEC.

In fact, it’s hard to think of anything else that can match the impact of simply picking small-school players as a way to find stars in the middle rounds. The data suggest that this logic has even applied at the top of the draft for comparisons such as those between Buffalo’s Khalil Mack and South Carolina’s Jadeveon Clowney. But the big gains from focusing on smaller football schools have come from finding the gems that the draft buzz mostly bypasses. Consistently, general managers have wasted picks on players from major conferences, missing chances to find difference-makers―particularly on defense―from schools such as Northern Colorado and Idaho State. [2]Bonus points for getting those players. Aaron Smith was a 4th round pick out of Northern Colorado in 1999 and Jared Allen was a 4th round pick out of Idaho State in 2004.

The Data

I look at all players drafted from 1998-2007, stopping at the later year to give players time to make a Pro Bowl. The measure of excellence is making a Pro Bowl, but I’ll also look at All-Pro selections. I ignore players listed at special teams positions (P, K, and KR), although it’s possible you could make a Pro Bowl as a special teamer after being drafted at an offensive or defensive position. I also did not include fullbacks because it became so easy to make the Pro Bowl at that spot.

Major conferences are defined according to the traditional BCS definitions: Big East/American, Big 10, Big 12, Pac 10, SEC, and ACC. Notre Dame is also included with these bigger (in terms of football) schools. A school such as Wake Forest gets defined as a big football school by this measure and it probably shouldn’t be, but adjustments from this definition would be judgment calls and so this simple rule seems best.

Note that almost none of the middle-round small-school Pro Bowlers during this time period come from schools such as Boise State that were big football schools at the time. The two possible exceptions are Brett Keisel of BYU (drafted in 2002) and Paul Soliai of Utah, who was drafted in 2007 before Utah joined the Pac-12.

Comparing Average Success Across Schools

Small school players get drafted later than big school players, so we need to control for draft position to get a fair comparison between them. Later, I’ll use regression to do that. Here, I’m just going to break down results according to ranges of draft position. The chance of making the Pro Bowl is much higher in the early parts of the draft, so I’ll break things down there according to selection number rather than just the round.

The table below looks at the first three rounds of the draft. Overall, the chances of drafting a Pro Bowler tend to be higher for small school players in the first three rounds. The small school samples are limited in the first round, but the share of small school players who make a Pro Bowl is higher throughout than for big schools. Out of all the rounds, the 2nd round is the only one where we see a small trend the other way.

 Small schoolsBig schools
Round# of selections% Pro Bowlers# of selections% Pro Bowlers
1 (Pick 1-10)771.4%9355.9%
1 (Pick 11-20)850.0%9141.8%
1 (Pick 21-32)1145.5%9929.3%
2 (Pick 33-48)2623.1%13124.4%
2 (Pick 49-64)3511.4%11215.2%
38310.8%2449.0%

The largest differences, and the clearest benefit from drafting players from smaller schools, come in the middle rounds. The table below shows the differences in rounds 4-7. In round 4 over the ten-year period, teams have been about three times more likely to draft a Pro Bowler when picking from a small school rather than a big one. 12.9% of small school draftees in Round 4 have made the Pro Bowl, compared to just 4.1% of big school players.

 Small schoolsBig schools
Round# of selections% Pro Bowlers# of selections% Pro Bowlers
49312.9%2474.1%
51088.3%2283.5%
61353.7%2203.6%
71572.6%2941.7%

In round 5, we see a similarly large difference. Round 5 players from small schools have been more than twice as likely as big school players to make a Pro Bowl. Altogether, across rounds 4 and 5, despite 475 non-special teams players being drafted from big schools, just 18 (3.8%) have made a Pro Bowl. On the other hand, out of just 201 players drafted in those rounds from small schools, 21 (10.5%) made a Pro Bowl. If you wanted to find a future star in rounds 4 or 5, you would have increased your chances by more than double by looking at the Northern Colorados and Alabama A&Ms of college football rather than the USCs and Alabamas.

[Chase note: It is at this point that I decided I needed to stop reading the article.  I trust Andrew, but found his claims too remarkable to just blindly accept. So I decided to open up my database to confirm. I removed punters and kickers but kept everyone else in the database.  To my amazement, the numbers not only seem legit, but perhaps even under-reported.  The average player selected from the 4th or 5th round from a Big School made 0.06 Pro Bowls, compared to 0.22 Pro Bowls for players from non-major schools!]

Regression Results: Controlling for Draft Position in a Flexible Way

To figure out the average bonus small school players offer compared to large school players, we can use linear regression to control for draft position. In the regressions, I predict whether a player became a Pro Bowler with a cubic polynomial in draft position and whether the player went to a major school. The regression results indicate that, looking across rounds and controlling for draft position, players from small schools are about 3 percentage points more likely to become Pro Bowlers. [3]We get almost the same result if we include higher powers of the pick number. We also get similar results if we use a logit instead of a linear regression. The standard error for the estimate is in … Continue reading

All rounds ( N = 2427 (0.014)):

[math]Pro Bowl = f(Pick, Pick^2, Pick^3) + 0.030 *Small School [/math]

The three percentage point bump for small school players is a substantial boost. Across all rounds of the draft, about 11.8% of the main position players made a Pro Bowl. Compared to this baseline, teams increase their chances of drafting a Pro Bowler by about 20% by drafting a small school player.

We can see more of this pattern by breaking things down according to the early and later rounds. If we look at rounds 1-3, nothing statistically significant emerges. The point estimate follows the overall pattern, but the result is not clear, in part due to the relatively small number of small school players drafted in the first three rounds.

Rounds 1-3 (N = 947 (0.034)):

[math]Pro Bowl = f(Pick, Pick^2, Pick^3) + 0.021 *Small School [/math]

On the other hand, in rounds 4-7, we get a very clear impact of picking small school players, an effect that is even more striking given the much smaller share of players who make the Pro Bowl in those rounds compared to earlier ones.

Round 4-7 (N = 1480 (0.011)):

[math]Pro Bowl = f(Pick, Pick^2, Pick^3) + 0.033 *Small School [/math]

We see that, controlling for the selection, small school players are 3.3 percentage points more likely to make the Pro Bowl. [4]The t-statistic is 3.04 and the p-value is .002. This represents about a doubling of the chance that a major school player makes the Pro Bowl. Just 3.1% of major school players drafted in Rounds 4-7 at the main positions made the Pro Bowl. The model predicts that around 6.4% of small school players drafted in those same positions would have made the Pro Bowl.

All-Pro Appearances

So focusing on small school players offers a much better way to draft a future star according to Pro Bowl appearances. And it doesn’t look like this is just about Pro Bowls. Instead, it’s pretty clear that small school players perform better more generally than major school players, once we control for draft position, with these differences primarily driven by the middle rounds, particularly 4 and 5.

Small school players drafted in rounds 4-7 are also about twice as likely to appear on an All-Pro team as their major school counterparts. Controlling for draft position, small school players are about 1.3 percentage points more likely to make an All-Pro team, relative to a baseline where 1.5% of major school players made an All-Pro team.

All-Pro (N = 1480 (0.008)):

[math]All-Pro= f(Pick, Pick^2, Pick^3) + 0.013 *Small School [/math]

Particularly given the relatively small number of players who made an All-Pro team, we can look at this another way by considering the number of appearances a player made on an All-Pro team. Controlling for draft position, players drafted in the middle rounds from small schools have an average of .036 more All-Pro selections than major school players. The mean number of All-Pro selections for major school players is .022, so small school players are predicted to have more than twice the number of All-Pro selections as their major school counterparts. [5]The small school players drafted in rounds 4-7 who made an All-Pro team are (with the number of appearances in parentheses): Adalius Thomas (2), Asante Samuel (3), Brandon Marshall (1), Cortland … Continue reading

Number of All-Pro Appearances (N = 1480 (0.015)):

[math]All-Pro Appearances = f(Pick, Pick^2, Pick^3) + 0.036 *Small School [/math]


The Best Defense Comes from Small Schools

One other interesting pattern in the data is the offense/defense breakdown. All of the above effects are driven by the defense. If we look just at offense, there’s basically no difference between big and small schools, which mimics what Chase found using a different methodology last year.  However, there are large gaps for defensive players.

Take the regression from before for rounds 4-7. Now let’s break it down separately for offense and defense:

Round 4-7, Offense only (N = 749 (0.016)):

[math]Pro Bowl = f(Pick, Pick^2, Pick^3) + 0.003 *Small School [/math]

Round 4-7, Defense only (N = 731 (0.015))::

[math]Pro Bowl = f(Pick, Pick^2, Pick^3) + 0.060 *Small School [/math]

The last gap is pretty enormous. Even if we don’t control for the spot the player is selected―which works against small school players since they get drafted later―we see the huge differences between small and large school defensive players. Out of 499 defensive players drafted in rounds 4-7 from major conference schools between 1998 and 2007, 10 (2.0%) made the Pro Bowl. On the other hand, out of 231 small school players drafted in those same rounds, 18 (7.8%) made the Pro Bowl. The gap for all-pro appearances is similarly large. There were a total of 10 all-pro appearances for the 499 large-school defensive players (.020 per player) and 17 all-pro appearances for the 232 small-school players (.073 per player) drafted in rounds 4-7 during this period.

Even though we have fewer than half as many draftees to pick from compared to major school players, look at the starting 11 we can field from small school players mostly picked in round 4 or later, with two round 3 draftees to fill in a couple of holes:

DE      Robert Mathis
DT      Paul Soliai
DT      Aaron Smith
DE       Jared Allen
OLB    Joey Porter (3)
MLB   Jeremiah Trotter (3)
OLB   Adalius Thomas
CB      Asante Samuel
CB      Cortland Finnegan
FS       Kerry Rhodes [6] Rhodes has actually never made a Pro Bowl, but he was second-team All-Pro in 2006. He did not count in the players from small schools who have made a Pro Bowl.
SS       Antoine Bethea

Note that if you go back a few more years, you can substitute La’Roi Glover (5th round, 1996, San Diego St.) for Soliai and Rodney Harrison (5th round, 1994, Western Illinois) in at SS, sliding Bethea in for Rhodes at FS. That is a pretty sweet defense, all built on middle-to-late round picks from small schools.

Conclusion

The data show that picks in the middle rounds of the draft have been substantially more productive when spent on players from smaller schools. Despite picking major-school players more than twice as frequently, teams have found as many stars from the smaller schools. On defense, they have actually found substantially more stars from schools such as New Hampshire than ones such as LSU. A defensive player taken in round 4 or later has been almost four times more likely to eventually make a Pro Bowl when that player comes from a school outside the traditional power conferences. Stars such as Jared Allen, Asante Samuel, and Robert Mathis are part of a larger pattern. Teams have found those essential mid-round steals by drafting players from smaller schools.

Why has there been this opportunity to do better by picking small school players? One possibility is that there was less information out there about those players, a gap that would have been decreasing as film and televised college games have become ubiquitous. That explanation makes some sense since the benefit to smaller school players emerges in the middle rounds, long after the Brian Urlachers (New Mexico) and Joe Greenes (North Texas) who were impossible to miss had been selected. However, with the sample going from 1998-2007, this explanation seems unsatisfying since teams have had relatively easy access to information about any college player.

The explanation that I think could make more sense is some kind of risk aversion, kind of like the bias that leads to punts on fourth down. Maybe teams in the middle rounds, not seeing clear standouts, felt that it’s safer to pick the player from Alabama instead of the one from Idaho State. Even though it’s anything but safer, general managers can say to themselves that they’re getting a player who’s a known quantity due to the college program he comes from. Picking the major school player might even be the kind of move that’s harder to criticize, putting the general manager in a similar position to the coach facing 4th and 3 at midfield, where the best choice for the team may not be optimal for the decision maker. Whatever the reason, the bias towards major school players in the middle rounds has left available potential stars to the teams that have chosen players from overlooked schools.

However, this potential opportunity may already be gone. Since 2008, six defensive players have made Pro Bowls and were drafted after round three. All six were actually from major schools: Kam Chancellor (Virginia Tech) and Richard Sherman (Stanford) in Seattle, Geno Atkins (Georgia), Henry Melton (Texas), Alterraun Verner (UCLA), and Greg Hardy (Mississippi). Across offense and defense, it’s eight Pro Bowlers for large schools (adding Carl Nicks and Jordan Cameron) versus four for small schools (Alfred Morris, True Receiving Yards champ Antonio Brown, Josh Sitton, and Julius Thomas, and not counting Jerome Felton, who plays FB), about the same ratio as players drafted altogether. Still, the biggest stars here are clearly the big school players.

Even though we need more years of data on all the players in these drafts, it is possible that the previous trend has shifted. Assuming that’s right, why might that have happened? One possibility is that ever more schools are getting national media attention, meaning that small schools aren’t so small anymore. [7]Another possibility is that NFL teams have changed their behavior. There has been almost no change over time, though, in the share of small school defensive players selected at certain points in the … Continue reading    Another possibility that seems even more plausible to me is that the increasing information on high school players means that great players are now less likely to be at small schools in the first place. Even though there will always be some great players who end up at small schools (see Watt, J.J.), maybe Jared Allen would have been recruited more heavily if he played now. There may now be fewer diamonds in the rough than there used to be. That idea suggests there might have been even more diamonds in the rough if we look at earlier years. And that looks like it might be exactly the case. Just looking at rounds 4 and later in some of these earlier drafts is kind of incredible. In 1989, there were five (non-kicker) Pro Bowlers from small schools and only one from a large school. In 1990, there were nine small school Pro Bowlers (including HOFer Shannon Sharpe) compared to just four from major schools. In 1991, it was eight small school Pro Bowlers compared to just two major school players. [8]Some of the late round diamonds in the rough may have become undrafted free agents in later years. For example, James Harrison (Kent State) and London Fletcher (John Carroll) are two small school … Continue reading All of this appears even though substantially more large school players are drafted in rounds 4-8. While the chance to find a small school steal was just on defense from 1998-2007, it seems like the opportunities may have been all over the field in earlier years.

References

References
1 In 2003, Central Florida went 3-9 in the MAC. While the Blake Bortles Knights may not be a football powerhouse, either, the 2013 UCF team that went 12-1 in the American Conference bears little resemblance to where the program was a decade ago.
2 Bonus points for getting those players. Aaron Smith was a 4th round pick out of Northern Colorado in 1999 and Jared Allen was a 4th round pick out of Idaho State in 2004.
3 We get almost the same result if we include higher powers of the pick number. We also get similar results if we use a logit instead of a linear regression. The standard error for the estimate is in parentheses.
4 The t-statistic is 3.04 and the p-value is .002.
5 The small school players drafted in rounds 4-7 who made an All-Pro team are (with the number of appearances in parentheses): Adalius Thomas (2), Asante Samuel (3), Brandon Marshall (1), Cortland Finnegan (1), Jahri Evans (5), Jared Allen (4), Jerry Azumah (1), Lance Schulters (1), Matt Birk (2), Michael Turner (2), Robert Mathis (1), Terrence McGee (2), and Trent Cole (1). Of these, McGee made it as a special teams player. Amongst major college players drafted in rounds 4-7, Dante Hall and Leon Washington made All-Pro teams as special teamers during this time.
6 Rhodes has actually never made a Pro Bowl, but he was second-team All-Pro in 2006. He did not count in the players from small schools who have made a Pro Bowl.
7 Another possibility is that NFL teams have changed their behavior. There has been almost no change over time, though, in the share of small school defensive players selected at certain points in the draft.
8 Some of the late round diamonds in the rough may have become undrafted free agents in later years. For example, James Harrison (Kent State) and London Fletcher (John Carroll) are two small school UDFAs who made Pro Bowls.
{ 13 comments }

By now, you know about guest blogger Andrew Healy, an economics professor at Loyola Marymount University and author of today’s post. There’s now a tag at the site where you can find all of his great work. He’s back with a cap to his excellent series about playoff performance, and today’s post will not disappoint:


The Purple People Eaters never won a Super Bowl

The Purple People Eaters never won a Super Bowl.

We know the teams that have experienced consistent heartbreak at the altar. But is it the Vikings, Eagles, or Bills that are the most unlikely to have never won a Super Bowl? On the flip side, we know the teams that stacked championships on top of championships. But is it the Packers, Steelers, or 49ers that have made the most of their chances?

For the latter question, it turns out that it’s option D, none of the above.  One mystery team has won four championships despite having had a pretty decent chance of never winning a single Lombardi.  The most unlikely team never to win a Super Bowl turns out to be a team that lost “only” two Super Bowls, but that has led the NFL in DVOA four times since 1979.

To figure this stuff out, I’ve utilized DVOA ratings and estimated DVOA ratings to rerun the NFL playoffs. In the simulations, the slate is wiped clean, which means there’s no reason The Fumble or The Helmet Catch or The Immaculate Reception have to happen this time around.

In last week’s post, I went decade by decade to look at the best teams, and also those that most let opportunity slip through their fingers. Today, I bring it all together. I compare what might have been with what actually was for the NFL from 1950 to 2013. I’ll also hand out awards for the teams that were the most unlikely winners and the most unlikely losers of all time. [continue reading…]

{ 9 comments }

Ranking the Almost Dynasties, Part II

Andrew Healy is back with a sequel to his popular post. As always, we thank him for his generous contributions. Andrew Healy is an economics professor at Loyola Marymount University. He is a big fan of the New England Patriots and Joe Benigno.


A couple of weeks ago, I went decade-by-decade since the 1970 AFL-NFL merger to identify the teams that were the best of their eras and the teams that nearly became the teams we remember most instead. In those rankings, I used Pro Football Reference’s Simple Rating System to estimate team strength. Today, I use Football Outsiders’ DVOA ratings and go back an additional twenty years. Using DVOA produces some pretty notable differences that were bigger than I would have guessed.

What are some of those changes?

  • The Steelers have been supplanted as the true team of the ‘70s.
  • The best team to win no titles changes for three of the decades.
  • The ‘70s Vikings get replaced by a more recent what-might-have-been team as the best to win nothing in the Super Bowl era.

Before we get to that, I cover the 1950s and 1960s, identifying the true teams of those decades and the what-might-have-been teams. In a follow-up post, I’ll bring it all together and identify the franchises that have maximized their championship potential the most, and those that have left the most money on the table. [continue reading…]

{ 17 comments }

Ranking The Almost Dynasties

A couple of weeks ago, Andrew Healy contributed a guest post titled, “One Play Away.” He’s back at it today, and we thank him for another generous contribution. Andrew Healy is an economics professor at Loyola Marymount University. He is a big fan of the New England Patriots and Joe Benigno.


What teams do we remember the most? Going back to the merger, the 1970s Steelers, the 1980s 49ers, the 1990s Cowboys, and the 2000s Patriots seem to stand above the rest. Each of these teams earned that place in our collective memory by winning the most Super Bowls in the decade.

How different could it have been? In other words, were the dynasties that happened by far the most likely ones? Or were there others that were equally, or even more likely? Think of teams that have suffered unusually cruel sequences of defeats (cue nodding Vikings, Bills, and Browns fans). We all know that those teams could have won Super Bowls. But maybe the more interesting question is whether those teams realistically could have won multiple Super Bowls, or even have become the dominant team of the era.

Today, I estimate the chances that different teams had of becoming the Team of the Decade (the TOD) for the ’70s, ’80, ’90s, and ’00s. Some of the results are surprising. One of the teams that became the TOD was actually much less likely than another to dominate that decade. Only two of the four teams truly stand out as being clearly the single most-likely team to be the TOD.

Even more interesting are the teams that might have been dynasties instead of the ones we’ve come to know. In most cases, these teams won at least one Super Bowl. In one case, though, a team that became famous for losing easily could have been not just a one-time winner, but a team that became a dynasty and dominated the decade.

To come up with the estimates of a team’s chances of winning Super Bowl, I simulated the playoffs 50,000 times. I used the actual playoff brackets and then created win probabilities for each game based on team strength. In tables that follow below, I’ll describe the probabilities that teams won multiple titles in a decade. I’ll also pick a True Team of the Decade (most expected Super Bowl wins), a What-Might-Have-Been-Dynasty that Won Nothing, a Team that Wasn’t as Good as We Remember, and a A Bottom-Feeder Team(s) for each decade.

First, a brief description of how I performed the simulations before getting to the rankings:

  • The playoffs were run under the rules in a given year: All rules relating to seeding, home field, and number of teams were used. If there was a rule in place preventing matchups between divisional opponents in a given round, I also applied that rule. To some extent, the fewer teams in earlier years helped make dynasties more likely in those decades.
  • Pro Football Reference’s Simple Rating System was used to measure team strength: I used PFR’s for all years to be consistent. It’s worth noting that their ratings and DVOA usually match up closely. Another possibility is to try to simulate DVOA ratings, but it seems simpler to just use SRS throughout. In some cases, there are some differences, such as for the 1998 Broncos and 1999 Titans.
  • I used the beginning of the NFL season to define the decades: So 1970-79 means Super Bowls V-XIV. An interesting thought experiment is to consider Super Bowl time instead of calendar decades. Then the Raiders would have been the team of Super Bowls XI-XX. Anyway, I’ll stick with the convention. It’s worth noting that my results suggest the Raiders were not as good as we might remember.

1970s

The table below shows each franchise’s probability of having won 0, 1, 2, 3, 4, 5, or 6 Super Bowls during the decade according to the methodology described above. The final column shows the expected number of Super Bowl wins for the decade.

Team0123456E(Wins)
PIT0.1450.330.3120.1560.0490.0080.0011.659
DAL0.2090.3770.2750.1110.0240.00401.377
MIN0.2360.4070.2610.0810.0130.00101.232
MIA0.3430.4220.1910.0390.004000.941
RAM0.390.3990.1690.0370.005000.87
OAK0.3950.4020.1650.0340.005000.853
BAL0.5610.3550.0760.0080000.532
WAS0.6010.3330.0610.0050000.469
SD0.6410.359000000.359
DEN0.6540.320.0250.0010000.373
SF0.7430.2350.0220.0010000.281
DET0.7620.238000000.238
NE0.8320.1610.00700000.175
CIN0.8820.1140.00400000.123
KC0.8920.108000000.108
STL0.90.0970.00300000.103
GB0.9050.095000000.095
PHI0.9240.0750.00100000.077
CLE0.9650.035000000.035
HOU0.9720.028000000.028
TB0.9740.026000000.026
BUF0.9750.025000000.025
CHI0.9820.018000000.018
ATL0.9980.002000000.002
NYG10000000
NYJ10000000
SEA10000000

The True Team of the Decade: Pittsburgh Steelers
The Steelers had only a 14.5% chance of winning no Super Bowls in the ’70s and a 4.9% chance of winning the four that they did. The expected value of SB wins for Pittsburgh was 1.67, the highest value for any team in any decade.

The What-Might-Have-Been-Dynasty that Won Nothing: Minnesota Vikings
The Vikings are not too far away from the Steelers and Cowboys. There was only a 23.6% chance the Vikings would have won nothing in the ’70s. And they certainly could have won multiple championships. There was over a 35% chance the Vikings would have won at least two titles and a 9.6% chance they would have won at least three. Of all the teams that won nothing, the 1970s Vikings are the best candidate for the team that could have been the TOD.

The What-Might-Have-Been Dynasty that Won Nothing, Part 2: Los Angeles Rams

A little bit behind the Vikings are the Rams. Los Angeles had only a 39% chance of winning no Super Bowls in the ’70s and a 20.3% chance of winning multiple titles.

The Team that Wasn’t as Good as We Remember: Oakland Raiders
When I starting working with the data, I expected the Raiders to challenge for the TOD. Five losses in the AFC championship to go with the one title. Seven playoff appearances. Despite all that, the Raiders only had the sixth-most expected titles in the decade. In fact, they didn’t really underperform at all in terms of titles. They had a 39.5% chance of winning none at all. The Raiders’ SRS ratings explain this. Oakland was never really great, only passing +10.0 in a year (1977) where they finished second in the division.

Bottom-Feeder Teams: New York Giants, New York Jets
Only two teams played the entire decade and missed the playoffs every single year. They happened to be the two teams that played in New York. The chance that two teams would miss the playoffs every year and New York would happen to miss playoff football entirely: about 0.2%.

1980s

Team0123456E(Wins)
SF0.1460.3370.310.1560.0420.0070.0011.637
CHI0.2890.4810.1980.030.002000.975
MIA0.4160.3970.1540.0290.003000.805
WAS0.3920.450.1410.0170.001000.785
DEN0.4730.4020.1120.0120000.664
CLE0.5370.3710.0830.0090000.565
PHI0.5850.3550.0560.0030000.478
DAL0.6010.3290.0650.0050000.475
CIN0.6080.340.0510.0010000.446
NYG0.6250.3320.0420.0010000.419
OAK/LA0.6430.3020.050.0050000.417
SD0.70.2710.0280.0010000.329
BUF0.7070.2620.030.0010000.324
MIN0.7560.2250.0180.0010000.263
NYJ0.7720.210.01800000.247
ATL0.7840.2160.00100000.217
RAM0.8370.1520.0100000.174
NE0.8690.1290.00200000.134
NO0.8720.128000000.128
SEA0.9010.0970.00300000.102
GB0.9020.098000000.098
PIT0.9090.0880.00300000.094
TB0.930.07000000.071
HOU0.940.0590.00200000.062
BAL/IND0.9570.043000000.043
DET0.9720.027000000.028
KC0.9830.017000000.017
STL/PHX0.9970.003000000.003

The True Team of the Decade: San Francisco 49ers
Unlike the 1970s, the ’80s weren’t close. The Niners were similar to the ’70s Steelers with an expectation of 1.64 Super Bowl wins in the decade. The ’80s 49ers had about a 4.2% chance of winning the four Super Bowls they did and 51.7% chance of winning at least two. And, while not shown in the table above, it’s exciting to note that the Niners had a 0.004% chance of winning seven Super Bowls in the 1980s.

The What-Might-Have-Been-Dynasty that Won Nothing: Miami Dolphins
I was really surprised by this one. The Dolphins come in third in the 1980s in expected SB wins with 0.81. Based on their consistency in the first half of the decade, the Dolphins had an 18.6% chance of winning multiple Super Bowls in the 1980s. That’s substantially higher than the 12.4% chance for their nearest competitor: the much better-remembered Denver Broncos who were annihilated in three Super Bowls.

The Team that Wasn’t as Good as We Remember: Oakland/LA Raiders
Despite never being close to dominant, the Raiders won two Super Bowls in the 1980s. According to the number of SB wins we would have expected them to have, the Raiders actually rank 11th, behind six teams that won none in the decade. They had about a 5.5% chance of winning multiple titles in the decade.

A Bottom-Feeder Team: Houston Oilers
For teams that played every season since the merger, the Oilers had the least hope of winning a title over the 1970s and 1980s combined. That’s a little surprising given that they had at least one memorable moment in the playoffs during that stretch, unlike some of the teams ahead of them.

1990s

Team0123456E(Wins)
SF0.1510.3310.3080.1560.0460.0070.0011.639
DAL0.3120.4160.2160.0510.005001.023
GB0.3630.4870.1380.0110000.799
WAS0.3950.5630.0410.0010000.647
BUF0.5190.3710.0960.0140.001000.607
KC0.5130.3830.0950.0090000.601
DEN0.5520.3510.0860.010000.557
MIN0.550.3990.0490.0020000.504
PIT0.5930.3280.0720.0070000.495
RAM/STL0.5780.422000000.422
HOU/TEN0.6580.3010.0390.0020000.386
NYG0.7640.2260.0100000.247
JAC0.8020.1920.00600000.204
MIA0.8130.1730.0130.0010000.202
NYJ0.8010.199000000.2
LA/OAK0.830.1670.00300000.173
NE0.8420.1510.00700000.166
ATL0.850.1490.00100000.151
SD0.8660.1290.00500000.139
IND0.8660.1330.00100000.135
NO0.8710.1250.00300000.132
DET0.8860.110.00400000.118
CAR0.8990.101000000.101
PHI0.9050.0920.00300000.097
TB0.9160.0830.00100000.086
CLE/BAL0.9190.081000000.081
CHI0.9560.043000000.044
SEA0.9590.041000000.041
CIN0.9930.007000000.007
PHX/ARI10000000

The True Team of the Decade: San Francisco 49ers
This one almost leaps off the page. Not only were the Niners on top in the 1990s in terms of expected SB wins, they were way on top. Given the Cowboys’ relatively short run, it’s not surprising that they would do worse here, but they’re closer to the 10th place Rams on this list than they are to the 49ers. Even though they only won one in the decade, the Niners had the same number (1.64) of expected titles in the ’90s as they did in the ’80s, and a 51.7% chance of multiple titles.

The What-Might-Have-Been-Dynasty that Won Nothing: Buffalo Bills
The Bills actually do worse on this list than I would have expected. They were about even money to win the zero titles that they did in the ’90s. They had an 11.0% chance of winning multiple titles, making them the top-ranked no-title team of the ’90s, but ranking them well behind the ’70s Vikings, the ’70s Rams, and the ’80s Dolphins.

The What-Might-Have-Been-Dynasty that Won Nothing, Part 2: Kansas City Chiefs
On the field, the ’90s Chiefs only went to one AFC Championship game and no Super Bowls. Nevertheless, they’re about even with the Bills in terms of the Super Bowls they could have won. They had a 10.4% chance of winning multiple titles in the ’90s.

The Team that Wasn’t as Good as We Remember: Pittsburgh Steelers
I’m not sure there’s a great candidate in this category, so I was tempted to just pick the Raiders again to keep the pattern. You could go with Broncos here, but the 1998 Broncos are one case where there’s a clear gap between SRS and DVOA, which gives them more credit. The ’90s Steelers had four playoff byes in a run of six straight playoff appearances. Still, they had a 59.3% chance of winning no Super Bowls and only a 7.9% chance of winning multiple titles.

A Bottom-Feeder Team: Phoenix/Arizona Cardinals
The worst team in two consecutive decades. Over twenty years, the Cardinals had 0.003 expected titles. That’s only 0.003 more expected titles than the Houston Texans and they weren’t even in the league yet.

2000s

Team0123456E(Wins)
NE0.170.4160.2990.0980.0160.00101.38
IND0.4150.4020.1480.0310.004000.807
PHI0.4280.3990.1430.0270.003000.78
PIT0.4630.3990.1220.0160000.693
OAK0.4690.4320.0970.0020000.633
STL0.4940.4320.0720.0020000.584
TEN0.5780.3470.070.0050000.501
SD0.5890.3470.060.0040000.48
BAL0.6220.3160.0570.0050000.445
CHI0.6390.3190.0410.0010000.404
NYG0.6470.3070.0440.0030000.403
NO0.6410.3260.0330.0010000.393
GB0.6990.260.0380.0030000.344
TB0.710.2650.0240.0010000.316
DEN0.7160.2680.0160.0010000.3
SEA0.740.250.0100000.27
DAL0.7870.1990.01400000.227
MIN0.7880.1970.01400000.226
KC0.8010.1980.00100000.199
CAR0.8560.140.00400000.149
NYJ0.8690.1240.00600000.138
ATL0.9140.0830.00300000.088
MIA0.920.0790.00100000.082
WAS0.9520.048000000.049
SF0.9630.037000000.038
JAC0.9710.029000000.029
CIN0.9750.025000000.025
CLE0.9910.009000000.009
ARI0.9910.009000000.009
BUF10000000
DET10000000
HOU10000000

The True Team of the Decade: New England Patriots
Less dominant than the other True TODs, the Patriots of the aughts still have a healthy gap over their closest rival, the Colts. There was only a 17% chance the Patriots would have gotten shut out in the ’00s. There was a 41.7% chance that the Pats would win multiple titles in the decade, more than double the chance of any other team.

The What-Might-Have-Been-Dynasty that Won Nothing: Philadelphia Eagles
The Eagles rank third in expected titles in the ’00s with 0.78, just a hair behind the Colts for second. They also look similar to the 1970s Rams and 1980s Dolphins in terms of multiple-title potential. They had about a 17.4% chance of winning multiple titles in the aughts.

The Team that Wasn’t as Good as We Remember: Tampa Bay Buccaneers
Hopefully, it’s not too hard to remember a decade that ended with President Obama in the White House, but the Bucs come in lower here than I might have guessed. They made the playoffs five times, but still are only 14th in expected SB wins. They actually had a 71% chance of winning no titles in the decade. Even in their best year, 2002, where they ranked #2 in SRS and #1 in DVOA, they were far from dominant and so had only about a 21% chance of winning the title.

Bottom-Feeder Teams: Buffalo Bills, Detroit Lions
Neither team made the playoffs in the decade, a more impressive accomplishment than the ’70s Giants and Jets in an era of expanded playoffs. Both cities also suffered through deindustrialization and so seemed to deserve better football as a compensating differential.

Closing Thoughts

I was excited to check this out because I wanted to compare teams like the ’90s Bills and the ’70s Rams. That comparison makes it pretty clear that the ’70s Vikings are hands-down the clearest What-Might-Have-Been-Dynasty that Won Nothing. This is all post-merger, so arguably the best Vikings team of that era (the ’69 edition) doesn’t even count in the calculation. If you count the 1969 Vikings, there was only about a 1-in-6 chance that those Vikings would end up with no Super Bowls.

Maybe the most remarkable regularity over the years is how the Cardinals have been so bad for so long. Even though Arizona came close in 2008, the Cardinals had only an 11.2% chance of winning any of the last 44 Super Bowls. In fact, they were lucky just to make the one Super Bowl that they did (in more ways than one).

Finally, a couple of thoughts about this decade. While we’re only four years in, this decade could wind up resembling the 1990s. The Patriots right now are playing the role of the ’90s Niners, while the Seahawks may be the best candidate to be the Cowboys. So far, the Patriots have been (perhaps surprisingly) dominant. There’s only about a 27% chance that New England would have no titles in the 2010s and there was even a 28.5% chance that the Patriots would have already won multiple titles; that likelihood is more than four times more as any other team. Despite having none on the field through four seasons, the ’10s Patriots are on pace through four years to have the most expected SB wins for any decade. They already have 1.07 expected wins, more than double their nearest competitor.

{ 21 comments }

One Play Away

Football Perspective accepts guest posts, and Andrew Healy submitted the following post. And it’s outstanding. Andrew Healy is an economics professor at Loyola Marymount University. He is a big fan of the New England Patriots and Joe Benigno.


The Browns were one play away from the Super Bowl

How much did this player lower Cleveland's Super Bowl odds?

The Catch. The Immaculate Reception. The Fumble. We remember all these plays, but which mattered the most? More specifically, what plays in NFL history had the biggest impact on who won the Super Bowl?

The answer to this question is kind of surprising. For example, two of those famous plays are in the top 20, but the other wasn’t even the most important play in its own game. Going all the way back to Lombardi’s Packers, the memorable and important plays overlap imperfectly.

Here, I try to identify the twenty plays that shifted the probability of the eventual Super Bowl winner the most. According to this idea, a simple win probability graph at Pro-Football-Reference.com identifies a not-surprising choice as the most influential play in NFL History: Wide Right. What is surprising is that they give Buffalo a 99% chance of winning after Jim Kelly spiked the ball to set up Scott Norwood’s kick. Obviously, that’s way off. [1]I think it happens because their model basically gives you credit for your expected points on the drive, which is enough to win since Buffalo was down by a point.

A better estimate would say him missing the kick lowered the Bills chances of winning from about 45% to about 0%. Norwood was about 60% for his career from 40-49 yards out, and 2 for 10 from over 50. Moreover, he was 1 for 5 on grass from 40-49 before that kick. But the conditions in Tampa that night were close to ideal for kicking. It’s hard to put an exact number on things, but around 45% on that 47-yard kick seems about right.

So that 45 percentage point swing in a team’s chances of being the champ is what I’m going to call our SBD, or Super Bowl Delta, value. I’m going to identify the twenty plays with the biggest SBD values, the ones that swung the needle the most.

Here are the ground rules for making the cut. [continue reading…]

References

References
1 I think it happens because their model basically gives you credit for your expected points on the drive, which is enough to win since Buffalo was down by a point.
{ 20 comments }