≡ Menu

Last year, I wrote a post on the plays that had the biggest impact on the eventual Super Bowl champion. These were the plays that affected the Super Bowl win probability by the biggest amount among teams that did not win the title. At the time, the Buffalo Bills were on the short end of the most influential play in the Super Bowl era. When Frank Reich put the ball down for Scott Norwood, I estimated that the Bills had a 45% chance on winning the Super Bowl. [1]Recent research by Chase suggests something similar. After the kick went wide right, the Bills’ win probability fell to zero. The 45 percentage point fall was the biggest change for a non-champion of any play in the Super Bowl era. Over 48 years, a bunch of plays fell in that range, but no team could point to a single play as having lowered its championship chances by so large an amount.

A couple weeks ago, that long-held record got broken kind of like Michael Johnson broke the 200-meter record in the Atlanta Olympics. Malcolm Butler’s pick obliterated the old mark. My estimate has the Butler interception as increasing the Patriots’ chances of winning by 0.87. There is no doubt that what some have called the Immaculate Interception is on an island by itself as the most influential play in NFL history.

To get that change in win probability from Butler’s play, I am going to assume that the Seahawks would have run on third and fourth down. I am going to give a run from the one a 60% chance of working. That might seem high, but the Patriots were the worst team in football in stuffing the run in important short-yardage situations either on third or fourth down, or down by the goal line. And their limited success mostly came against terrible running teams. It is not a huge sample, but against teams outside the worst quarter of rushing teams by DVOA, the Patriots had allowed opponents to convert 16 of 17 times with two yards or less to go for a first down or touchdown. If we add the playoffs, they actually had three more stops against good running teams (Baltimore and Seattle), albeit in games where the opponent had a good amount of success on the ground. [2]Note that the stop against Baltimore should not even count. In an otherwise great game for Gary Kubiak, he called for a reverse to Michael Campanaro on third-and-1 in the second quarter. The run was … Continue reading With Seattle being the best rushing team in football by a mile and the Patriots being at best not great in run defense in that situation, it seems hard to think that Seattle had anything less than a 0.60 chance of scoring on a run.

Here are my other assumptions:

  • Give Seattle a 2% chance of throwing an interception on the slant. [3]You could argue this is too high. It’s not going to make a big difference, but I do think the chance of the pick on that route is higher with Russell Wilson height making it even a little more … Continue reading
  • Give Seattle a 0.5% chance of fumbling on a running play.
  • The slant had a 55% chance of scoring a touchdown.
  • The Patriots have a 5% chance of winning if the second down play scored the touchdown with a snap at 0:26, 3% if it was second down, and 1% if fourth down. [4]Really think these might be a little high, if anything.

Under those assumptions, the Seahawks’ win probability at the snap―taking the slant call as given―was 0.87. [5]There’s just one thing to add here. You would want to account for the possibility of a run losing yardage. To keep things not too complicated, I have not done that here. But my other assumptions … Continue reading

Prob (Score 2nd down)*Prob (Win if Score) + Prob (3rd down happens)*Prob (Score 3rd down)*Prob (Win if Score) + Prob (4th down happens)*Prob (Score 4th down)*Prob (Win if Score) =

0.55*0.95 + 0.43*0.60*0.97 + 0.17*0.60*0.99 = 0.874

One interesting thing to note is that Pete Carroll’s seemingly odd explanation about wasting a play is not quite that crazy. If the Seahawks had just thrown the ball away on second down to waste some time, but leave them the timeout to run twice, their win probability was 0.82. That fall is small in part because the Patriots’ chances of winning after a Seattle score get even lower if they score on a later down. It’s still not a great idea because Marshawn Lynch’s chances of scoring on third or fourth down are not 100%, but Carroll may have been thinking along these lines. [6]Chase note: It’s also crazy because the “not wasting a play” idea was self-inflicted.  Seattle chose to snap the ball with 26 seconds left, which makes me think that Carroll is … Continue reading

Two other plays from this postseason deserve special note. First, the Jermaine Kearse Manna-from-Heaven catch could have been a top five most-influential play in NFL history. Under my rules, it does not get on the list because a game can only have one play on the list and the team that it hurts has to not win the Super Bowl in the end. But if Marshawn Lynch ran it in and the Seahawks won, the Kearse catch would have been the play that hurt the Patriots more than any other. Brian Burke’s Win Probability Calculator assigns the Patriots a 62% chance of winning at the snap and a 25% chance of winning after the completion. So the calculator estimates that the Kearse catch lowered the Patriots’ chances by 37%, eerily similar to the 39% hit the Patriots took from the Helmet Catch.

While that play does not make the cut because the Immaculate Interception wiped it out, another play from this postseason almost did squeeze onto the expanded list. The onside kick recovery by Seattle in the NFC Championship game, according to my estimates, lowered the Packers’ chances of winning the Super Bowl by about 14 percentage points. Here are the ingredients for that calculation:

  • Give Green Bay a 0.8 chance of recovering the onside kick
  • Green Bay has a 0.95 chance of winning if they recover
  • Green Bay has a 0.55 chance of winning if they don’t recover [7]Burke’s calculator estimates this as 0.64. That seems too low to me, so I am adjusting that number a bit.
  • Green Bay would have had 0.45 chance of beating the Patriots in the Super Bowl.

So, before the onside kick, the Packers’ chances of winning the Super Bowl were:

[Prob(Recover onside kick)*Prob(Beat Seattle if recover) + Prob(Don’t Recover)*Prob(Beat Seattle if don’t)]*Prob(Beat New England) = (0.8*0.95 + 0.2*0.55) * 0.45 = 0.39

After the onside kick, the Packers’ chances of winning the Super Bowl were:

Prob(Beat Seattle after not recovering) * Prob (Beat New England) = 0.55*0.45 = 0.25

So the failure to recover the onside kick lowered the Packers’ chances of winning the Super Bowl by 14 percentage points, leaving the Brandon Bostick botched recovery just off the list.

Below is the updated and expanded-to-25-plays list of the most influential plays in NFL history. The full set of ground rules can be found in last year’s post. The SBD, or Super Bowl Delta, value refers to the change in the probability of winning the Super Bowl for the team on the short end of the play. Since Norwood’s miss lowered the Bills’ chances of winning the Super Bowl by 45 percentage points, I assign an SBD value of 45 to that play.

RkNFL YearGamePlayTime at snapLosing teamGame WP ChangeSBD value
12014Super BowlImmaculate Interception00:26Seahawks0.8787
21990Super BowlWide Right00:08Bills0.4545
32008Super BowlHolmes 40 yards to Arizona 601:02Cardinals0.4242
42007Super BowlHelmet Catch00:45Patriots0.3939
51982Super BowlHere Comes the Diesel10:28Dolphins0.3636
62012Super Bowl4th down incomplete to Crabtree01:5049ers0.3535
71988Super Bowl27 yards to Rice01:15Bengals0.3434
81979Super BowlFirst pass to Stallworth12:15Rams0.3131
92013NFC ChampionshipSherman tip-to-INT vs. Crabtree00:3049ers0.528
101970Super BowlMike Curtis INT of Morton01:09Cowboys0.2727
111967NFL ChampionshipStarr QB sneak00:16Cowboys0.3525
121993Super BowlJames Washington fumble return14:34 in 3rdBills0.2424
131972Divisional RoundImmaculate Reception00:22Raiders0.9524
142011Super BowlWes Welker drop04:00Patriots0.2323
152011AFC ChampionshipLee Evans drop00:28Ravens0.4523
161990NFC ChampionshipRoger Craig fumble2:4049ers0.4523
171987AFC ChampionshipThe Fumble01:12Browns0.422
181999Super BowlWarner to Bruce for 73-yard TD02:05Titans0.2121
191981NFC ChampionshipDanny White fumble after The Catch00:38Cowboys0.4221
201975Super BowlWagner INT of Staubach08:41Cowboys0.2121
211975Divisional RoundHail Mary00:32Vikings0.8520
222001Super BowlBrady to Brown for 23 yards00:29Rams0.220
231978Super BowlThe Sickest Man in America2:46 in 3rdCowboys0.1717
242010Super BowlMatthews forces Mendenhall fumble15:00Steelers0.1717
252012AFC DivisionalFlacco-to-Jones over a sleeping Rahim Moore02:13Broncos0.1717

On this updated list, Butler’s pick looks like Tiger Woods’s -12 on top of the scoreboard at the 2000 U.S. Open. The Immaculate Interception stands alone, almost twice as influential as any other play in the Super Bowl era.

References

References
1 Recent research by Chase suggests something similar.
2 Note that the stop against Baltimore should not even count. In an otherwise great game for Gary Kubiak, he called for a reverse to Michael Campanaro on third-and-1 in the second quarter. The run was stopped for a loss. The Patriots basically could not stop Justin Forsett, making the reverse call very unnecessary.
3 You could argue this is too high. It’s not going to make a big difference, but I do think the chance of the pick on that route is higher with Russell Wilson height making it even a little more likely that the throw gets deflected on the line. I would not have run the fade either, with its low success rate. I would have faked a handoff to Lynch and rolled Wilson right with a run-pass option. Of course, I would have run three times, snapping a little earlier if need be.
4 Really think these might be a little high, if anything.
5 There’s just one thing to add here. You would want to account for the possibility of a run losing yardage. To keep things not too complicated, I have not done that here. But my other assumptions are charitable to the Patriots’ chances, so hopefully this just balances out.
6 Chase note: It’s also crazy because the “not wasting a play” idea was self-inflicted.  Seattle chose to snap the ball with 26 seconds left, which makes me think that Carroll is just coming up with a narrative, rather than being forthright.  If Seattle wanted to run three times, they could have snapped the ball with 30 or 35 or 40 seconds remaining; knowing that the team wanted to pass on 2nd down, it made sense to milk the clock down inside of 30 seconds.
7 Burke’s calculator estimates this as 0.64. That seems too low to me, so I am adjusting that number a bit.
{ 31 comments }