*Even for Football Perspective, this is a very math-heavy post. I’ve explained all the dirty work and fine details behind this system, but if you want to skip to the results section, I’ll understand. Heck, it might even make more sense to start there and then work your way back to the top.*

**Background**

In 2012, Neil Paine wrote a fascinating article on championship leverage in the NBA, building on Tom Tango’s work on the same topic in Major League Baseball. Championship Leverage was borne out of the desire to quantify the relative importance of any particular playoff game. Truth be told, this philosophy has more practical application in sports where each playoff round consists of a series of games. But Neil applied this system to the NFL playoffs and crunched all the data for every playoff game since 1965. Then he was kind enough to send it my way, and I thought this data would make for a good post.

The best way to explain Championship Leverage is through an example. For purposes of this exercise, we assume that every game is a 50/50 proposition. At the start of the playoffs, the four teams playing on Wild Card weekend all have a 1-in-16 chance of winning the Super Bowl (assuming a 50% chance of winning each of four games). This means after the regular season ended, the Colts had a 6.25% chance of winning the Super Bowl. After beating Kansas City, Indianapolis’ win probability doubled to 12.5%. Win or lose, the Colts’ Super Bowl probability was going to move by 6.25%, a number known as the Expected Delta.

New England, by virtue of a first round bye, began the playoffs with a 12.5% chance of winning the Lombardi. With a win over Indianapolis, the Patriots’ probability of winning the Super Bowl jumped 12.5% to 25%; had New England lost, the odds would have moved from 12.5% to zero. Therefore, the Expected Delta in a Division round game is 12.5%.

By beating Indianapolis, New England set up a crucial showdown with Denver. A win would again double the Patriots’ Super Bowl odds, this time from 25% to 50%, while a loss would drop it to zero. In the conference championship round, the Expected Delta is always 25%.

Denver also started the playoffs with a 12.5% chance of winning the Super Bowl, since the Broncos don’t get any extra credit for rostering Peyton Manning. Those odds jumped to 25% after beating San Diego and up to 50% after beating the Patriots. The Super Bowl, of course, has an Expected Delta of 50%. After the game, Denver’s odds of being Super Bowl champs will have moved 50% to either 100% or 0%.

There are 11 games (or 22 if you look at each game as one game for each team) in every NFL postseason, at least since 1990. The final game has an Expected Delta of 50%; the previous two each have an Expected Delta of 25%; the four before that each have an Expected Delta of 12.5%; and the first four each have an Expected Delta of 6.25%. This means, on average, each playoff game in the NFL has an average Expected Delta of 15.91%.

This means that the Super Bowl — with an Expected Delta of .50 — is 3.14 times as “important” as the average playoff game. That importance is what we call the Leverage Index, and at least since 1990, each Super Bowl has had a Leverage Index of 3.14. Peyton Manning’s performance against Seattle comes with a Leverage four times as great as Manning’s game against San Diego, because the stakes are four times as high. I’m reticent to ever type the word clutch, but using this method, we can at least quantify the stakes for each game.

**Calculating a Quarterback’s Leverage-Adjusted Postseason Value**

We can use this metric to grade each individual postseason by a quarterback after accounting for Leverage. For each game in the Super Bowl era, Neil calculated the Adjusted Net Yards per Attempt average allowed by each defense during the regular season, and then gave each quarterback credit (or blame) for his ANY/A average relative to that particular defense.** By using this method, we have both an era and SOS adjustment all in one. Then, each quarterback’s production is adjusted for leverage.** Let’s work through an example.

The following week, Warner went 21/32-220-2-1 (1-5) against the Panthers. Carolina allowed 5.43 ANY/A during the regular season, and Warner averaged 6.36 ANY/A in this game, giving him 0.93 ANY/A over expectation. The leverage was 0.79.

In the conference championship game, Warner faced an Eagles defense that allowed only 4.57 ANY/A during the regular season, but he went 21/28-279-4-0 (2-12); that works out to an 11.57 ANY/A average, giving him an incredible 7.00 ANY/A better than average in a game with a leverage of 1.57.

Then, in the Super Bowl, Warner was again outstanding. The Steelers defense allowed only 3.17 ANY/A to opposing quarterbacks during the regular season but Warner (31-43-377-3 (2-3), an 8.64 ANY/A average) was 5.47 ANY/A better than that against Pittsburgh. The Super Bowl, of course, has a leverage of 3.14.

All told, Warner had 140 attempts (including sacks). On average, each pass attempt came in a game with a Leverage of 1.62 (Warner’s four games, by definition, had Leverages of 0.39, 0.79, 1.57, and 3.14; that would give him a simple average of 1.47, but since he threw 12 more passes in the Super Bowl than in any other game, his weighted average leverage is a bit higher.) If you multiply his attempts by his ANY/A over expectation by the leverage for each of the four games, and then divided that total by 1.62 (the average leverage for each attempt), you get 714, the amount of (leverage-adjusted) adjusted net yards over expectation Warner produced. That’s the most by any quarterback in a single post-season.

Here’s another way to think about it. Based on the defenses Warner faced, he would have been expected to produce a weighted average ANY/A (weighted for both SOS and Leverage) of 3.87; in reality, he produced a weighted ANY/A (again, weighted for Leverage) of 8.97. Therefore, Warner exceeded expectations by 5.10 ANY/A. Since he had 140 dropbacks, that gives him 714 adjusted net yards of value over average. The table below shows the top 100 postseasons by a quarterback (looking at only passing numbers) using this method:

**The Best Single-Postseason Passing Performances From 1965 to 2012**

Rk | Quarterback | Tm | Yr | G | Att | Lev | Exp ANY/A | Act ANY/A | ANY/A OvEx | Value |
---|---|---|---|---|---|---|---|---|---|---|

1 | Kurt Warner | ARI | 2008 | 4 | 140 | 1.62 | 3.87 | 8.97 | 5.1 | 714 |

2 | Jim Plunkett | OAK | 1980 | 4 | 104 | 1.2 | 4.06 | 10.59 | 6.54 | 680 |

3 | Joe Montana | SFO | 1989 | 3 | 85 | 1.68 | 4.42 | 12.18 | 7.76 | 658 |

4 | Jake Delhomme | CAR | 2003 | 4 | 110 | 1.57 | 3.73 | 9.34 | 5.61 | 616 |

5 | Daryle Lamonica | OAK | 1968 | 2 | 89 | 0.85 | 2.81 | 9.14 | 6.33 | 564 |

6 | Joe Montana | SFO | 1988 | 3 | 96 | 1.75 | 4.03 | 9.78 | 5.75 | 552 |

7 | Joe Flacco | BAL | 2012 | 4 | 132 | 1.57 | 5.37 | 9.37 | 4 | 528 |

8 | Troy Aikman | DAL | 1992 | 3 | 96 | 1.86 | 4.64 | 10.13 | 5.49 | 527 |

9 | Terry Bradshaw | PIT | 1978 | 3 | 82 | 1.71 | 3.37 | 9.22 | 5.85 | 479 |

10 | Doug Williams | WAS | 1987 | 3 | 87 | 1.64 | 4.08 | 9.35 | 5.27 | 458 |

11 | Aaron Rodgers | GNB | 2010 | 4 | 140 | 1.59 | 4.6 | 7.81 | 3.21 | 449 |

12 | Steve Young | SFO | 1994 | 3 | 91 | 2.05 | 4.92 | 9.62 | 4.7 | 426 |

13 | Joe Montana | SFO | 1984 | 3 | 116 | 1.56 | 4.29 | 7.9 | 3.6 | 418 |

14 | Peyton Manning | IND | 2009 | 3 | 132 | 1.83 | 4.42 | 7.47 | 3.04 | 402 |

15 | Terry Bradshaw | PIT | 1979 | 3 | 86 | 1.47 | 3.65 | 8.24 | 4.59 | 394 |

16 | Jim Kelly | BUF | 1990 | 3 | 83 | 1.88 | 4.13 | 8.86 | 4.74 | 393 |

17 | Jim McMahon | CHI | 1985 | 3 | 72 | 1.62 | 3.79 | 9.29 | 5.5 | 393 |

18 | Phil Simms | NYG | 1986 | 3 | 61 | 1.75 | 4.7 | 11.06 | 6.36 | 388 |

19 | Kurt Warner | STL | 1999 | 3 | 124 | 1.93 | 5.11 | 8.21 | 3.1 | 384 |

20 | Ken Stabler | OAK | 1976 | 3 | 75 | 1.21 | 2.57 | 7.43 | 4.86 | 364 |

21 | Bart Starr | GNB | 1966 | 2 | 59 | 1.08 | 3.22 | 9.35 | 6.13 | 361 |

22 | Mark Rypien | WAS | 1991 | 3 | 79 | 1.94 | 4.85 | 9.28 | 4.42 | 350 |

23 | Jeff George | MIN | 1999 | 2 | 82 | 0.65 | 4.1 | 8.13 | 4.02 | 330 |

24 | Jeff Hostetler | RAI | 1993 | 2 | 43 | 0.59 | 5.01 | 12.63 | 7.62 | 328 |

25 | John Elway | DEN | 1998 | 3 | 90 | 1.87 | 4.71 | 8.34 | 3.63 | 327 |

26 | Troy Aikman | DAL | 1995 | 3 | 84 | 1.81 | 4.91 | 8.66 | 3.75 | 315 |

27 | Bernie Kosar | CLE | 1987 | 2 | 74 | 1.09 | 3.87 | 8.09 | 4.22 | 312 |

28 | Terry Bradshaw | PIT | 1975 | 3 | 62 | 1.41 | 2.48 | 7.37 | 4.89 | 303 |

29 | Drew Brees | NOR | 2009 | 3 | 104 | 1.93 | 5.25 | 8.16 | 2.91 | 303 |

30 | Drew Brees | NOR | 2011 | 2 | 112 | 0.62 | 5.02 | 7.69 | 2.67 | 299 |

31 | Matt Ryan | ATL | 2012 | 2 | 78 | 1.22 | 4.79 | 8.61 | 3.82 | 298 |

32 | Joe Namath | NYJ | 1968 | 2 | 81 | 1.49 | 2.33 | 5.97 | 3.64 | 295 |

33 | Bart Starr | GNB | 1967 | 3 | 84 | 1.19 | 2.71 | 6.12 | 3.41 | 286 |

34 | Colin Kaepernick | SFO | 2012 | 3 | 85 | 1.85 | 5.57 | 8.92 | 3.34 | 284 |

35 | Dan Marino | MIA | 1984 | 3 | 120 | 1.81 | 4.09 | 6.43 | 2.34 | 281 |

36 | Warren Moon | HOU | 1991 | 2 | 80 | 0.57 | 4.38 | 7.82 | 3.44 | 275 |

37 | Roger Staubach | DAL | 1975 | 3 | 91 | 1.35 | 1.92 | 4.87 | 2.95 | 269 |

38 | Kurt Warner | ARI | 2009 | 2 | 61 | 0.57 | 4.56 | 8.85 | 4.29 | 262 |

39 | Ken Stabler | OAK | 1977 | 2 | 78 | 0.85 | 2.73 | 6.07 | 3.34 | 261 |

40 | Randall Cunningham | MIN | 1997 | 2 | 79 | 0.6 | 3.67 | 6.95 | 3.28 | 259 |

41 | Brett Favre | GNB | 1996 | 3 | 78 | 2.05 | 4.67 | 7.99 | 3.31 | 258 |

42 | Mark Sanchez | NYJ | 2010 | 3 | 92 | 0.95 | 4.83 | 7.58 | 2.75 | 253 |

43 | Tom Brady | NWE | 2004 | 3 | 88 | 1.93 | 4.74 | 7.61 | 2.87 | 252 |

44 | Brett Favre | GNB | 1995 | 3 | 108 | 0.97 | 4.9 | 7.21 | 2.31 | 250 |

45 | Tom Brady | NWE | 2003 | 3 | 126 | 1.91 | 4.93 | 6.91 | 1.98 | 250 |

46 | Len Dawson | KAN | 1969 | 3 | 67 | 1.26 | 1.98 | 5.7 | 3.73 | 250 |

47 | Dan Fouts | SDG | 1980 | 2 | 86 | 1.07 | 3.48 | 6.34 | 2.85 | 245 |

48 | Ken Anderson | CIN | 1981 | 3 | 86 | 1.81 | 4.15 | 6.79 | 2.63 | 226 |

49 | Joe Theismann | WAS | 1982 | 4 | 95 | 1.83 | 2.54 | 4.92 | 2.38 | 226 |

50 | Brett Favre | GNB | 1997 | 3 | 103 | 1.98 | 4.2 | 6.38 | 2.18 | 225 |

51 | John Brodie | SFO | 1970 | 2 | 75 | 0.91 | 1.89 | 4.83 | 2.94 | 221 |

52 | Eli Manning | NYG | 2007 | 4 | 128 | 1.64 | 4.8 | 6.53 | 1.72 | 220 |

53 | Erik Kramer | DET | 1991 | 2 | 76 | 1.17 | 4.2 | 7.04 | 2.84 | 216 |

54 | Dan Marino | MIA | 1994 | 2 | 69 | 0.61 | 5.47 | 8.53 | 3.06 | 211 |

55 | Daryle Lamonica | OAK | 1967 | 2 | 62 | 1.6 | 1.71 | 5.09 | 3.39 | 210 |

56 | Kelly Holcomb | CLE | 2002 | 1 | 45 | 0.39 | 4.79 | 9.42 | 4.63 | 208 |

57 | Joe Montana | SFO | 1981 | 3 | 95 | 1.47 | 4.43 | 6.62 | 2.19 | 208 |

58 | Ken Stabler | OAK | 1974 | 2 | 70 | 0.9 | 2.4 | 5.36 | 2.96 | 207 |

59 | Aaron Rodgers | GNB | 2009 | 1 | 47 | 0.39 | 5.08 | 9.34 | 4.26 | 200 |

60 | Drew Brees | NOR | 2006 | 2 | 87 | 1.26 | 4.02 | 6.29 | 2.27 | 198 |

61 | Joe Montana | SFO | 1990 | 2 | 62 | 1.15 | 4.06 | 7.19 | 3.13 | 193 |

62 | Philip Rivers | SDG | 2008 | 2 | 79 | 0.59 | 3.72 | 6.14 | 2.42 | 191 |

63 | Tom Brady | NWE | 2005 | 2 | 67 | 0.6 | 4.87 | 7.68 | 2.81 | 188 |

64 | Troy Aikman | DAL | 1993 | 3 | 89 | 1.72 | 4.62 | 6.72 | 2.1 | 188 |

65 | Roger Staubach | DAL | 1977 | 3 | 69 | 1.54 | 3.1 | 5.8 | 2.71 | 188 |

66 | Peyton Manning | IND | 2006 | 4 | 159 | 1.51 | 4.09 | 5.26 | 1.17 | 186 |

67 | Fran Tarkenton | MIN | 1973 | 3 | 84 | 1.38 | 2.08 | 4.29 | 2.21 | 185 |

68 | Terry Bradshaw | PIT | 1974 | 3 | 52 | 1.31 | 3.15 | 6.66 | 3.51 | 183 |

69 | Ken Stabler | OAK | 1975 | 2 | 68 | 0.96 | 1.93 | 4.61 | 2.68 | 182 |

70 | Russell Wilson | SEA | 2012 | 2 | 69 | 0.61 | 5.81 | 8.43 | 2.62 | 181 |

71 | Danny White | DAL | 1982 | 3 | 102 | 0.85 | 4.06 | 5.78 | 1.72 | 176 |

72 | Doug Flutie | BUF | 1998 | 1 | 39 | 0.39 | 3.57 | 8.05 | 4.48 | 175 |

73 | Ken Stabler | OAK | 1973 | 2 | 42 | 0.9 | 1.03 | 5.18 | 4.16 | 175 |

74 | Peyton Manning | IND | 2007 | 1 | 48 | 0.79 | 4.12 | 7.75 | 3.63 | 174 |

75 | Jim Kelly | BUF | 1989 | 1 | 55 | 0.69 | 4.01 | 7.16 | 3.15 | 173 |

76 | Neil O'Donnell | PIT | 1994 | 2 | 77 | 1.34 | 5.11 | 7.36 | 2.25 | 173 |

77 | Joe Montana | SFO | 1983 | 2 | 81 | 1.1 | 4.77 | 6.88 | 2.11 | 171 |

78 | Mark Malone | PIT | 1984 | 2 | 66 | 1.07 | 4.38 | 6.92 | 2.54 | 167 |

79 | Peyton Manning | IND | 2004 | 2 | 77 | 0.61 | 5.01 | 7.16 | 2.15 | 166 |

80 | Lynn Dickey | GNB | 1982 | 2 | 63 | 0.77 | 4.42 | 7.05 | 2.63 | 166 |

81 | Scott Brunner | NYG | 1981 | 2 | 54 | 0.6 | 3.49 | 6.55 | 3.05 | 165 |

82 | Bill Nelsen | CLE | 1969 | 2 | 63 | 0.91 | 1.82 | 4.44 | 2.62 | 165 |

83 | Joe Ferguson | BUF | 1974 | 1 | 26 | 0.58 | 1.59 | 7.85 | 6.26 | 163 |

84 | Ken Anderson | CIN | 1975 | 1 | 32 | 0.58 | 1.21 | 6.28 | 5.07 | 162 |

85 | Jeff Hostetler | NYG | 1990 | 3 | 84 | 2.02 | 4.54 | 6.45 | 1.9 | 160 |

86 | Matt Hasselbeck | SEA | 2010 | 2 | 84 | 0.62 | 4.98 | 6.86 | 1.87 | 157 |

87 | Rich Gannon | OAK | 2001 | 2 | 62 | 0.6 | 4.64 | 7.16 | 2.52 | 156 |

88 | Mark Sanchez | NYJ | 2009 | 3 | 69 | 1.04 | 5.11 | 7.36 | 2.25 | 155 |

89 | Kurt Warner | STL | 2001 | 3 | 113 | 2 | 4.62 | 5.99 | 1.37 | 155 |

90 | Ron Jaworski | PHI | 1979 | 2 | 67 | 0.56 | 3.54 | 5.82 | 2.29 | 153 |

91 | Brad Johnson | TAM | 2002 | 3 | 99 | 1.86 | 4.84 | 6.37 | 1.53 | 151 |

92 | Eli Manning | NYG | 2011 | 4 | 174 | 1.58 | 5.77 | 6.64 | 0.87 | 151 |

93 | Rodney Peete | PHI | 1995 | 2 | 32 | 0.46 | 5.03 | 9.77 | 4.74 | 151 |

94 | Johnny Unitas | BAL | 1970 | 3 | 61 | 1.16 | 3.79 | 6.24 | 2.45 | 149 |

95 | Dan Marino | MIA | 1990 | 2 | 81 | 0.63 | 4.67 | 6.45 | 1.78 | 144 |

96 | Steve Young | SFO | 1992 | 2 | 70 | 1.21 | 4.17 | 6.21 | 2.05 | 143 |

97 | Don Meredith | DAL | 1966 | 1 | 33 | 0.75 | 1.92 | 6.24 | 4.32 | 143 |

98 | Donovan McNabb | PHI | 2002 | 2 | 83 | 1.27 | 2.92 | 4.63 | 1.72 | 142 |

99 | Roger Staubach | DAL | 1978 | 3 | 80 | 1.84 | 2.84 | 4.6 | 1.76 | 142 |

100 | John Elway | DEN | 1986 | 3 | 114 | 1.68 | 4.52 | 5.75 | 1.23 | 140 |

Seeing Warner’s 2008 as the top postseason performance isn’t too surprising. What about Jim Plunkett’s 1980 season? Over four games, he had a 96.2 passer rating and averaged 9.1 yards per attempt while throwing for 7 touchdowns. Remember, this was 1980, not 2013: that year, Brian Sipe won the passer rating crown with a 91.4 rating. More importantly, Plunkett gets extra credit for being at his best in the biggest games. In the AFC Championship Game, he was 14/18 for 261 yards and 2 touchdowns. In the Super Bowl, he threw for 261 yards and 3 touchdowns on 21 passes. If the goal is to reward quarterbacks for being at their best in the most critical games, then Plunkett’s position at number two is legitimate.

Joe Montana’s magical 1989 is number three, and the only reason he’s behind Plunkett is because he had fewer attempts. **Montana’s leverage-adjusted 7.76 ANY/A over expectation is the best performance in a postseason since 1965.** Jake Delhomme’s presence at #4 might be surprising, but that’s a function of his production in a high-leverage situation against a great opponent. Forget the name, and consider that a quarterback ten years ago faced the #1 pass defense in the league (by ANY/A) and threw for 323 yards and 3 touchdowns with no interceptions on 33 pass attempts in the Super Bowl. Had Carolina won that game (and, perhaps, had Delhomme not subsequently imploded five years later), we might remember his 2003 playoffs the way we think of Joe Flacco’s 2012 postseason.

**Working Through Another Example**

Speaking of Flacco, I was a bit surprised he wasn’t in the top 3, but that’s essentially a function of the built-in era adjustment. Let’s go through this method using Flacco’s 2012 season, but using another method to get to the same result.

Flacco’s first game was against the Colts, who allowed 6.54 ANY/A during the regular season. If we multiply that number by the leverage (0.39) and his number of dropbacks (24), we get 61.66. In Denver, Flacco faced a team that allowed 4.87 ANY/A during the regular season. Multiply that number by the leverage (0.79) and dropbacks (35), and you get 133.85. In the AFC Championship Game, Flacco had 38 dropbacks against a team that allowed 6.31 ANY/A during the regular season; multiply those two numbers by the leverage (1.57) and you get 376.83. Finally, he faced the 49ers in the Super Bowl, and San Francisco allowed 4.88 ANY/A during the regular season. Flacco had 35 dropbacks in a game with massive leverage (3.14); the product of those three numbers is 536.91.If you add up those four numbers – 61.66, 133.85, 376.83, and 536.91 — you get 1,109.26. Next, we divide that number by Flacco’s total number of dropbacks (132) to get 8.40. The last step is to divide *that* number by the average leverage of each pass Flacco attempted. Do the math, and that number is 1.57. Once you divide 8.40 by 1.57, you get the Expected (leverage-adjusted) ANY/A for Flacco during the post-season, which is 5.37. That’s a really high number, at least historically speaking, which simply reflects the fact that putting up good passing numbers was a lot easier in 2012 than it was in 1972. Flacco is essentially getting dinged for an era adjustment, but that’s appropriate.

How did Flacco actually do? He had an ANY/A of 12.88 against Indianapolis, 10.97 against Denver, 7.76 in New England, and 9.54 in the Super Bowl. Adjust for his number of attempts and leverage, and Flacco produced a leverage-adjusted ANY/A of 9.37. That’s also a hair lower than his non-leverage adjusted ANY/A of 10.02, which makes sense: his best game was against Indianapolis, the lowest-stakes game in which he played. Flacco was still great, but the leverage and the era combine to put him at “only” 4.00 ANY/A better than expectation.

You might be surprised that Tom Brady doesn’t fare all that well in this metric. In fact, he only has three top-100 seasons, and none in the top 40. Well, Brady’s never had one dominant postseason. His best year was in 2004, but even then, his numbers there look merely “very good” as opposed to historically great. Is his playoff reputation overrated? Perhaps. In Part II, I’ll show you the career playoff ratings.

I won’t pretend that the math involved isn’t overly complicated. But hey, Neil and I already did all the work for you. So what do you think of the list?

{ 19 comments… read them below or add one }

This makes perfect sense to me! I’m glad you weighted everything according to the number of attempts as it’s much more representative that way! After all, Warner’s 45 dropbacks in the Super Bowl count a lot more than those 32 drop backs in the Wild Card round.

I’m also tickled to see that among these top 100 the two lowest ANY/A over expected postseasons are two Manning Super Bowls, but perhaps not the two you’d expect!

Just some cursory observations. Only 17 of the top 100 are from the “dead ball” 1970′s. Not sure if this is disproportinate or not.

Of those 17, 12 are from Bradshaw (4), Staubach (3), and Stabler (5!). For the ’70′s, Tarkenton only once and no Bob Griese.

Was surprised not to see Chris Chandler for the 1998 season and Atlanta’s super bowl run. My impression was he had quite th hot streak to carry Atlanta that year. Guess I should check those box scores for the playoffs of that year.

Overall, an interesting metric that weights relative performance to game importance to generate the list.

Just some cursory observations. Only 17 of the top 100 are from the “dead ball” 1970′s. Not sure if this is disproportinate or not.I think there are 2 reasons.

1) From 1970-1979, there were only 74 playoff games played (an average of 7.4/season). But the playoffs expanded in the 70′s and 1990. So the decades of the 90′s had 110 playoff games (11 per season). The 80′s had 96 playoff games (9.6/season). So – there were just fewer QB’s playing postseason games in the 70′s.

2) The increase in games also increased the leverage of the later round games. So Bradshaw was at a handicap winning the Super Bowl in 1974, when there were zero wildcard games. (Again – this is pending a check on my math/understanding in another comment.)

Chase, in the formula you posted above (4x.0625 + 2x.0125, etc…), why am I getting .1182 instead of .1591?

It seems you may have used .0125 instead of .125?

Yes, that was my error. Thanks.

When the playoffs expanded in 1990, that increased the Super Bowl leverage index from 3.83 to 4.23. (Based on my math, which may be wrong.) Why should Joe Montana get less “credit” for winning the Super Bowl in 1989 than Jeff Hostetler got in 1990? (Regardless of my math, adding 2 games to the wild card round in 1990 should decrease the average delta, thereby increasing the leverage for any game with a delta above .0625.)

That’a sort of the big question with a system like this… The reason we diminish the Super Bowl in the wild card era is because we want to maintain that relationship where the average leverage of a playoff game ALWAYS equals exactly 1.00. This is useful for a number of reasons, not least because it means the sum of leverages will always equal the number of playoff games played across the league. However, I can also appreciate the argument that the leverage of a Super Bowl should be constant across seasons, regardless of whether there was a wild-card game or not. Ideally, my way would work in concert with a regular-season leverage that quantifies the swings of every game in the entire season, playoffs or otherwise. Then it would be entirely self-contained, and more appropriate to set the average game to 1.00.

The evolution of Wild Card games certainly puts a strange twist on leverage. From the above example, both Montana and Hostetler had first round byes, giving them seemingly the same odds of winning the Super Bowl, which they both did in 3 games. Yet, because of the format at the time, Hostetler gets some extra leverage. If there were 2 fewer Wild Card games in 1990, Hostetler’s leverage would have dropped from 2.02 to 1.90, and if there were 2 more Wild Card games in 1989, Montana leverage would have jumped from 1.68 to 1.78.

Given that they both came into the playoffs with the same path to a championship, does it make sense to alter their rating based on a round they didn’t play in?

This “formula” is crap. Plain and simple.

Jim Plunkett’s 1980 playoff performance @ #2 all-time, while Aaron Rodgers’ 2010 playoff performance is @ #10 all-time? Really?

Yes, because completing 41% of your passes with 2 TD passes and 3 INT across the first two rounds of the playoffs screams “all-time great performances!” Plunkett had next to nothing to do with the Raider wins in the first two rounds. Oakland’s defense intercepted Kenny Stabler and Brian Sipe a combined 5 times, and held Earl Campbell to 91 yards on 27 carries (3.37 ypc). Not bad, considering Campbell ran for an NFL leading 1,934 yards in 1980, and averaged 5.2 ypc. Not only did Plunkett barely contribute in the first two rounds, he gave Cleveland a 7-0 lead by throwing a pick 6. The defense bailed his ass out. Now, I give him somewhat of a pass, because the game at Cleveland was 2 degrees at game time (and 20 below zero wind chill), but Rodgers had to face similar conditions at Chicago, and he played a much tougher defense than Plunkett did.

Plunket was 8-23 for 168 yards, 2 TD passes and an INT in the first round. That’s a 34.78% completion rate. Basically, he completed one of every three passes he threw. Round 2? 14-30 for 149 yards, 0 TD passes and 2 INT. By today’s QB rating metric, through 2 playoff rounds, his passer rating was 50.9. Now he did better in the third round, going 14-18 for 261 yards, 2 TD passes and 0 INT. But that was against the Charger defense that was 18th in points allowed (18th out of 28 teams then). Finally, in the Super Bowl, he faced the #1 scoring defense, and was 13-21 for 261 yards, 3 TD and 0 INT. So, he certainly improved the last two games. But two crap performances, and two really good performances do not average out to the second best postseason performance in NFL history!

Rodgers was 18-27 for 180 yards and 3 TD passes against the Eagles in the first postseason game of the 2010 season. His second game, he was nearly perfect, going 31-36 for 366 yards and 3 TD against the Falcons. The Eagles may have been 21st in the NFL in points allowed, but Rodgers did this against a Falcon defense that was 5th in points allowed, and he did it to them at Atlanta, where the Falcons were considered virtually unbeatable. Now, Rodgers’ only bad game of the playoffs came against Chicago. He was 17-30 for 244 yards. He threw 0 TD passes and 2 INT. Can you blame him though? The game was at Soldier Field. It was 20 degrees with a 14 mph. The wind chill was 7. As with the first TWO games the Raiders won, the defense was responsible for winning this game for the Packers. And the Super Bowl? Rodgers, like Plunkett, faced the #1 scoring defense in the NFL in Pittsburgh. Rodgers was 24 for 39 for 304 yards and 3 TD. Like Plunkett, he won the Super Bowl MVP. Unlike Plunkett’s receivers, Rodgers’ receivers dropped no fewer than seven passes. Rodgers lost Packer all-time leading receiver Donald Driver in the first half, and was forced to go with Greg Jennings (who was granted, a Pro Bowl receiver), and an untested Jordy Nelson. I distinctly recall Nelson dropping three passes himself. But he and Rodgers made up for it.

Plunkett had a home game in round one. Rodgers was on the road for all three playoff games leading up to the Super Bowl.

What teams did each QB face? Record (and NFL defensive points allowed ranking):

Plunkett: 11-5 Houston (2nd), 11-5 Cleveland (12th), 11-5 San Diego (18th), and 12-4 Philadelphia (1st). Combined records: 45-19. Average pts allowed rank: 8.25/28

Rodgers: 10-6 Philadelphia (21st), 13-3 Atlanta (5th), 11-5 Chicago (4th), and 12-4 Pittsburgh (1st). Combined records: 46-18. Average pts allowed rank: 7.75/32.

Who had the harder road to the Super Bowl victory? Aaron Rodgers, who played three road games, and faced the 1st, 4th, 5th and 21st ranked defenses (out of 32), or Plunkett who had a home game, and faced the 1st, 2nd, 12th and 18th ranked defenses (out of 28)? Plunkett faced the top two scoring defenses in the NFL. Rodgers faced three of the top 5. Rodgers faced more tough defenses on his way to hoisting the Lombardi.

Pure numbers? Plunkett was 49 of 92 (53.26%) for 839 yards (9.12 ypa), 7 TD passes vs 3 INT. QB rating 96.2

Pure numbers? Rodgers was 90 for 132 (68.18%) for 1,094 yards (8.39 ypa), 9 TD passes vs 2 INT. QB rating of 109.8.

Plunkett beats Rodgers in one area, yards per attempt. Rodgers completed 15% more of his passes, threw for 2 more touchdowns and one fewer interception. Plunkett ran in a touchdown against the Chargers in the AFC Championship Game. Aaron Rodgers ran in a touchdown in the divisional game against Atlanta, AND a touchdown against the Bears in Chicago. So while Plunkett accounted for 8 touchdowns, Rodgers counted for 11.

In summary, Rodgers performed better than Plunkett. He was forced to win three games on the road, while Plunkett had a home game and two road games. Statistically he was better against better on-average defensive opponents.

There is no way Plunkett deserves to be second on this list, and Rodgers 10th.

And before anybody jumps my ass for “not realizing this measures drop backs compared to net yards”, I do realize it, and it’s a stupid metric. Tell me, if a team has a lead late in the game, and is passing the ball at all, are they more likely to throw it short, or long? They’re going to throw short, high percentage plays. This will drive their average yards per attempt down, but the name of the game in the postseason is winning, and if shorter passes nets more first downs, who cares how many yards each pass is netting?

There is no metric…none, that passes the sniff test, that will convince me, or any other sports enthusiast with a brain, that Jim Plunkett outplayed Aaron Rodgers when compared side by side.

To Richie – thanks for the overview on my previous comment. There were wildcard games in the NFL system starting in 1970 (but only one entry per conference) and in the AFL during the SB era but prior to the merger. I was also figuring that there were fewer playoff games and thus, my own qualifier that the fewer 70′s representatives on the list may be due to disproprotionate playoff game opportunties. Thanks again for your review of my statement. I might add that I don’t consider the 70′s a “dead ball” era in actuality. But from 1970 through 1976 there was a major decline in passing numbers that started to turn with the changes in passing game rules starting in 1977.

I think it’s nice.

However I think you should be careful equating good performance in high leverage situation to being clutch. I admit clutchness is a somewhat subjective thing, but I think when people talk about the clutch they see a performance relative to the amount of “pressure” the player in question was under. This doesn’t always result in a zero-sum game.

Example: AFC Championship a week ago. It seemed to me that Brady was on somewhat of a freeroll: If he won, great, but if he lost no biggie – how could he beat a juggernaut like the Broncos with that many injuries and those recievers? Manning however was under maximum pressure – he HAD to win or else he’d be labelled the ultimate playoff choker seriously hurting his GOAT case. Plus, you know, he’d blow his likely last chance to get to the super bowl. Mannings was under more pressure, but gets credit for the same leverage as Brady.

I’m don’t think clutch exist – football is a series of near independent events. I’m just saying you should bevare of selling any stat as a measure of clutchness, since the term clutch is so flimsy and hard to define, thus the stat will be extremely easy to poke holes in.

But as I said i kinda like it.

Overall, I like it. The adjustment for era and SoS is particularly helpful, which seems to be missing in most QB playoff discussions. However, I do have one concern: the heavy weighting of the Super Bowl allows single plays to wildly swing a QB’s value, even if he had little to do with the play. Think of an unlucky tip-drill INT, which carries a penalty of 141.3 yards (45 x 3.14). Or a dumpoff to a RB who takes it 80 yards for a TD, which credits the QB 314 yards (80+20 x 3.14).

Why is Jake Delhomme ranked 4th? Because more than half of his value came on one play, an 85 yard TD pass in the closing minutes of the Super Bowl (worth 329.7 yards). He dropped back 110 times, yet 54% of his value is determined by one single play? That’s borderline absurd.

ANY/A works great over a full season or career, but with the small sample of one playoff run, outliers have a huge influence.

That’s probably pretty accurate, though. Think about Eli Manning, for instance: basically two plays — the helmet catch by Tyree and the *perfect* 38-yard pass to Manningham — are the difference between him being regarded as a massive bust/NYC media whipping boy and a 2-time Super Bowl champion. In that case, the absurdly elevated emphasis on the Super Bowl by talking heads is actually somewhat in line with what leverage says about the Super Bowl’s importance relative to other games.

“Denver also started the playoffs with a 12.5% chance of winning the Super Bowl, since the Broncos don’t get any extra credit for rostering Peyton Manning.”

More like losing credit for rostering Peyton Manning, amirite?

When will the career list come out?

While I’m not completely discrediting this leverage system, I would have to agree with Mr. Gregory and his Plunkett/Rodgers argument that there’s just no way that Jim Plunkett’s postseason was better than Aaron Rodgers Super Bowl run. Certain things obviously carry more weight like winning on the road and not turning the ball over. But if I have a QB that dinks and dunks and earns his 1st downs 6.5 yards at a time making the smart, safe throw but chews up clock and keeps the other offense of the field (imagine your ‘to win one game I’d take ……as my QB’ scenario had 2013 Peyton Manning on the opposing sideline.), I’d take him in a playoff game over a gunslinger who has a 9.0 ANY/A but only completes 45-50% of his passes because if I’m in a playoff game the only thing that matters is the W. Nobody cares if your stat line read 28-51 475yds 5td 2int but your team isn’t hoisting the Lombardi. #1 on this list is an example of that. Warner lit it up, sure, but I’d take Trent $+#^® Dilfer over him if I knew he’d manage the game, not turn the ball over and played smart enough not to have some hero complex and try to do too much. What’s the point of my ramble? Its that we have to figure out a metric that takes into account ANY/A and Value over Average but also includes a leverage metric as well as some sort of value above their win expentancy. Add to that I think while we are trying to isolate a QB to measure his regular season efficiency and excellence but the postseason is almost the complete opposite. What matters most in the playoffs is how much a quarterback elevates his team. How you guys have done WWOY studies on Wide Receivers across eras, you need some type of WWOY system entangled with the rest so we can truly evaluate the best postseason games, years and careers. This definitely comes closer to that by measuring leverages and the ‘clutchness’ of quarterbacks against great or awful defenses, so I’m not trashing the metric. I’m just saying Mr. Gregory has a very very good point about any form of YPA isn’t that meaningful in an environment where winning by any means is as important as breathing.

The issue with that line of argument, though, is that the team with the superior ANY/A almost always wins. Since passing opened up in 1978, the winner of the ANY/A battle has won 82% of playoff games. This year, only 5 of the 10 playoff games have been won by the team who had the better ANY/A, but prior to this year we were in a four-year stretch where the ANY/A winner won 84% of playoff games (and that’s nothing compared to 1978-92, when the ANY/A winner won 89% of playoff games!). Anyway, it’s a pretty big outlier whenever a team wins without beating the opponent in ANY/A as well. The idea that it’s somehow incidental to winning isn’t supported by the data at all.

{ 1 trackback }