Thursday, July 12, 2007

Disclaimer on Data

I've been culling my box scores from this site as it was the deepest archive of box scores I could find when I started the research. Since then, I've found DatabaseFootball.com to supplement some of the information and correct errors. DF's archives go back to '83, but the other site has more third down conversion data. At any rate, I was working on an article about game-to-game variance of offense and defense, and I started to realize that there are more errors than I originally realized. They're just small typoes, but if you enter 75.0 rushing yards as 750 yards, it tends to throw off my metrics. So I'm looking at all the curiously aberrant data and correcting any mistakes. Maybe I should start putting a warning label on my site: May not be 100% accurate.

This was fixed quicker than I thought. Here is what I corrected today:


  • 2003 Week 15 SF@CIN Rushes 3->37
  • 1994 Week 14 PIT@CIN Rush yards 768->76
  • 2004 Week 2 NYJ@SD Rush yards 1222->122
  • 1995 Week 6 MIN@HOU Rush yards 750->75
  • 1994 Week 6 PHI@WAS Sacks ->2-15 3-39
  • 1994 Week 2 NYG@ARI Sacks 3-23 14-27 -> 4-31 3-23
  • 2006 week 11 PIT@CLE PIT Kick Returns 1-158->5-158
  • 2006 Week 15 TEN@JAX JAX Kick returns 3-417->4-117
  • 2000 Week 3 STL@SF Third Down 10-2 9-4 -> 2-10 4-9
  • 2000 Week 3 BUF@NYJ Third Down 13-6 17-6 -> 6-13 6-17
  • 2000 Week 3 PHI@GB Third Down 15-5 13-5 -> 5-15 5-13
  • 2000 Week 3 ATL@CAR Third Down 16-3 12-4 -> 3-16 4-12
  • 2001 Week 1 OAK@KC Third Down 20-12 -> 12-20
  • 2002 Week 3 KC@NE Thrid Down 89-17-> 8-17
  • 2003 Week 14 PIT@OAK Fumbles 33->3


Note that these are not the only box scores I have had to correct. Out of the 3211 boxscores I have collected from John Troan's site, about 30-40 have needed to be corrected. It's an error rate of about 1%, and the most egregious errors have been taken care of. Kick return avgs. above 110 yards. Third down conversion rates over 100%. 80 yards per carry in a game. 88% fumble rates in a game. As I find more errors in my data, I will post it on the blog. Good night, and good luck.

No comments: