An Idea for Estimating Future Performance
As discussed previously, football predictions (mine and others') are largely based on the averages of past performances. The past performances themselves are above and below the average by various amounts, and the future performance is almost certainly going to be above and below that mean by a certain amount. But we don't know whether the performance will be above or below or by how much. That's the limitation of using averages. If we have all of the observations from the season so far, can we do a better job of estimating performance? In other words, we want to estimate the following:
I'm pretty sure the expected value of performance would still be the mean as it's the sum of all possible outcomes weighted by their probabilities, but there's still value in knowing the probability distribution of the possible outcomes. If Teams A and B averaged 4.0 yards a carry, you might think they're about as good. But if Team A has a 60% chance of averaging less than 4.0 yards a carry in a game, while Team B's chance is only 35%, then it's clear that Team B is more reliable. Team B would be the better choice to bet on. This would also be useful for fantasy football, I suspect. If there's a 5% chance, a running back is going to go for 220 yards in today's game, you might start him despite his expected performance (the mean) maybe being 95 yards. Depends on your risk-aversity, however.
My current idea as to the method of doing this would be a hidden Markov Model. Given a series of observations over time 1 through t-1, it estimates the probability of what you'll observe at time t. I'd break down performance into certain ranges (5.75-6 yards a pass attempt, 6-6.25, etc.) and use those as the evidence variables. I'm thinking the unobserved state variables would be the average performance broken down into ranges in a similar way.
Another page on hidden Markov models.
Before going to all the trouble of implementing it, I was curious to hear people's reactions and thoughts and suggestions. Plus, I'm moving next week, so I'll take the time to develop the idea while I get settled in.
2 comments:
I have never attempted Markov chain models before, but I know they are very appropriate for baseball.
From your second paragraph, it sounded more like you were going for a Bayesian approach. Each team would have its own distribution of yard expectancies as a prior. Every subsequent data point would refine the expectancy. But that's seriously high-powered stuff.
Derek, what kind of neural network software do you use? Someone suggested Tiberius to me, and I've been using the trial version with some success.
Post a Comment