Two weeks ago, we kicked off our fantasy season with a player draft. ESPN’s draft center provides fantasy owners with an overwhelming amount of information on each player, but time and again, only one data point seemed to matter: how many points ESPN projected that player would score. Pick after pick, teams would choose the best available player at each position. By the end of the draft, we were all wondering the same thing: How much do these projections affect draft results?
Most leagues follow this pattern, in which fantasy owners tend to adhere to the player rankings provided by the league. While teams rarely select the highest point scorer available - kickers, for instance, tend to get drafted much later than running backs, regardless of their projected output - teams typically follow to point projections by position. In other words, the draft order of wide receivers is nearly identical to the point projection ranking for wide receivers.
Nobody knows what to make of Jonathan Dwyer's up-and-down preseason
This relationship doesn’t necessarily imply that teams are drafting mechanically according to ESPN’s recommendations. People want to draft the best players, so it makes sense for there to be close relationship between draft orders and the consensus on who’s best. ESPN’s “expert” advice could determine our opinions on players, or it could simply reflect what we already know.
Fortunately, there are other cases in which that advice is different. CBS, which manages another widely used fantasy football platform, provides their own projections for their leagues. By comparing the differences in CBS and ESPN point projections to the differences in average draft positions, we can estimate how much drafts are affected by these projections.
As it turns out, we just do what we’re told. (Except Rage Against the Machine. They won’t do what we tell them.) Differences in ESPN and CBS rankings by position strongly correlate with differences in ESPN and CBS draft outcomes. According to rough calculations, approximately 35% of the variation in CBS’s and ESPN’s draft results can be explained by differences in how each league projects players will perform.
The relationship is even stronger if you eliminate the later rounds, which are mostly made of up of teams drafting backups and bench players. For players drafted in the first 10 rounds, differences in projections explain 70% of the differences in draft results. Ranking a player one spot lower within their position (e.g., projecting a running back to score the 10th most points instead of 9th) lowers that players average draft position by about two picks.
We’re all sheep
Though leagues sometimes have different scoring methods (passing TDs are worth 4 points in ESPN leagues and 6 in CBS leagues), ranking players by position - as is done here - rather than comparing the nominal point projections should negate most of these differences.
Are Auction Drafts Different?
These results may actually be more interesting (and actionable) in auction drafts. In an auction draft, every player comes up for auction. Teams, which are all allotted a certain amount of money (typically $200), fill their rosters by bidding on the players they want, and the highest bidder for each player pays that amount for him. Because this format doesn’t constrain fantasy owners to pick in any particular order and everyone has an equal opportunity to buy each player, fantasy owners can therefore more easily take advantage of market inefficiencies.
Unfortunately, CBS doesn’t provide data on average bid values for players. However, as shown below, ESPN bid values are strongly correlated with average draft positions. Assuming CBS bids also closely mirror their standard draft outcomes, we can estimate bid values from CBS' average draft position data.
Adrian Peterson? More Like Adrian PAYterson.
After estimating the average bid value for CBS players, we can then compare differences in league projections to differences in bid values, just as was done with draft results. In this case, differences in projections have less of an impact on what teams are willing to bid for players than on when players get drafted. (Why the weaker relationship? Possibly because CBS values are estimated, and possibly because auction drafts usually involve more experienced players who are less likely to simply follow league forecasts.) Nevertheless, as shown in the graph below, there is still a significant negative relationship between differences in projections and differences in bid values, implying that, despite teams in both leagues bidding on the same player, players will be worth less in leagues that project them to do worse. For example, because ESPN expects Eddie Lacey to score 15 more points than CBS, ESPN teams were willing to pay $9 more for him than CBS teams.
Spending money must make us think more carefully
These finding have a couple implications. First, fantasy owners can use aggregated projections such as these to take advantage of anomalous league projections. Second, (as will be discussed further in a future post), teams can use projections to anticipate other teams' draft picks, which can be used to model optimal drafting strategies.
Data and Analysis Code
Data was first collected on ESPN projections and draft results, and CBS projections and draft results. Each dataset was gathered a CSV.
Analysis was done in R (h/t to Fantasy Football Analytics in R for inspiration and a bit of R code.) and visualizations were made in Excel.
All of the data, CSVs, R scripts, and charts that powered this analysis can be found in this folder.
Originally posted at bennstancil.com.
