December 22, 2006

Player Value Part III

It’s been a little less than a week since I released part II of my player evaluations. In this release I’m not using the term “rank”. This is a statistics that measure how well these players have played so far, whether that makes them the best player or lucky is a matter of opinion as it always is with statistics. If there were no opinion then we could just evaluate players based on salary (perfect correlation of performance to pay). There are still small tweaks I can make to the algorithm improve, however this is about as good as it will get. Remember also, that this evaluates player’s performance at even strength which accounts for 65% of all goals and 72% of ice time.

The most significant change was to regress to the mean, this means that I look at each player’s score and ask the question: “is it more likely this player is average than actually this good”. So a player with seven goals against per hour in one game might be extremely bad, but it’s more likely that they were unlucky and are actually only “semi-bad”. Using an estimated percent error as a function of ice time, I rescale each players Z score (how many standard deviations they are from average), if the amount of time is less than some amount (where percentage error >100%) I just assume the player is average until I have better data. This means that good players who’ve missed a good chunk of the season I can’t really rate. For example, Gaborik has a negative score, which will improve if he gets more ice time.

Since the regression doesn’t care about individual scores, but the scores of all possible cross products I had to rescale every pair using the above logic. So if a pair doesn’t play much together, but got a ton of goals in the time I just assume it was all luck and give them an average number of goals. So this regression primarily looks at significant pairings and ignores the insignificant pairings. This also prevents the regression from blowing up in both directions and makes the results in a much smaller band.

A good/poor score can be the result of coaching usage, player confidence, ability, luck etc. This is not a definitive number telling you how good a player is at even strength, but rather attempts to explain how they have done, whether that’s an anomaly or not is a matter of opinion. So with the technical discussion over a short list, the rest is available at my site.


Canucks
NFLastnameV
1HSEDIN0.36
2DSEDIN0.33
3MNASLUND0.21
4MOHLUND0.12
5KBIEKSA-0.03
6JGREEN-0.10
7SSALO-0.11
8MCHOUINARD-0.14
9BMORRISON-0.14
10TLINDEN-0.15
11ABURROWS-0.15
12JBULIS-0.23
13RKESLER-0.28
14TPYATT-0.29
15MCOOKE-0.37
16LKRAJICEK-0.51
17WMITCHELL-0.66


Wild
NFLastnameV
1BROLSTON0.09
2KCARNEY0.01
3SVEILLEUX0.00
4MSKOULA0.00
5MPARRISH-0.04
6TWHITE-0.10
7KFOSTER-0.18
8BBURNS-0.20
9PBOUCHARD-0.21
10PDUPUIS-0.25
11BRADIVOJEVIC-0.25
12KJOHNSSON-0.43
13MKOIVU-0.43
14PDEMITRA-0.50
15NSCHULTZ-0.51
16PNUMMELIN-0.65


Edmonton
NFLastnameV
1RTORRES0.67
2JSTOLL0.40
3DTJARNQVIST0.35
4FPISANI0.35
5MBERGERON0.26
6JSMITH0.23
7MGREENE0.15
8PSYKORA0.07
9AHEMSKY0.06
10RSMYTH0.05
11SSTAIOS-0.01
12BWINCHESTER-0.05
13PTHORESEN-0.08
14SHORCOFF-0.10
15LSMID-0.12
16MREASONER-0.12
17JLUPUL-0.15
18TPETERSEN-0.43


Colorado
NFLastnameV
1KKLEE0.61
2JSAKIC0.47
3TARNASON0.38
4MSVATOS0.33
5ABRUNETTE0.30
6WWOLSKI0.18
7JLILES0.14
8BMCLEAN0.12
9PSTASTNY0.09
10MHEJDUK0.06
11OVAANANEN0.06
12BCLARK-0.02
13BRICHARDSON-0.15
14ILAPERRIERE-0.15
15ALAAKSONEN-0.15
16PBRISEBOIS-0.17
17MRYCROFT-0.19
18KSKRASTINS-0.34


Flames
NFLastnameV
1JIGINLA0.70
2RWARRENER0.53
3DLANGKOW0.52
4DPHANEUF0.49
5ATANGUAY0.41
6RHAMRLIK0.36
7MLOMBARDI0.32
8RREGEHR0.23
9KHUSELIUS-0.12
10MNILSON-0.12
11BRITCHIE-0.23
12JLUNDMARK-0.23
13DMCCARTY-0.25
14CKOBASEW-0.29
15AFERENCE-0.31
16JFRIESEN-0.37
17TAMONTE-0.47
18AZYUZIN-0.65


I’ve also been doing the same thing to my PP and SH data as a result the columns on my website are significantly different. A NETV score, which represents goal differential provided by a given player, using even strength, power play and penalty kill data. You can estimate winning percentage by (2.86+NETV)2/((2.86+NETV)2 + 2.862), which might be more intuitive to readers. PP+, PP-, SH+, SH- are functions of goals for and shots against and do not represent typical plus minus numbers, they attempt to credit the player who is responsible for the goal rather than all players equally.

NETV =
+ V
+ (PP+ - PP- - PPavg)*PPhours/(0.15*Games)
+ (SH+ - SH- + SHavg)*SHhours/(0.15* Games)

I’m not quite satisfied with the constant used in the algorithm at this point to say these results are very good, but they are useful. All the NETV scores are on my website.

I want to do some more interesting analysis in the next week, so I’ll avoid dealing with my player rating system for a while, so I’ll keep these results for now. Not sure what topic I’ll cover next. It’s been a while since some of my more detailed better articles came out.

2 comments:

Anonymous said...

I think you have problems when the top 3 players for VAL are on the same team (Buffalo) and the top 3 players for NET are all from the same team (NYR). To me that says you are not isolating their contribution very well.

JavaGeek said...

First off my algorithm will only give two players who play together different scores if their ice time not together is significant. If the biggest problem is that the top 5 players are wrong then I'd be happy, the goal wasn't to create a ranking system, but an evaluation system. The players at the top of the list are often there because of luck so I take the top players with a grain of salt.

However,
1. Buffalo has had some terrible even strength goal tending, but are ranked top 3 in goal differential.
2. Vanek is not on the same line as Briere and Pominville.
3. 85% of Pominville's ice time has been with Briere. There are about 3000 seconds of information of them apart (probably distributed amount 16 other players), even if they were with the same player there's 65% error on this data, that means a lot of regressing to the mean. In other words I lack sufficient data to consider which one is better so I choose to make them more similar.
4. That being said, Pominville's 4.9 +'s/HR I hope he gets ranked high. And I'm glad this high ranking for Pominville didn't effect Briere signifigantly (I'd hate to have Briere get a low offensive ranking because Pominville has done well)

New York NET scores:
1. Shanahan is there for completely different reasons than Jagr and Straka. Shanahan has spent some time on the PK and has had great results and as a result gets rewarded.
2. Shanahan and Straka are indistinguishable on the power play.
3. Straka and Jagr haven't spent enough time apart to get a good picture on who is producing results.

Conclusion: The number of priority isn't isolating player contribution, but estimating skill, there are times when that is impossible due to too much time together (Sedin's) that one is better off to give the two players the same score and let one subjectively determine who is driving the results.