Effective player assessment (and is Wayne Rooney really playing that badly?)

Quickly assessing the ability of individual players isn’t a particularly easy task; firstly because a player’s overall effectiveness isn’t necessarily the sum of a series of data points (goals, assists, passes, tackles etc) and secondly – good quality, manipulable, player-data is difficult to get hold of.

There are a few good sources of Team data – including the excellent football-data.co.uk, which allows access to continually updated CSV files, containing a treasure-trove of match information, across a variety of leagues. I use this for my shot-based Adjusted Goals team rating system. But it’s a different story for player data – it’s accessible but (deliberately) only in a format unfriendly to robust analysis.

However, I’m keen to explore the impact of individual players on team performance in more detail. Whilst my shot based Team assessment (Adjusted Goals) is proving an excellent starting point for individual match modelling, it doesn’t take account of team changes – including the absence of key players. A change of player personnel obviously does affect a team’s overall ability and tactical make-up, but by how much?  For betting purposes I suspect that there’s a rich vein of potential value to be found in properly adjusting for the absence of key players – essentially, because it’s so difficult to make an objective assessment, meaning that the market may over (or under) react.

As an extreme example of this, when Liverpool played at Bournemouth on 17 April 2016, their opening Pinnacle odds were 2.10. These odds already allowed for the fact that Liverpool were likely to field a weakened team, due to European commitments. However, by kick-off their odds increased by 32% to 2.77 – reflecting that Klopp made more changes than expected.The true effect on likelihood of these changes was clearly difficult to assess – but I suspect that there was true value in these odds somewhere along the line.

My initial attempt at Premier League player assessment uses the same method I deployed to rate International teams for Euro 2016. This takes a variety of (reasonably accessible) data points to assess each players effectiveness score for their particular team – for both attacking and defensive strength.

For reference, the components are:

Attacking Component per 95 minutes
Passes 24%
Goals 28%
Assists 7%
Shots 6%
Chances created 35%
Defensive Component per 95 minutes
Tackles 32%
Interceptions 32%
Clearances 32%
Blocks 4%

Now, sadly, I can’t point to any scientific basis for these weightings. These were based on trial and error to get – what looked right – using 2015/16 data. But it’s a starting point.

Using these, I assess each player’s relative effectiveness for their particular team, by dividing by the average score for that team. This is then multiplied by that team’s relative attacking or defensive strength (from my adjusted goals rating method) – to give an overall rating – where the average Premier League player has a rating of 1.

So far, for the 2016/17 season the ratings are as follows:

Rank Attacker Rating Team Attack Rating
1 Son Tottenham 3.90
2 Lukaku Everton 3.54
3 De Bruyne Man City 3.30
4 Aguero Man City 3.25
5 Coutinho Liverpool 3.23
6 Iheanacho Man City 3.08
7 Sánchez Arsenal 3.01
8 Milner Liverpool 2.93
9 Chadli West Brom 2.89
10 Willian Chelsea 2.83
11 Diego Costa Chelsea 2.81
12 Firmino Liverpool 2.76
13 Payet West Ham 2.68
14 Lallana Liverpool 2.63
15 Capoue Watford 2.46
16 Ozil Arsenal 2.33
17 Sterling Man City 2.30
18 Rashford Man United 2.30
19 Kane Tottenham 2.20
20 Cazorla Arsenal 2.19
Rank Defence Rating Team Defence Rating
1 Vertonghen Tottenham 3.14
2 Rose Tottenham 3.13
3 Otamendi Man City 3.13
4 Jagielka Everton 3.12
5 van Dijk Southampton 3.04
6 Alderweireld Tottenham 3.03
7 Williams Everton 2.90
8 Romeu Southampton 2.66
9 Coleman Everton 2.50
10 Mustafi Arsenal 2.50
11 Bailly Man United 2.29
12 Wanyama Tottenham 2.21
13 Blind Man United 2.17
14 Gueye Everton 2.14
15 Fonte Southampton 2.14
16 Monreal Arsenal 2.14
17 Funes Mori Everton 2.13
18 Koscielny Arsenal 2.13
19 Holgate Everton 2.03
20 Lovren Liverpool 1.99
Rank Overall rating Team Overall Rating
1 Milner Liverpool 2.32
2 Son Tottenham 2.14
3 Coutinho Liverpool 2.05
4 Rose Tottenham 2.01
5 De Bruyne Man City 1.96
6 Otamendi Man City 1.92
7 Lukaku Everton 1.87
8 Iheanacho Man City 1.84
9 Coleman Everton 1.76
10 Chadli West Brom 1.76
11 Jagielka Everton 1.76
12 Alderweireld Tottenham 1.74
13 Vertonghen Tottenham 1.73
14 van Dijk Southampton 1.73
15 Sánchez Arsenal 1.72
16 Aguero Man City 1.71
17 Lallana Liverpool 1.70
18 Henderson Liverpool 1.68
19 Lamela Tottenham 1.68
20 Capoue Watford 1.68

These aren’t perfect, for example James Milner’s top position is significantly influenced by his penalty haul. Also, seven matches isn’t really long enough to properly assess effectiveness.

However, it does given me a starting point for objective assessment for player changes, that I can use in conjunction with my team ratings.

There are player rankings available on some of the football stats sites – but I haven’t a clue how these are complied, so I can’t judge whether they’re robust. It’s preferable to construct  your own rating method, where it’s much easier to understand the shortcomings, and can be improved over time (which it what I’ll be attempting to do with these ratings).

So how does the much maligned Wayne Rooney rate using this assessment method? He’s ranked 99th in the Premier League and 9th at Man U this season – with a rating of 1.14. Just above the average Premier League player – which seems about right.

Rank Overall Team Overall Rating
1 Blind Man United 1.65
2 Fellaini Man United 1.38
3 Mata Man United 1.35
4 Rashford Man United 1.34
5 Bailly Man United 1.30
6 Herrera Man United 1.29
7 Ibrahimovic Man United 1.28
8 Pogba Man United 1.27
9 Rooney Man United 1.14
10 Smalling Man United 1.13
11 Martial Man United 1.12
12 Valencia Man United 1.10
13 Lingard Man United 0.99
14 Mkhitaryan Man United 0.91
15 Shaw Man United 0.89
16 Young Man United 0.88
17 Carrick Man United 0.85
18 Depay Man United 0.82
19 Schneiderlin Man United 0.81


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s