The Economics of Sport
  • Sports Economics
  • About
  • Workshop
  • Selected Publications
  • Book Reviews
  • A Primer on Gaelic Games
  • Upcoming Events
  • Media
  • Education
  • Resources & Links
  • Data

The Use (and Abuse) of Metrics to Measure Performance

27/9/2018

 
By Stephen Brosnan

Recently, I attended the 23rd International Conference on Science, Technology and Innovation indicators. The focus of the conference was to stimulate discussion on comprehensive approaches and indicators in the study of science, technology and innovation. A key debate at the conference was the use of quantitative and qualitative approaches to research evaluations. Typically, there are two approaches in the evaluation of scientific quality: peer review vs metrics. Peer review refers to a process of research assessment based on the use of expert opinion and judgment while metrics refer to a quantifiable measure used to track and assess the status of a specific process.

The use of metrics as a tool for evidence-based decision making has gained traction amongst sports teams, most famously by Billy Beane of the Oakland A’s. The ‘Moneyball’ strategy has been implemented by many sports teams with varying rates of success. Daryl Morey, General Manager of the Houston Rockets, has utilised metrics to assemble the team with the best regular season record in the NBA while Bill Gerrard has provided data analysis for both AZ Alkmaar in soccer and Saracens in rugby.  However, similar to the academic debate, there has been significant push back towards the overreliance on metrics to guide decision making. Charles Barkley, an 11-time NBA All-Star, argues that “analytics is crap” because the NBA is all about talent, that Morey is “one of those idiots”, and that proponents of analytics are "a bunch of guys who ain't never played the game [and] they never got the girls in high school”.

A key issue in the debate is that metrics tend to ‘count what is easily measurable rather than measuring what counts’. The argument is that metrics fail to capture important tacit elements of performance such as hard work, heart and determination. Furthermore, there is an argument that once a measure becomes known it is no longer a useful measure due to ‘gaming’ of the system. This occurred last year when OKC point guard Russell Westbrook was accused of padding his stats to achieve a season average triple-double. In the final regular season game, he needed 16 rebounds to average a triple-double for the second-straight year. Westbrook wound up grabbing 20, a career-high.

Another limitation associated with using metrics to guide evaluations and decision-making is that choosing the right metrics is not easy and the choice of metrics can lead to contrasting recommendations. This issue is evident every time there is a debate surrounding the greatest NBA player of all time. Michael Jordan’s fans point to his 100% record in NBA finals along with his six final MVP awards as reason he is the GOAT. The choice of these metrics paints the narrative that Jordan was the ultimate competitor with a win at all costs mentality and always showed up on the big occasion. However, Karim Abdul Jabbar’s supporters point to the fact he is the NBA leading scorer of all time with the most unstoppable shot ever, the Skyhook while Lebron James fans point to the fact that he is the only player to be top 10 all time in scoring and assists, thus painting the narrative of the perfect teammate that makes everyone better.

Recently, Jerry Muller published a book entitled “Tyranny of the Metrics” which highlights the dangers associated with the quantification of performance metrics in education, medicine, business and finance, government, the police and military. I think it is clear from this piece that sport may also be added to the list. Metrics may be used (and abused) in sport to convey particular narratives and recommendations and should be used as a complement - not a substitute for- judgements based on experience and expertise.

Comments are closed.

    Archives

    March 2023
    February 2023
    January 2023
    December 2022
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013

    About

    This website was founded in July 2013.

    RSS Feed

    Categories

    All
    American Football
    Athletics
    Baseball
    Basketball
    Behavioural Economics
    Boxing
    Broadcasting
    Competitive Balance
    Cricket
    Cycling
    Darts
    David Butler
    Declan Jordan
    Drugs
    Ed Valentine
    Epl
    Esports
    Expenditure
    F1
    Fifa World Cup
    Finances
    Funding
    Gaa
    Gaelic Games
    Gambling
    Game Theory
    Gary Burns
    Geography
    Golf
    Greyhound Racing
    Guest Posts
    Horse Racing
    Impact Studies
    John Considine
    John Eakins
    League Of Ireland
    Location
    Media
    Mls
    Mma
    Olympics
    Participation
    Paul O'Sullivan
    Premier League
    Regulation
    Research
    Robbie Butler
    Rugby
    Simpsonomics
    Snooker
    Soccer
    Spatial Analysis
    Sporting Bodies
    Stephen Brosnan
    Swimming
    Taxation
    Teaching
    Technology
    Tennis
    Transfers
    Uefa
    Ufc
    World Cup
    Wwe

Related

The website is not formally affiliated to any institution and all of the entries represent the personal views and opinions of an individual contributor. The website operates on a not-for-profit basis. For this reason we decline all advertisement opportunities. 

Contact

To contact us email sportseconomics2013@gmail.com or find us on Twitter @SportEcon.