Main Article Content

Authors

Fahad Alfarraj

Jaquelin Bousie

Jeremy Witchalls

Phil Newman

Abstract

Coaches typically play a central role in team performance and player selection, but their assessments can also be valuable for the medical team in injury prevention and recovery. This research aimed to evaluate whether soccer coaches' evaluations of their players' physical abilities align with performance testing during pre-season. The players were rated subjectively by two coaches independently, focusing on various aspects such as technical, tactical, physical, and psychological skills. Ratings were given on a scale of 0 to 100, based on the coaches' perceptions of top players in those positions globally. The mean score of the coaches' ratings was used for each player. The study used the Intra-class Correlation Coefficient (ICC) to measure the reliability of inter-coach ratings, while players' scores on common functional tests were assessed independently by the medical staff. Decision tree analysis was conducted to determine the association between coaches' ratings and functional testing scores, as well as to identify cut-off values for differentiating higher and lower coach ratings. Sixty-three male professional soccer players from the Saudi Professional League participated voluntarily. The ICC values ranged from 0.73 to 0.79, indicating good to excellent agreement between coaches. The analysis showed that functional performance scores and coach ratings agreed in 86% of cases, with 88% precision and 91% recall. The algorithm correctly identified 88.4% of players rated high performers by coaches and 80% of lower-rated players. Cut-off scores were determined based on specific functional test results. For instance, players scoring above certain thresholds on tests like the Y-balance test and triple medial hop were more likely to receive higher coach ratings. The study revealed a solid alignment between coaches' subjective evaluations of physical abilities and objectively measured functional performance tests. These results hold the potential for aiding in player selection, establishing preparation standards, and facilitating players' return to play after injury.

Downloads

Download data is not yet available.

Article Details

Section

Articles

References

  1. Jowett, S. and P. Wylleman, Interpersonal relationships in sport and exercise settings: Crossing the chasm. Psychology of Sport & Exercise, 2006. 2(7): p. 119-123.
  2. Bruner, M.W., J. Hall, and J. Côté, Influence of sport type and interdependence on the developmental experiences of youth male athletes. European Journal of Sport Science, 2011. 11(2): p. 131-142.
  3. Rhind, D.J. and S. Jowett, Initial evidence for the criterion-related and structural validity of the long versions of the Coach–Athlete Relationship Questionnaire. European Journal of Sport Science, 2010. 10(6): p. 359-370.
  4. Leite, N., J. Baker, and J. Sampaio, Paths to expertise in Portuguese national team athletes. Journal of Sports Science & Medicine, 2009. 8(4): p. 560-566.
  5. Côté, J. and W. Gilbert, An integrative definition of coaching effectiveness and expertise. International Journal of Sports Science & Coaching, 2009. 4(3): p. 307-323.
  6. Carling, C., T. Reilly, and A.M. Williams, Performance assessment for field sports. 2008: Routledge.
  7. Winter, E., et al., Rationale. Sport and Exercise Physiology Testing Guidelines, 2007. 1: p. 7-10.
  8. Elferink-Gemser, M., et al., Relation between multidimensional performance characteristics and level of performance in talented youth field hockey players. Journal of Sports Sciences, 2004. 22(11-12): p. 1053-1063.
  9. Ré, A.H.N., U.C. Corrêa, and M.T.S. Böhme, Anthropometric characteristics and motor skills in talent selection and development in indoor soccer. Perceptual and Motor Skills, 2010. 110(3): p. 916-930.
  10. Bishop, D.J. and O. Girard, Determinants of team-sport performance: implications for altitude training by team-sport athletes. British Journal of Sports Medicine, 2013. 47(Suppl 1): p. i17-i21.
  11. Cochrane, D. and S. Stannard, Acute whole body vibration training increases vertical jump and flexibility performance in elite female field hockey players. British Journal of Sports Medicine, 2005. 39(11): p. 860-865.
  12. Cressey, E.M., et al., The effects of ten weeks of lower-body unstable surface training on markers of athletic performance. The Journal of Strength & Conditioning Research, 2007. 21(2): p. 561-567.
  13. Hrysomallis, C., Balance ability and athletic performance. Sports Medicine, 2011. 41(3): p. 221-232.
  14. Gabbett, T.J. and B. Georgieff, The development of a standardized skill assessment for junior volleyball players. International Journal of Sports Physiology and Performance, 2006. 1(2): p. 95-107.
  15. Elferink-Gemser, M.T., et al., Multidimensional performance characteristics and standard of performance in talented youth field hockey players: A longitudinal study. Journal of Sports Sciences, 2007. 25(4): p. 481-489.
  16. Sunderland, C., et al., The reliability and validity of a field hockey skill test. International Journal of Sports Medicine, 2006. 27(05): p. 395-400.
  17. Landy, F.J. and J.L. Farr, Performance rating. Psychological Bulletin, 1980. 87(1): p. 72.
  18. Calder, J.M. and I.N. Durbach, Decision support for evaluating player performance in rugby union. International Journal of Sports Science & Coaching, 2015. 10(1): p. 21-37.
  19. Sullivan, C., et al., Factors affecting match performance in professional Australian football. International Journal of Sports Physiology and Performance, 2014. 9(3): p. 561-566.
  20. Tromp, E.Y., et al., “Let's Pick Him!”: Ratings of Skill Level on the Basis of in-Game Playing Behaviour in Bantam League Junior ICE Hockey. International Journal of Sports Science & Coaching, 2013. 8(4): p. 641-660.
  21. Svensson, M. and B. Drust, Testing soccer players. Journal of Sports Sciences, 2005. 23(6): p. 601-618.
  22. Phillips, E., et al., Expert performance in sport and the dynamics of talent development. Sports Medicine, 2010. 40(4): p. 271-283.
  23. Lames, M. and T. McGarry, On the search for reliable performance indicators in game sports. International Journal of Performance Analysis in Sport, 2007. 7(1): p. 62-79.
  24. Pang, B., L. Lee, and S. Vaithyanathan, Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2002.
  25. Abraham, A., D. Collins, and R. Martindale, The coaching schematic: Validation through expert coach consensus. Journal of Sports Sciences, 2006. 24(06): p. 549-564.
  26. Woods, K., P. Bishop, and E. Jones, Warm-up and stretching in the prevention of muscular injury. Sports Medicine, 2007. 37(12): p. 1089-1099.
  27. Robinson, R.H. and P.A. Gribble, Support for a reduction in the number of trials needed for the star excursion balance test. Archives of Physical Medicine and Rehabilitation, 2008. 89(2): p. 364-370.
  28. Gribble, P.A. and J. Hertel, Considerations for normalizing measures of the Star Excursion Balance Test. Measurement in Physical Education and Exercise Science, 2003. 7(2): p. 89-100.
  29. Gribble, P.A., J. Hertel, and P. Plisky, Using the Star Excursion Balance Test to assess dynamic postural-control deficits and outcomes in lower extremity injury: a literature and systematic review. Journal of Athletic Training, 2012. 47(3): p. 339-357.
  30. Kivlan, B.R., et al., Reliability and validity of functional performance tests in dancers with hip dysfunction. International Journal of Sports Physical Therapy, 2013. 8(4): p. 360-369.
  31. Noyes, F.R., S.D. Barber, and R.E. Mangine, Abnormal lower limb symmetry determined by function hop tests after anterior cruciate ligament rupture. The American Journal of Sports Medicine, 1991. 19(5): p. 513-518.
  32. Witchalls, J.B., et al., Functional performance deficits associated with ligamentous instability at the ankle. Journal of Science and Medicine in Sport, 2013. 16(2): p. 89-93.
  33. Fleiss, J., The design and analysis of clinical experiments. New York: Willey and Sons, 1986: p. 1-15.
  34. Demšar, J., et al., Orange: data mining toolbox in Python. The Journal of Machine Learning Research, 2013. 14(1): p. 2349-2353.
  35. Nasteski, V., An overview of the supervised machine learning methods. Horizons. b, 2017. 4: p. 51-62.
  36. Rico-González, M., et al., Machine learning application in soccer: A systematic review. Biology of Sport, 2022. 40(1): p. 249-263.
  37. Stokes, M., et al., Are Intrinsic Factors useful in predicting Risk of Injury and Performance in Field Hockey, in Research Institute for Sport and Exercise. 2020, University of Canberra.
  38. Keogh, J.W., C.L. Weber, and C.T. Dalton, Evaluation of anthropometric, physiological, and skill-related tests for talent identification in female field hockey. Canadian Journal of Applied Physiology, 2003. 28(3): p. 397-409.
  39. Nieuwenhuis, C.F., E.J. Spamer, and J.H.v. Rossum, Prediction function for identifying talent in 14-to 15-year-old female field hockey players. High Ability Studies, 2002. 13(1): p. 21-33.
  40. Song, Y.-Y. and L. Ying, Decision tree methods: applications for classification and prediction. Shanghai Archives of Psychiatry, 2015. 27(2): p. 130.