Display options
Cite
Mischiati CR, Comerford M, Gosford E, et al. Intra and inter-rater reliability of screening for movement impairments: movement control tests from the foundation matrix. J Sports Sci Med. 2015;14(2):427-40
Mischiati, C. R., Comerford, M., Gosford, E., Swart, J., Ewings, S., Botha, N., Stokes, M., & Mottram, S. L. (2015). Intra and inter-rater reliability of screening for movement impairments: movement control tests from the foundation matrix. Journal of sports science & medicine, 14(2), 427-40.
Mischiati, Carolina R, et al. "Intra and inter-rater reliability of screening for movement impairments: movement control tests from the foundation matrix." Journal of sports science & medicine vol. 14,2 (2015): 427-40.
Mischiati CR, Comerford M, Gosford E, Swart J, Ewings S, Botha N, Stokes M, Mottram SL. Intra and inter-rater reliability of screening for movement impairments: movement control tests from the foundation matrix. J Sports Sci Med. 2015 May 08;14(2):427-40. eCollection 2015 Jun. PMID: 25983594; PMCID: PMC4424474.
Copy Download .nbib Format: NLM
Share it on

J Sports Sci Med. 2015 May 08;14(2):427-40. eCollection 2015 Jun.

Intra and inter-rater reliability of screening for movement impairments: movement control tests from the foundation matrix.

Journal of sports science & medicine

Carolina R Mischiati, Mark Comerford, Emma Gosford, Jacqueline Swart, Sean Ewings, Nadine Botha, Maria Stokes, Sarah L Mottram

Affiliations

  1. Department of Sport and Exercise Sciences, University of Chichester , UK.
  2. Faculty of Health Sciences, University of Southampton , UK ; Movement Performance Solutions , Chichester, UK.
  3. Manage Movement Centre , Pretoria, South Afric.
  4. Southampton Statistical Sciences Research Institute, University of Southampton , UK.
  5. Faculty of Health Sciences, University of Southampton , UK ; Arthritis Research UK Centre for Sport, Exercise and Osteoarthritis , UK.
  6. Faculty of Health Sciences, University of Southampton , UK ; Movement Performance Solutions , Chichester, UK ; Arthritis Research UK Centre for Sport, Exercise and Osteoarthritis , UK.

PMID: 25983594 PMCID: PMC4424474

Abstract

Pre-season screening is well established within the sporting arena, and aims to enhance performance and reduce injury risk. With the increasing need to identify potential injury with greater accuracy, a new risk assessment process has been produced; The Performance Matrix (battery of movement control tests). As with any new method of objective testing, it is fundamental to establish whether the same results can be reproduced between examiners and by the same examiner on consecutive occasions. This study aimed to determine the intra-rater test re-test and inter-rater reliability of tests from a component of The Performance Matrix, The Foundation Matrix. Twenty participants were screened by two experienced musculoskeletal therapists using nine tests to assess the ability to control movement during specific tasks. Movement evaluation criteria for each test were rated as pass or fail. The therapists observed participants real-time and tests were recorded on video to enable repeated ratings four months later to examine intra-rater reliability (videos rated two weeks apart). Overall test percentage agreement was 87% for inter-rater reliability; 98% Rater 1, 94% Rater 2 for test re-test reliability; and 75% for real-time versus video. Intraclass-correlation coefficients (ICCs) were excellent between raters (0.81) and within raters (Rater 1, 0.96; Rater 2, 0.88) but poor for real-time versus video (0.23). Reliability for individual components of each test was more variable: inter-rater, 68-100%; intra-rater, 88-100% Rater 1, 75-100% Rater 2; and real-time versus video 31-100%. Cohen's Kappa values for inter-rater reliability were 0.0-1.0; intra-rater 0.6-1.0 for Rater 1; -0.1-1.0 for Rater 2; and -0.1-1 for real-time versus video. It is concluded that both inter and intra-rater reliability of tests in The Foundation Matrix are acceptable when rated by experienced therapists. Recommendations are made for modifying some of the criteria to improve reliability where excellence was not reached. Key pointsThe movement control tests of The Foundation Matrix had acceptable reliability between raters and within raters on different daysAgreement between observations made on tests performed real-time and on video recordings was low, indicating poor validity of use of video recordingsSome movement evaluation criteria related to specific tests that did not achieve excellent agreement could be modified to improve reliability.

Keywords: Movement control; movement impairments; reliability; screening

References

  1. N Am J Sports Phys Ther. 2006 May;1(2):62-72 - PubMed
  2. J Strength Cond Res. 2012 Feb;26(2):408-15 - PubMed
  3. J Strength Cond Res. 2013 Apr;27(4):978-81 - PubMed
  4. Scand J Med Sci Sports. 2012 Jun;22(3):306-15 - PubMed
  5. Inj Prev. 2002 Dec;8 Suppl 4:IV22-5 - PubMed
  6. Int J Sports Phys Ther. 2011 Jun;6(2):75-82 - PubMed
  7. J Orthop Sports Phys Ther. 2012 Jun;42(6):530-40 - PubMed
  8. Br J Sports Med. 2009 Aug;43(8):589-94 - PubMed
  9. Am J Sports Med. 2003 Nov-Dec;31(6):974-80 - PubMed
  10. Am J Sports Med. 2007 Jul;35(7):1123-30 - PubMed
  11. N Am J Sports Phys Ther. 2006 Aug;1(3):132-9 - PubMed
  12. BMC Musculoskelet Disord. 2007 Sep 12;8:90 - PubMed
  13. Man Ther. 2009 Dec;14(6):630-5 - PubMed
  14. Scand J Med Sci Sports. 2011 Apr;21(2):287-92 - PubMed
  15. Br J Sports Med. 2005 Jun;39(6):324-9 - PubMed
  16. Br J Sports Med. 2012 Mar;46(3):193-7 - PubMed
  17. Stat Med. 1998 Jan 15;17(1):101-10 - PubMed
  18. J Occup Med Toxicol. 2007 Apr 11;2:3 - PubMed
  19. J Sci Med Sport. 2015 May;18(3):353-7 - PubMed
  20. Sports Biomech. 2010 Nov;9(4):270-9 - PubMed
  21. J Clin Epidemiol. 1990;43(6):551-8 - PubMed
  22. Man Ther. 2007 Nov;12(4):298-309 - PubMed
  23. J Bodyw Mov Ther. 2014 Jul;18(3):477-81 - PubMed
  24. Phys Ther Sport. 2008 Feb;9(1):40-51 - PubMed
  25. J Strength Cond Res. 2013 Apr;27(4):982-7 - PubMed
  26. Int J Sports Phys Ther. 2014 Oct;9(5):583-95 - PubMed
  27. Am J Sports Med. 2008 Jun;36(6):1073-80 - PubMed
  28. Br J Sports Med. 2012 Mar;46(3):169-73 - PubMed
  29. Man Ther. 2005 Nov;10(4):242-55 - PubMed
  30. Clin J Sport Med. 2004 May;14(3):123-6 - PubMed
  31. Man Ther. 2009 Oct;14(5):555-61 - PubMed
  32. Am J Sports Med. 2006 Mar;34(3):471-5 - PubMed
  33. Clin J Pain. 2015 Feb;31(2):97-107 - PubMed
  34. J Orthop Sports Phys Ther. 2006 Dec;36(12):911-9 - PubMed
  35. J Orthop Sports Phys Ther. 2009 Sep;39(9):665-74 - PubMed
  36. N Am J Sports Phys Ther. 2007 Aug;2(3):147-58 - PubMed
  37. J Shoulder Elbow Surg. 2013 Apr;22(4):e11-9 - PubMed
  38. BMC Musculoskelet Disord. 2010 Nov 16;11:265 - PubMed
  39. Pain. 2009 Apr;142(3):183-8 - PubMed
  40. J Pain. 2001 Jun;2(3):135-45 - PubMed
  41. Phys Ther Sport. 2014 Aug;15(3):169-75 - PubMed
  42. Man Ther. 2001 Feb;6(1):15-26 - PubMed
  43. Spine (Phila Pa 1976). 1996 Nov 15;21(22):2640-50 - PubMed
  44. Sports Med Arthrosc Rehabil Ther Technol. 2010 Apr 23;2:11 - PubMed
  45. J Sports Sci. 2001 Oct;19(10 ):811-27 - PubMed
  46. Phys Ther. 2014 Jul;94(7):1034-42 - PubMed

Publication Types