The FMS is a great tool to uncover asymmetry and movement dysfunction in fitness clients as well as patients in the clinic who are ready to transition back to sport. I have been using this tool consistently for 2.5 years in my practice. One of the questions I have asked myself about the screening tool is how reliable is it?
Click here for an earlier post I wrote on this topic regarding what it tells us as practitioners. One of the challenges with any screen or test is not only validity but reliability. In the April edition of the Journal of Strength and Conditioning Research, we gain some new insight regarding intra and interrater reliability via 2 new articles.
The first article discusses a controlled laboratory study where repeated measures were used to investigate how experience using the FMS and clinical experience as an athletic trainer (AT) affects the intrarater reliability of FMS testing. The raters (17 men and 21 women who were recruited from the university’s athletic training clinical staff and academic programs), with different levels of FMS and clinical experience (AT students, AT or AT with at least 6 months experience using the FMS) viewed each of the 3 videotaped models.
None of the AT students or AT members had seen or used the FMS previously compared to the AT group with at least 6 months of experience. Each group rated the models on each of the FMS exercises according to the script presented by the lead investigator. A week later the raters watched the same videos again in a different randomized order and rated each model on each exercise.
The intersession scores were examined to establish intrarater reliability of all participants. In addition, the intrarater reliability of different groups of participants (students and clinicians) was compared to infer differences about the influence of clinical experience as an AT along with previous experience using the FMS.
- Average FMS score was 13.68 +/- 0.98
- There was moderate intrarater reliability was observed when all participants were analyzed
- The AT group with experience had the strongest intrarater reliability followed by the AT group (no experience)
- The AT students demonstrated poor reliability with a large 95% confidence interval
- Previous research by Minick et al. had established excellent agreement on all components of the FMS among expert and novice raters indicating strong interrater reliability, but authors point out that is first study to look at intrarater reliability
- This helps establish reliability of assessment giving more credibility to using it as an effective assessment tool
- All raters were either AT’s or AT senior undergraduate students - need to include other professionals in future studies to confidently apply the external validity of the results in this particular study
- Primary limitation of this study is the fact that video was used as opposed to live assessment
- Possessing clinical experience and experience with the FMS strengthens intrarater reliability so learning to use the tool with other experienced clinicians may be wise to improve validity