Collecting concurrent validity, expert-rater agreement, and inter/intra-rater reliability evidence for the FG-COMPASS

Abstract

Fundamental movement skills (FMS) are considered the building blocks for the development of specialized sport skills. In addition, fundamental movement skill competency has been linked to decreased levels of obesity and increased levels of physical activity/sport participation. Thus, assessing FMS development is crucial. This study aimed to collect evidence for concurrent validity, expert-rater agreement, and inter/intra rater reliability for the FG-COMPASS, a time-efficient FMS assessment tool. Participants were 34 children ages 5-10 years. Partial Pearson correlations comparing the scores of both tests indicate a moderate to strong correlation for locomotion (rxy.z =.52, p textless .01), object manipulation (rxy.z =.59, p textless .001), and total scores (rxy.z =.63, p textless .001). Expert-rater agreement was assessed by comparing the live scores of five raters with those of an expert. Inter-rater reliability was assessed by comparing the scores across the five raters. Intra- rater reliability was assessed by comparing each rater’s live scores to their video scores. Weighted kappa scores ranged from .51 to .83, .50 to .89, and .60 to .87 for expert-rater agreement, inter and intra rater reliability, respectively. These results provide further validity and reliability evidence for the FG-COMPASS. Further studies involving children with different ethnicity backgrounds and a larger sample size are recommended.

comments powered by Disqus

Related