Content Validity and Inter-rater Reliability of the Assessment of Occupational Functioning- Collaborative Version
Date of Award
MOT Group Research Project
Master of Occupational Therapy
Christine Raber, PhD, OTR/L
Barbara Warnock, DHSc, OTR/L
Purpose: This psychometric study examined the content validity and inter-rater reliability of the Assessment of Occupational Functioning-Collaborative Version (AOF-CV) through content validity index and percent agreement, to determine clinical usefulness and alignment with the current version of the Model of Human Occupation (MOHO). Method: Data was gathered in two phases over four months. The first phase gathered inter-rater reliability through administering the AOF-CV virtually to college students. Percent agreement was determined using AOF-CV ratings completed by two teams of two raters per team. The second phase gathered content validity data from a MOHO content expert using a content validity index form and interview. Results: Nine participants completed the AOF-CV and follow-up interview. The overall interrater reliability was 84.35%, based on nine completed AOF-CV by four raters. Data analysis from participants, raters, and content expert focused on content validity and identified two themes: AOF-CV Administration aspects and AOF-CV Yield of Occupational Profile. Content expert rated AOF-CV items as representative of MOHO constructs (93%), with 90% of items demonstrating clarity. Conclusion: The results strengthen the existing evidence on inter-rater reliability and identified alignment with majority of current MOHO constructs. The AOF-CV can measure occupational functioning of young adults and effectively contribute to developing an occupational profile. Future research should address recommendations for revisions, use with other populations and continued psychometric research to support increased use of the AOF-CV in practice.
Keywords: occupational functioning; measurement; inter-rater reliability; content validity; Model of Human Occupation, assessment psychometrics.
Approval has been obtained for this item.
Deal,, Joanna R. B.S., S/OT; Legge,, Anna E. B.A., S/OT; Martens,, Kimberly M.E. B.S., S/OT; Rockwell,, Kyla M. B.A., S/OT; Russell,, Jacob A. B.S., S/OT; and Raber,, Christine PhD, OTR/L, "Content Validity and Inter-rater Reliability of the Assessment of Occupational Functioning- Collaborative Version" (2022). Occupational Therapy Research Projects. 2.
Available for download on Sunday, December 31, 2023