SAGE Open Med. 2015 May 13;3:2050312115585041. doi: 10.1177/2050312115585041. eCollection 2015.
Factor structure and measurement invariance of the Health Education Impact Questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences?.
SAGE open medicine
Gerald R Elsworth, Sandra Nolte, Richard H Osborne
Affiliations
Affiliations
- Public Health Innovation, Population Health Strategic Research Centre, Deakin University, Melbourne, VIC, Australia.
- Public Health Innovation, Population Health Strategic Research Centre, Deakin University, Melbourne, VIC, Australia; Medical Clinic, Department of Psychosomatic Medicine, Charité - Universitätsmedizin Berlin, Berlin, Germany.
PMID: 26770785
PMCID: PMC4679238 DOI: 10.1177/2050312115585041
Abstract
OBJECTIVE: On-going evidence is required to support the validity of inferences about change and group differences in the evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.
METHODS: An archived dataset of responses to the most recent version of the English-language Health Education Impact Questionnaire that uses four rather than six response options (N = 3221) was analysed using exploratory structural equation modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum constraints necessary for model identification.
RESULTS: The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).
CONCLUSION: The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre-post evaluation designs and system-level monitoring and evaluation.
Keywords: Health Education Impact Questionnaire; Health program evaluation; construct validation; measurement invariance; patient self-report measure
References
- Health Qual Life Outcomes. 2004 Mar 23;2:16 - PubMed
- Qual Life Res. 2013 Sep;22(7):1655-64 - PubMed
- PLoS One. 2014 Apr 18;9(4):e94367 - PubMed
- Patient Educ Couns. 2007 May;66(2):192-201 - PubMed
- Child Dev Perspect. 2010 Apr 1;4(1):10-18 - PubMed
- Arthritis Res Ther. 2011;13(5):R152 - PubMed
- Jpn J Nurs Sci. 2013 Dec;10(2):255-66 - PubMed
- Arthritis Rheum. 2006 Jun 15;55(3):458-65 - PubMed
- J Clin Epidemiol. 2009 Nov;62(11):1173-80 - PubMed
- Qual Life Res. 2005 Apr;14(3):587-98 - PubMed
- Br J Math Stat Psychol. 2007 Nov;60(Pt 2):201-16 - PubMed
- J Clin Epidemiol. 2015 Apr;68(4):360-9 - PubMed
- Nurs Clin North Am. 2011 Sep;46(3):255-70, v - PubMed
- Soc Sci Med. 1999 Jun;48(11):1531-48 - PubMed
- Health Qual Life Outcomes. 2004 Mar 15;2:14 - PubMed
- Qual Life Res. 2013 Aug;22(6):1391-403 - PubMed
- Psychol Assess. 2010 Sep;22(3):471-91 - PubMed
- Med Care. 2006 Nov;44(11 Suppl 3):S69-77 - PubMed
- Med Care. 2006 Nov;44(11 Suppl 3):S78-94 - PubMed
- Eval Program Plann. 2013 Feb;36(1):198-203 - PubMed
Publication Types