Display options
Share it on

SAGE Open Med. 2015 May 13;3:2050312115585041. doi: 10.1177/2050312115585041. eCollection 2015.

Factor structure and measurement invariance of the Health Education Impact Questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences?.

SAGE open medicine

Gerald R Elsworth, Sandra Nolte, Richard H Osborne

Affiliations

  1. Public Health Innovation, Population Health Strategic Research Centre, Deakin University, Melbourne, VIC, Australia.
  2. Public Health Innovation, Population Health Strategic Research Centre, Deakin University, Melbourne, VIC, Australia; Medical Clinic, Department of Psychosomatic Medicine, Charité - Universitätsmedizin Berlin, Berlin, Germany.

PMID: 26770785 PMCID: PMC4679238 DOI: 10.1177/2050312115585041

Abstract

OBJECTIVE: On-going evidence is required to support the validity of inferences about change and group differences in the evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.

METHODS: An archived dataset of responses to the most recent version of the English-language Health Education Impact Questionnaire that uses four rather than six response options (N = 3221) was analysed using exploratory structural equation modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum constraints necessary for model identification.

RESULTS: The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).

CONCLUSION: The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre-post evaluation designs and system-level monitoring and evaluation.

Keywords: Health Education Impact Questionnaire; Health program evaluation; construct validation; measurement invariance; patient self-report measure

References

  1. Health Qual Life Outcomes. 2004 Mar 23;2:16 - PubMed
  2. Qual Life Res. 2013 Sep;22(7):1655-64 - PubMed
  3. PLoS One. 2014 Apr 18;9(4):e94367 - PubMed
  4. Patient Educ Couns. 2007 May;66(2):192-201 - PubMed
  5. Child Dev Perspect. 2010 Apr 1;4(1):10-18 - PubMed
  6. Arthritis Res Ther. 2011;13(5):R152 - PubMed
  7. Jpn J Nurs Sci. 2013 Dec;10(2):255-66 - PubMed
  8. Arthritis Rheum. 2006 Jun 15;55(3):458-65 - PubMed
  9. J Clin Epidemiol. 2009 Nov;62(11):1173-80 - PubMed
  10. Qual Life Res. 2005 Apr;14(3):587-98 - PubMed
  11. Br J Math Stat Psychol. 2007 Nov;60(Pt 2):201-16 - PubMed
  12. J Clin Epidemiol. 2015 Apr;68(4):360-9 - PubMed
  13. Nurs Clin North Am. 2011 Sep;46(3):255-70, v - PubMed
  14. Soc Sci Med. 1999 Jun;48(11):1531-48 - PubMed
  15. Health Qual Life Outcomes. 2004 Mar 15;2:14 - PubMed
  16. Qual Life Res. 2013 Aug;22(6):1391-403 - PubMed
  17. Psychol Assess. 2010 Sep;22(3):471-91 - PubMed
  18. Med Care. 2006 Nov;44(11 Suppl 3):S69-77 - PubMed
  19. Med Care. 2006 Nov;44(11 Suppl 3):S78-94 - PubMed
  20. Eval Program Plann. 2013 Feb;36(1):198-203 - PubMed

Publication Types