Display options
Share it on

J Med Internet Res. 2017 May 08;19(5):e155. doi: 10.2196/jmir.6714.

The Virtual Care Climate Questionnaire: Development and Validation of a Questionnaire Measuring Perceived Support for Autonomy in a Virtual Care Setting.

Journal of medical Internet research

Eline Suzanne Smit, Alexandra Lelia Dima, Stephanie Annette Maria Immerzeel, Bas van den Putte, Geoffrey Colin Williams

Affiliations

  1. Amsterdam School of Communication Research/ASCoR, Department of Communication Science, University of Amsterdam, Amsterdam, Netherlands.
  2. Health Services and Performance Research (HESPER EA 7425), University Claude Bernard Lyon 1, Lyon, France.
  3. Trimbos Institute, Netherlands Institute for Mental Health and Addiction, Utrecht, Netherlands.
  4. Department of Clinical and Social Sciences in Psychology, University of Rochester, Rochester, NY, United States.
  5. Healthy Living Center, Center for Community Health, Department of Medicine, University of Rochester, Rochester, NY, United States.

PMID: 28483743 PMCID: PMC5705912 DOI: 10.2196/jmir.6714

Abstract

BACKGROUND: Web-based health behavior change interventions may be more effective if they offer autonomy-supportive communication facilitating the internalization of motivation for health behavior change. Yet, at this moment no validated tools exist to assess user-perceived autonomy-support of such interventions.

OBJECTIVE: The aim of this study was to develop and validate the virtual climate care questionnaire (VCCQ), a measure of perceived autonomy-support in a virtual care setting.

METHODS: Items were developed based on existing questionnaires and expert consultation and were pretested among experts and target populations. The virtual climate care questionnaire was administered in relation to Web-based interventions aimed at reducing consumption of alcohol (Study 1; N=230) or cannabis (Study 2; N=228). Item properties, structural validity, and reliability were examined with item-response and classical test theory methods, and convergent and divergent validity via correlations with relevant concepts.

RESULTS: In Study 1, 20 of 23 items formed a one-dimensional scale (alpha=.97; omega=.97; H=.66; mean 4.9 [SD 1.0]; range 1-7) that met the assumptions of monotonicity and invariant item ordering. In Study 2, 16 items fitted these criteria (alpha=.92; H=.45; omega=.93; mean 4.2 [SD 1.1]; range 1-7). Only 15 items remained in the questionnaire in both studies, thus we proceeded to the analyses of the questionnaire's reliability and construct validity with a 15-item version of the virtual climate care questionnaire. Convergent validity of the resulting 15-item virtual climate care questionnaire was confirmed by positive associations with autonomous motivation (Study 1: r=.66, P<.001; Study 2: r=.37, P<.001) and perceived competence for reducing alcohol intake (Study 1: r=.52, P<.001). Divergent validity could only be confirmed by the nonsignificant association with perceived competence for learning (Study 2: r=.05, P=.48).

CONCLUSIONS: The virtual climate care questionnaire accurately assessed participants' perceived autonomy-support offered by two Web-based health behavior change interventions. Overall, the scale showed the expected properties and relationships with relevant concepts, and the studies presented suggest this first version of the virtual climate care questionnaire to be reasonably valid and reliable. As a result, the current version may cautiously be used in future research and practice to measure perceived support for autonomy within a virtual care climate. Future research efforts are required that focus on further investigating the virtual climate care questionnaire's divergent validity, on determining the virtual climate care questionnaire's validity and reliability when used in the context of Web-based interventions aimed at improving nonaddictive or other health behaviors, and on developing and validating a short form virtual climate care questionnaire.

©Eline Suzanne Smit, Alexandra Lelia Dima, Stephanie Annette Maria Immerzeel, Bas van den Putte, Geoffrey Colin Williams. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 08.05.2017.

Keywords: Internet; health behavior; health promotion; personal autonomy; psychometrics; questionnaire design; self-determination theory; validation studies

References

  1. J Med Internet Res. 2012 Jun 11;14(3):e82 - PubMed
  2. Health Educ Res. 2007 Oct;22(5):691-702 - PubMed
  3. Psychol Sport Exerc. 2011 Jan;12(1):13-19 - PubMed
  4. J Med Internet Res. 2014 Jan 27;16(1):e26 - PubMed
  5. J Public Health (Oxf). 2011 Dec;33(4):527-35 - PubMed
  6. Diabetes Care. 2014 Aug;37(8):e169-70 - PubMed
  7. Perspect Psychol Sci. 2012 Jul;7(4):325-40 - PubMed
  8. J Med Internet Res. 2010 Feb 17;12(1):e4 - PubMed
  9. Health Psychol. 2002 Jan;21(1):40-50 - PubMed
  10. J Pers Soc Psychol. 1996 Apr;70(4):767-79 - PubMed
  11. Int J Behav Nutr Phys Act. 2012 Jun 22;9:78 - PubMed
  12. Arch Pediatr Adolesc Med. 1999 Sep;153(9):959-64 - PubMed
  13. J Med Internet Res. 2013 Oct 02;15(10):e220 - PubMed
  14. Diabetes Care. 1998 Oct;21(10):1644-51 - PubMed
  15. J Med Internet Res. 2011 Jun 30;13(2):e43 - PubMed
  16. BMC Med Inform Decis Mak. 2015 Jul 09;15:51 - PubMed
  17. Br J Psychol. 2014 Aug;105(3):399-412 - PubMed
  18. Psychol Methods. 2009 Mar;14(1):6-23 - PubMed
  19. J Outcome Meas. 1999;3(2):103-22 - PubMed
  20. Am Psychol. 2000 Jan;55(1):68-78 - PubMed
  21. BMC Med Res Methodol. 2012 Jun 11;12:74 - PubMed
  22. J Med Internet Res. 2014 Mar 20;16(3):e91 - PubMed
  23. Educ Health (Abingdon). 2003 Jul;16(2):230 - PubMed
  24. J Pers. 1994 Mar;62(1):119-42 - PubMed
  25. J Med Internet Res. 2006 Jun 23;8(2):e10 - PubMed
  26. J Med Internet Res. 2013 Mar 14;15(3):e57 - PubMed

MeSH terms

Publication Types