Front Public Health. 2018 Jun 11;6:149. doi: 10.3389/fpubh.2018.00149. eCollection 2018.
Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer.
Frontiers in public health
Godfred O Boateng, Torsten B Neilands, Edward A Frongillo, Hugo R Melgar-Quiñonez, Sera L Young
Affiliations
Affiliations
- Department of Anthropology and Global Health, Northwestern University, Evanston, IL, United States.
- Division of Prevention Science, Department of Medicine, University of California, San Francisco, San Francisco, CA, United States.
- Department of Health Promotion, Education and Behavior, Arnold School of Public Health, University of South Carolina, Columbia, SC, United States.
- Institute for Global Food Security, School of Human Nutrition, McGill University, Montreal, QC, Canada.
- Institute for Policy Research, Northwestern University, Evanston, IL, United States.
PMID: 29942800
PMCID: PMC6004510 DOI: 10.3389/fpubh.2018.00149
Abstract
Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale development and evaluation can be onerous, jargon-filled, unfamiliar, and resource-intensive. Further, it is often not a part of graduate training. Therefore, our goal was to concisely review the process of scale development in as straightforward a manner as possible, both to facilitate the development of new, valid, and reliable scales, and to help improve existing ones. To do this, we have created a primer for best practices for scale development in measuring complex phenomena. This is not a systematic review, but rather the amalgamation of technical literature and lessons learned from our experiences spent creating or adapting a number of scales over the past several decades. We identified three phases that span nine steps. In the first phase, items are generated and the validity of their content is assessed. In the second phase, the scale is constructed. Steps in scale construction include pre-testing the questions, administering the survey, reducing the number of items, and understanding how many factors the scale captures. In the third phase, scale evaluation, the number of dimensions is tested, reliability is tested, and validity is assessed. We have also added examples of best practices to each step. In sum, this primer will equip both scientists and practitioners to understand the ontology and methodology of scale development and validation, thereby facilitating the advancement of our understanding of a range of health, social, and behavioral outcomes.
Keywords: content validity; factor analysis; item reduction; psychometric evaluation; scale development; tests of dimensionality; tests of reliability; tests of validity
References
- J Behav Med. 2007 Oct;30(5):359-70 - PubMed
- Qual Life Res. 2009 May;18(4):447-60 - PubMed
- J Biomed Inform. 2009 Apr;42(2):377-81 - PubMed
- J Nutr. 2006 May;136(5):1409S-1419S - PubMed
- Stat Med. 2002 Nov 30;21(22):3431-46 - PubMed
- J Nutr. 2008 Mar;138(3):587-92 - PubMed
- Psychol Bull. 1988 Mar;103(2):265-275 - PubMed
- Psychometrika. 1965 Jun;30:179-85 - PubMed
- Multivariate Behav Res. 2011 Apr 11;46(2):340-64 - PubMed
- BMC Health Serv Res. 2006 Apr 03;6:44 - PubMed
- Eval Rev. 2009 Oct;33(5):464-80 - PubMed
- Stat Methods Med Res. 2007 Jun;16(3):199-218 - PubMed
- Public Health Nutr. 2012 Jul;15(7):1182-9 - PubMed
- Psychol Bull. 1959 Mar;56(2):81-105 - PubMed
- Eur J Epidemiol. 1991 Jul;7(4):339-43 - PubMed
- Psychol Bull. 1993 Nov;114(3):552-66 - PubMed
- J Am Diet Assoc. 2008 Jul;108(7):1221-5 - PubMed
- Ann Acad Med Singapore. 2006 Feb;35(2):67-71 - PubMed
- BMC Psychiatry. 2014 Nov 22;14:303 - PubMed
- J Hum Lact. 1999 Sep;15(3):195-201 - PubMed
- Qual Life Res. 2007;16 Suppl 1:19-31 - PubMed
- Matern Child Nutr. 2018 Jul;14 (3):e12579 - PubMed
- West J Nurs Res. 2003 Aug;25(5):508-18 - PubMed
- J Consult Clin Psychol. 1988 Oct;56(5):754-61 - PubMed
- Clin Ther. 2014 May;36(5):648-62 - PubMed
- BMC Public Health. 2008 May 23;8:175 - PubMed
- Psychol Bull. 1990 Mar;107(2):238-46 - PubMed
- Multivariate Behav Res. 1966 Apr 1;1(2):245-76 - PubMed
- PLoS One. 2018 Jun 8;13(6):e0198591 - PubMed
- Midwifery. 2013 Jun;29(6):599-607 - PubMed
- J Obstet Gynecol Neonatal Nurs. 2003 Nov-Dec;32(6):734-44 - PubMed
- Res Nurs Health. 1999 Oct;22(5):399-409 - PubMed
- Soc Sci Med. 2016 May;157:127-37 - PubMed
- AIDS Educ Prev. 2002 Apr;14(2):158-71 - PubMed
- Br J Health Psychol. 2006 Sep;11(Pt 3):421-37 - PubMed
- JMIR Res Protoc. 2014 Jul 16;3(3):e38 - PubMed
- Public Health Nutr. 2015 Nov;18(16):2895-905 - PubMed
- J Pers Assess. 2010 Nov;92(6):544-59 - PubMed
- Psychol Methods. 2012 Sep;17(3):354-73 - PubMed
- Salud Publica Mex. 2005 Nov-Dec;47(6):413-22 - PubMed
- J Pers. 2012 Aug;80(4):796-846 - PubMed
- J Adolesc Health. 2002 Jul;31(1):26-30 - PubMed
- PLoS One. 2018 Feb 12;13(2):e0192394 - PubMed
- Comput Biol Med. 1990;20(5):337-40 - PubMed
- Multivariate Behav Res. 1979 Jan 1;14(1):57-74 - PubMed
- BMC Med Educ. 2009 Jul 07;9:40 - PubMed
- Nurs Res. 1986 Nov-Dec;35(6):382-5 - PubMed
- Int J Drug Policy. 2017 Oct;48:54-62 - PubMed
- J Sex Res. 2010 Jan;47(1):24-37 - PubMed
- J Strength Cond Res. 2005 Feb;19(1):231-40 - PubMed
Publication Types
Grant support