Display options
Share it on

Front Public Health. 2018 Jun 11;6:149. doi: 10.3389/fpubh.2018.00149. eCollection 2018.

Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer.

Frontiers in public health

Godfred O Boateng, Torsten B Neilands, Edward A Frongillo, Hugo R Melgar-Quiñonez, Sera L Young

Affiliations

  1. Department of Anthropology and Global Health, Northwestern University, Evanston, IL, United States.
  2. Division of Prevention Science, Department of Medicine, University of California, San Francisco, San Francisco, CA, United States.
  3. Department of Health Promotion, Education and Behavior, Arnold School of Public Health, University of South Carolina, Columbia, SC, United States.
  4. Institute for Global Food Security, School of Human Nutrition, McGill University, Montreal, QC, Canada.
  5. Institute for Policy Research, Northwestern University, Evanston, IL, United States.

PMID: 29942800 PMCID: PMC6004510 DOI: 10.3389/fpubh.2018.00149

Abstract

Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale development and evaluation can be onerous, jargon-filled, unfamiliar, and resource-intensive. Further, it is often not a part of graduate training. Therefore, our goal was to concisely review the process of scale development in as straightforward a manner as possible, both to facilitate the development of new, valid, and reliable scales, and to help improve existing ones. To do this, we have created a primer for best practices for scale development in measuring complex phenomena. This is not a systematic review, but rather the amalgamation of technical literature and lessons learned from our experiences spent creating or adapting a number of scales over the past several decades. We identified three phases that span nine steps. In the first phase, items are generated and the validity of their content is assessed. In the second phase, the scale is constructed. Steps in scale construction include pre-testing the questions, administering the survey, reducing the number of items, and understanding how many factors the scale captures. In the third phase, scale evaluation, the number of dimensions is tested, reliability is tested, and validity is assessed. We have also added examples of best practices to each step. In sum, this primer will equip both scientists and practitioners to understand the ontology and methodology of scale development and validation, thereby facilitating the advancement of our understanding of a range of health, social, and behavioral outcomes.

Keywords: content validity; factor analysis; item reduction; psychometric evaluation; scale development; tests of dimensionality; tests of reliability; tests of validity

References

  1. J Behav Med. 2007 Oct;30(5):359-70 - PubMed
  2. Qual Life Res. 2009 May;18(4):447-60 - PubMed
  3. J Biomed Inform. 2009 Apr;42(2):377-81 - PubMed
  4. J Nutr. 2006 May;136(5):1409S-1419S - PubMed
  5. Stat Med. 2002 Nov 30;21(22):3431-46 - PubMed
  6. J Nutr. 2008 Mar;138(3):587-92 - PubMed
  7. Psychol Bull. 1988 Mar;103(2):265-275 - PubMed
  8. Psychometrika. 1965 Jun;30:179-85 - PubMed
  9. Multivariate Behav Res. 2011 Apr 11;46(2):340-64 - PubMed
  10. BMC Health Serv Res. 2006 Apr 03;6:44 - PubMed
  11. Eval Rev. 2009 Oct;33(5):464-80 - PubMed
  12. Stat Methods Med Res. 2007 Jun;16(3):199-218 - PubMed
  13. Public Health Nutr. 2012 Jul;15(7):1182-9 - PubMed
  14. Psychol Bull. 1959 Mar;56(2):81-105 - PubMed
  15. Eur J Epidemiol. 1991 Jul;7(4):339-43 - PubMed
  16. Psychol Bull. 1993 Nov;114(3):552-66 - PubMed
  17. J Am Diet Assoc. 2008 Jul;108(7):1221-5 - PubMed
  18. Ann Acad Med Singapore. 2006 Feb;35(2):67-71 - PubMed
  19. BMC Psychiatry. 2014 Nov 22;14:303 - PubMed
  20. J Hum Lact. 1999 Sep;15(3):195-201 - PubMed
  21. Qual Life Res. 2007;16 Suppl 1:19-31 - PubMed
  22. Matern Child Nutr. 2018 Jul;14 (3):e12579 - PubMed
  23. West J Nurs Res. 2003 Aug;25(5):508-18 - PubMed
  24. J Consult Clin Psychol. 1988 Oct;56(5):754-61 - PubMed
  25. Clin Ther. 2014 May;36(5):648-62 - PubMed
  26. BMC Public Health. 2008 May 23;8:175 - PubMed
  27. Psychol Bull. 1990 Mar;107(2):238-46 - PubMed
  28. Multivariate Behav Res. 1966 Apr 1;1(2):245-76 - PubMed
  29. PLoS One. 2018 Jun 8;13(6):e0198591 - PubMed
  30. Midwifery. 2013 Jun;29(6):599-607 - PubMed
  31. J Obstet Gynecol Neonatal Nurs. 2003 Nov-Dec;32(6):734-44 - PubMed
  32. Res Nurs Health. 1999 Oct;22(5):399-409 - PubMed
  33. Soc Sci Med. 2016 May;157:127-37 - PubMed
  34. AIDS Educ Prev. 2002 Apr;14(2):158-71 - PubMed
  35. Br J Health Psychol. 2006 Sep;11(Pt 3):421-37 - PubMed
  36. JMIR Res Protoc. 2014 Jul 16;3(3):e38 - PubMed
  37. Public Health Nutr. 2015 Nov;18(16):2895-905 - PubMed
  38. J Pers Assess. 2010 Nov;92(6):544-59 - PubMed
  39. Psychol Methods. 2012 Sep;17(3):354-73 - PubMed
  40. Salud Publica Mex. 2005 Nov-Dec;47(6):413-22 - PubMed
  41. J Pers. 2012 Aug;80(4):796-846 - PubMed
  42. J Adolesc Health. 2002 Jul;31(1):26-30 - PubMed
  43. PLoS One. 2018 Feb 12;13(2):e0192394 - PubMed
  44. Comput Biol Med. 1990;20(5):337-40 - PubMed
  45. Multivariate Behav Res. 1979 Jan 1;14(1):57-74 - PubMed
  46. BMC Med Educ. 2009 Jul 07;9:40 - PubMed
  47. Nurs Res. 1986 Nov-Dec;35(6):382-5 - PubMed
  48. Int J Drug Policy. 2017 Oct;48:54-62 - PubMed
  49. J Sex Res. 2010 Jan;47(1):24-37 - PubMed
  50. J Strength Cond Res. 2005 Feb;19(1):231-40 - PubMed

Publication Types

Grant support