Display options
Share it on

Br J Educ Psychol. 2020 Mar;90(1):130-151. doi: 10.1111/bjep.12268. Epub 2019 Feb 11.

Measure reliability of the Perceived Competence and Social Acceptance for Children Scale via Rasch analysis.

The British journal of educational psychology

Brody Heritage, Vincent Mancini, Daniela Rigoli, Jan Piek

Affiliations

  1. Discipline of Psychology, Murdoch University, Perth, Western Australia, Australia.
  2. School of Psychology, Curtin University, Perth, Western Australia, Australia.

PMID: 30746693 DOI: 10.1111/bjep.12268

Abstract

BACKGROUND: The self-concept of children has an impact on later behavioural development and psychopathology; therefore, evidence of the accurate measurement of self-concept is important. Harter and Pike's (1984, Child Development, 55, 1969) commonly used measure of self-concept, the Pictorial Scale of Perceived Competence and Social Acceptance for Children, has demonstrated varying evidence of its construct validity and reliability, particularly with preschool- or kindergarten-aged participants.

AIM: To examine the measurement properties of the Acceptance and Competence measures, and to substantiate the measures' adequacy within the latter participant age range.

SAMPLE: One hundred and ninety-seven preschool or kindergarten-aged children (M = 5.40 years, SD = 0.30) provided data as part of the Animal Fun study over three measurement periods.

METHODS: The study conducted a pair of Rasch analyses on the Acceptance and Competence measures described prior, with adherence to the assumptions of univariate measurement, item fit, item invariance, and response category adequacy examined as part of these analyses.

RESULTS: While the Acceptance measure demonstrated adequate reliability outside of some potentially misfitting items, the study identified several limitations for the Competence measure, including potential gender-based and verbal IQ-based response biases.

CONCLUSIONS: Practitioners and research applications of these subscales may benefit from the response recoding recommendations provided in this study for the Acceptance measure, as they improved the measure's properties. The study provides potential solutions to item adequacy concerns, and avenues for future research, involving these measures.

© 2019 The British Psychological Society.

Keywords: acceptance; competence; measurement; psychometrics; reliability; self concept; validity

References

  1. Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA preschool forms and profiles. Burlington, VT: University of Vermont Department of Psychiatry. - PubMed
  2. Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573. https://doi.org/10.1007/bf02293814 - PubMed
  3. Baylor, C., Hula, W., Donovan, N. J., Doyle, P. J., Kendall, D., & Yorkston, K. (2011). An introduction to item response theory and Rasch models for speech-language pathologists. American Journal of Speech-Language Pathology, 20, 243-259. https://doi.org/10.1044/1058-0360(2011/10-0079) - PubMed
  4. Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge. - PubMed
  5. Bowlby, J. (1969). Attachment and loss: Vol. 1. Attachment. New York, NY: Basic Books. - PubMed
  6. Bowlby, J. (1973). Attachment and loss: Vol. 2. Separation. New York, NY: Basic Books. - PubMed
  7. Byrne, B. M. (1996). Measuring self-concept across the life span: Issues and instrumentation. Washington, DC: American Psychological Association. - PubMed
  8. Crane, J. R., Foley, J. T., Naylor, P.-J., & Temple, V. A. (2017). Longitudinal change in the relationship between fundamental motor skills and perceived competence: Kindergarten to grade 2. Sports, 5(3), 59. https://doi.org/10.3390/sports5030059 - PubMed
  9. De Jong, P., Sportel, B., De Hullu, E., & Nauta, M. (2012). Co-occurrence of social anxiety and depression symptoms in adolescence: Differential links with implicit and explicit self-esteem? Psychological Medicine, 42, 475-484. https://doi.org/10.1017/s0033291711001358 - PubMed
  10. Eccles, J., Wigfield, A., Harold, R. D., & Blumenfeld, P. (1993). Age and gender differences in children's self-and task perceptions during elementary school. Child Development, 64, 830-847. https://doi.org/10.2307/1131221 - PubMed
  11. El Hassan, K. (1999). Validation of the Harter pictorial scale of perceived competence and social acceptance with Lebanese children. Social Behavior and Personality: An International Journal, 27, 339-353. https://doi.org/10.2224/sbp.1999.27.4.339 - PubMed
  12. Fantuzzo, J. W., McDermott, P. A., Manz, P. H., Hampton, V. R., & Burdick, N. A. (1996). The pictorial scale of perceived competence and social acceptance: Does it work with low-income urban children? Child Development, 67, 1071-1084. https://doi.org/10.2307/1131880 - PubMed
  13. Fortus, D., & Vedder-Weiss, D. (2014). Measuring students’ continuing motivation for science learning. Journal of Research in Science Teaching, 51, 497-522. https://doi.org/10.1002/tea.21136 - PubMed
  14. Franck, E., De Raedt, R., Dereu, M., & Van den Abbeele, D. (2007). Implicit and explicit self-esteem in currently depressed individuals with and without suicidal ideation. Journal of Behavior Therapy and Experimental Psychiatry, 38(1), 75-85. https://doi.org/10.1016/j.jbtep.2006.05.003 - PubMed
  15. Gallahue, D. L., & Ozmun, J. C. (1998). Understanding motor development: Infants, children, adolescents, adults (4th ed.). Boston, MA: McGraw Hill. - PubMed
  16. Gresham, F., & Elliot, S. (1990). Manual for the social skills rating system. Circle Pines, MN: American Guidance Service. - PubMed
  17. Guay, F., Marsh, H. W., & Boivin, M. (2003). Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology, 95(1), 124. https://doi.org/10.1037//0022-0663.95.1.124 - PubMed
  18. Harter, S. (1982). The perceived competence scale for children. Child Development, 53, 87-97. https://doi.org/10.2307/1129640 - PubMed
  19. Harter, S. (1985). Manual for the self-perception profile for children. Denver, CO: University of Denver. - PubMed
  20. Harter, S. (2012). Emerging self-processes during childhood and adolescence. In M. R. Leary & J. P. Tangney (Eds.), Handbook of self and identity (pp. 680-715). New York, NY: Guilford Press. - PubMed
  21. Harter, S., & Pike, R. (1984). The pictorial scale of perceived competence and social acceptance for young children. Child Development, 55, 1969-1982. https://doi.org/10.2307/1129772 - PubMed
  22. Hattie, J. A. (1992). Self-concept. Hillsdale, NJ: Lawrence Erlbaum. - PubMed
  23. Hertsberg, N., & Zebrowski, P. M. (2016). Self-perceived competence and social acceptance of young children who stutter: Initial findings. Journal of Communication Disorders, 64, 18-31. https://doi.org/10.1016/j.jcomdis.2016.08.004 - PubMed
  24. Horn, T. S. (2004). Developmental perspectives on self-perceptions in children and adolescents. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 101-143). Morgantown, WV: Fitness Information Technology. - PubMed
  25. Isabella, R. A., & Diener, M. L. (2010). Self-representations of social and academic competence: Contextual correlates in middle childhood. Journal of Research in Childhood Education, 24, 315-331. https://doi.org/10.1080/02568543.2010.510082 - PubMed
  26. Jacobs, J. E., Lanza, S., Osgood, D. W., Eccles, J. S., & Wigfield, A. (2002). Changes in children's self-competence and values: Gender and domain differences across grades one through twelve. Child Development, 73, 509-527. https://doi.org/10.1111/1467-8624.00421 - PubMed
  27. Lamb, R. L., Vallett, D., & Annetta, L. (2014). Development of a short-form measure of science and technology self-efficacy using Rasch analysis. Journal of Science Education and Technology, 23, 641-657. https://doi.org/10.1007/s10956-014-9491-y - PubMed
  28. Leeuwis, F. H., Koot, H. M., Creemers, D. H., & van Lier, P. A. (2015). Implicit and explicit self-esteem discrepancies, victimization and the development of late childhood internalizing problems. Journal of Abnormal Child Psychology, 43, 909-919. https://doi.org/10.1007/s10802-014-9959-5 - PubMed
  29. Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328. Retrieved from https://www.rasch.org/rmt/ - PubMed
  30. Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3, 85-106. Retrieved from http://jampress.org/ - PubMed
  31. Linacre, J. M. (2017a). Winsteps (Version 4.0.1) [Computer software]. Beaverton, OR: Winsteps.com. - PubMed
  32. Mallinson, T. (2011). Rasch analysis of repeated measures. Rasch Measurement Transactions, 251(1), 1317. Retrieved from https://www.rasch.org/rmt/ - PubMed
  33. Mancini, V. O., Rigoli, D., Roberts, L. D., Heritage, B., & Piek, J. P. (2017). The relationship between motor skills and psychosocial factors in young children: A test of the elaborated environmental stress hypothesis. British Journal of Educational Psychology, 88, 363-379. https://doi.org/10.1111/bjep.12187 - PubMed
  34. Mantzicopoulos, P., French, B. F., & Maller, S. J. (2004). Factor structure of the pictorial scale of perceived competence and social acceptance with two pre-elementary samples. Child Development, 75, 1214-1228. https://doi.org/10.1111/j.1467-8624.2004.00734.x - PubMed
  35. Marsh, H. W., Ellis, L. A., & Craven, R. G. (2002). How do preschool children feel about themselves? Unraveling measurement and multidimensional self-concept structure. Developmental Psychology, 38, 376-393. https://doi.org/10.1037//0012-1649.38.3.376 - PubMed
  36. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174. https://doi.org/10.1007/bf02296272 - PubMed
  37. Mayer, D., Sodian, B., Koerber, S., & Schwippert, K. (2014). Scientific reasoning in elementary school children: Assessment and relations with cognitive abilities. Learning and Instruction, 29, 43-55. https://doi.org/10.1016/j.learninstruc.2013.07.005 - PubMed
  38. Meijer, R. R., Egberink, I. J., Emons, W. H., & Sijtsma, K. (2008). Detection and validation of unscalable item score patterns using item response theory: An illustration with Harter's self-perception profile for children. Journal of Personality Assessment, 90, 227-238. https://doi.org/10.1080/00223890701884921 - PubMed
  39. Müller, E., Seiler, C. W., Perren, S., & Simoni, H. (2015). Young children's self-perceived ability: Development, factor structure and initial validation of a self-report instrument for preschoolers. Journal of Psychopathology and Behavioral Assessment, 37, 256-273. https://doi.org/10.1007/s10862-014-9447-9 - PubMed
  40. Nguyen, T. H., Han, H.-R., Kim, M. T., & Chan, K. S. (2014). An introduction to item response theory for patient-reported outcome measurement. The Patient, 7(1), 23-35. https://doi.org/10.1007/s40271-013-0041-0 - PubMed
  41. Noordstar, J. J., van der Net, J., Jak, S., Helders, P. J., & Jongmans, M. J. (2016). Global self-esteem, perceived athletic competence, and physical activity in children: A longitudinal cohort study. Psychology of Sport and Exercise, 22, 83-90. https://doi.org/10.1016/j.psychsport.2015.06.009 - PubMed
  42. O'Neill, T., Peabody, M., Tan, R. J. B., & Du, Y. (2013). How much item drift is too much? Rasch Measurement Transactions, 27, 1423-1424. Retrieved from https://www.rasch.org/rmt/ - PubMed
  43. Piek, J. P., Kane, R., Rigoli, D., McLaren, S., Roberts, C. M., Rooney, R., … Straker, L. (2015). Does the animal Fun program improve social-emotional and behavioural outcomes in children aged 4-6 years? Human Movement Science, 43, 155-163. https://doi.org/10.1016/j.humov.2015.08.004 - PubMed
  44. Piek, J. P., McLaren, S., Kane, R., Jensen, L., Dender, A., Roberts, C., … Straker, L. (2013). Does the animal Fun program improve motor performance in children aged 4-6 years? Human Movement Science, 32, 1086-1096. https://doi.org/10.1016/j.humov.2012.08.004 - PubMed
  45. Piek, J. P., Straker, L. M., Jensen, L., Dender, A., Barrett, N. C., McLaren, S., … Bradbury, G. (2010). Rationale, design and methods for a randomised and controlled trial to evaluate “Animal Fun” - a program designed to enhance physical and mental health in young children. BMC Pediatrics, 10(78), 1-10. https://doi.org/10.1186/1471-2431-10-78 - PubMed
  46. Plummer, J. D., & Maynard, L. (2014). Building a learning progression for celestial motion: An exploration of students’ reasoning about the seasons. Journal of Research in Science Teaching, 51, 902-929. https://doi.org/10.1002/tea.21151 - PubMed
  47. Psouni, E., Di Folco, S., & Zavattini, G. C. (2015). Scripted secure base knowledge and its relation to perceived social acceptance and competence in early middle childhood. Scandinavian Journal of Psychology, 56, 341-348. https://doi.org/10.1111/sjop.12208 - PubMed
  48. Samejima, F. (1997). The graded response model. Handbook of modern item response theory (pp. 85-100). New York, NY: Springer. - PubMed
  49. Sowislo, J. F., & Orth, U. (2013). Does low self-esteem predict depression and anxiety? A meta-analysis of longitudinal studies. Psychological Bulletin, 139(1), 213-240. https://doi.org/10.1037/a0028931 - PubMed
  50. Stodden, D. F., Goodway, J. D., Langendorfer, S. J., Roberton, M. A., Rudisill, M. E., Garcia, C., & Garcia, L. E. (2008). A developmental perspective on the role of motor skill competence in physical activity: An emergent relationship. Quest, 60(2), 290-306. https://doi.org/10.1080/00336297.2008.10483582 - PubMed
  51. Wechsler, D. (2002). WPPSI-III administration and scoring manual. San Antonio, TX: Psychological Corporation. - PubMed
  52. Zwick, R., Thayer, D. T., & Lewis, C. (1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36(1), 1-28. https://doi.org/10.1111/j.1745-3984.1999.tb00543.x - PubMed

MeSH terms

Publication Types