Br J Educ Psychol. 2020 Mar;90(1):130-151. doi: 10.1111/bjep.12268. Epub 2019 Feb 11.
Measure reliability of the Perceived Competence and Social Acceptance for Children Scale via Rasch analysis.
The British journal of educational psychology
Brody Heritage, Vincent Mancini, Daniela Rigoli, Jan Piek
Affiliations
Affiliations
- Discipline of Psychology, Murdoch University, Perth, Western Australia, Australia.
- School of Psychology, Curtin University, Perth, Western Australia, Australia.
PMID: 30746693
DOI: 10.1111/bjep.12268
Abstract
BACKGROUND: The self-concept of children has an impact on later behavioural development and psychopathology; therefore, evidence of the accurate measurement of self-concept is important. Harter and Pike's (1984, Child Development, 55, 1969) commonly used measure of self-concept, the Pictorial Scale of Perceived Competence and Social Acceptance for Children, has demonstrated varying evidence of its construct validity and reliability, particularly with preschool- or kindergarten-aged participants.
AIM: To examine the measurement properties of the Acceptance and Competence measures, and to substantiate the measures' adequacy within the latter participant age range.
SAMPLE: One hundred and ninety-seven preschool or kindergarten-aged children (M = 5.40 years, SD = 0.30) provided data as part of the Animal Fun study over three measurement periods.
METHODS: The study conducted a pair of Rasch analyses on the Acceptance and Competence measures described prior, with adherence to the assumptions of univariate measurement, item fit, item invariance, and response category adequacy examined as part of these analyses.
RESULTS: While the Acceptance measure demonstrated adequate reliability outside of some potentially misfitting items, the study identified several limitations for the Competence measure, including potential gender-based and verbal IQ-based response biases.
CONCLUSIONS: Practitioners and research applications of these subscales may benefit from the response recoding recommendations provided in this study for the Acceptance measure, as they improved the measure's properties. The study provides potential solutions to item adequacy concerns, and avenues for future research, involving these measures.
© 2019 The British Psychological Society.
Keywords: acceptance; competence; measurement; psychometrics; reliability; self concept; validity
References
- Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA preschool forms and profiles. Burlington, VT: University of Vermont Department of Psychiatry. - PubMed
- Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573. https://doi.org/10.1007/bf02293814 - PubMed
- Baylor, C., Hula, W., Donovan, N. J., Doyle, P. J., Kendall, D., & Yorkston, K. (2011). An introduction to item response theory and Rasch models for speech-language pathologists. American Journal of Speech-Language Pathology, 20, 243-259. https://doi.org/10.1044/1058-0360(2011/10-0079) - PubMed
- Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge. - PubMed
- Bowlby, J. (1969). Attachment and loss: Vol. 1. Attachment. New York, NY: Basic Books. - PubMed
- Bowlby, J. (1973). Attachment and loss: Vol. 2. Separation. New York, NY: Basic Books. - PubMed
- Byrne, B. M. (1996). Measuring self-concept across the life span: Issues and instrumentation. Washington, DC: American Psychological Association. - PubMed
- Crane, J. R., Foley, J. T., Naylor, P.-J., & Temple, V. A. (2017). Longitudinal change in the relationship between fundamental motor skills and perceived competence: Kindergarten to grade 2. Sports, 5(3), 59. https://doi.org/10.3390/sports5030059 - PubMed
- De Jong, P., Sportel, B., De Hullu, E., & Nauta, M. (2012). Co-occurrence of social anxiety and depression symptoms in adolescence: Differential links with implicit and explicit self-esteem? Psychological Medicine, 42, 475-484. https://doi.org/10.1017/s0033291711001358 - PubMed
- Eccles, J., Wigfield, A., Harold, R. D., & Blumenfeld, P. (1993). Age and gender differences in children's self-and task perceptions during elementary school. Child Development, 64, 830-847. https://doi.org/10.2307/1131221 - PubMed
- El Hassan, K. (1999). Validation of the Harter pictorial scale of perceived competence and social acceptance with Lebanese children. Social Behavior and Personality: An International Journal, 27, 339-353. https://doi.org/10.2224/sbp.1999.27.4.339 - PubMed
- Fantuzzo, J. W., McDermott, P. A., Manz, P. H., Hampton, V. R., & Burdick, N. A. (1996). The pictorial scale of perceived competence and social acceptance: Does it work with low-income urban children? Child Development, 67, 1071-1084. https://doi.org/10.2307/1131880 - PubMed
- Fortus, D., & Vedder-Weiss, D. (2014). Measuring students’ continuing motivation for science learning. Journal of Research in Science Teaching, 51, 497-522. https://doi.org/10.1002/tea.21136 - PubMed
- Franck, E., De Raedt, R., Dereu, M., & Van den Abbeele, D. (2007). Implicit and explicit self-esteem in currently depressed individuals with and without suicidal ideation. Journal of Behavior Therapy and Experimental Psychiatry, 38(1), 75-85. https://doi.org/10.1016/j.jbtep.2006.05.003 - PubMed
- Gallahue, D. L., & Ozmun, J. C. (1998). Understanding motor development: Infants, children, adolescents, adults (4th ed.). Boston, MA: McGraw Hill. - PubMed
- Gresham, F., & Elliot, S. (1990). Manual for the social skills rating system. Circle Pines, MN: American Guidance Service. - PubMed
- Guay, F., Marsh, H. W., & Boivin, M. (2003). Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology, 95(1), 124. https://doi.org/10.1037//0022-0663.95.1.124 - PubMed
- Harter, S. (1982). The perceived competence scale for children. Child Development, 53, 87-97. https://doi.org/10.2307/1129640 - PubMed
- Harter, S. (1985). Manual for the self-perception profile for children. Denver, CO: University of Denver. - PubMed
- Harter, S. (2012). Emerging self-processes during childhood and adolescence. In M. R. Leary & J. P. Tangney (Eds.), Handbook of self and identity (pp. 680-715). New York, NY: Guilford Press. - PubMed
- Harter, S., & Pike, R. (1984). The pictorial scale of perceived competence and social acceptance for young children. Child Development, 55, 1969-1982. https://doi.org/10.2307/1129772 - PubMed
- Hattie, J. A. (1992). Self-concept. Hillsdale, NJ: Lawrence Erlbaum. - PubMed
- Hertsberg, N., & Zebrowski, P. M. (2016). Self-perceived competence and social acceptance of young children who stutter: Initial findings. Journal of Communication Disorders, 64, 18-31. https://doi.org/10.1016/j.jcomdis.2016.08.004 - PubMed
- Horn, T. S. (2004). Developmental perspectives on self-perceptions in children and adolescents. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 101-143). Morgantown, WV: Fitness Information Technology. - PubMed
- Isabella, R. A., & Diener, M. L. (2010). Self-representations of social and academic competence: Contextual correlates in middle childhood. Journal of Research in Childhood Education, 24, 315-331. https://doi.org/10.1080/02568543.2010.510082 - PubMed
- Jacobs, J. E., Lanza, S., Osgood, D. W., Eccles, J. S., & Wigfield, A. (2002). Changes in children's self-competence and values: Gender and domain differences across grades one through twelve. Child Development, 73, 509-527. https://doi.org/10.1111/1467-8624.00421 - PubMed
- Lamb, R. L., Vallett, D., & Annetta, L. (2014). Development of a short-form measure of science and technology self-efficacy using Rasch analysis. Journal of Science Education and Technology, 23, 641-657. https://doi.org/10.1007/s10956-014-9491-y - PubMed
- Leeuwis, F. H., Koot, H. M., Creemers, D. H., & van Lier, P. A. (2015). Implicit and explicit self-esteem discrepancies, victimization and the development of late childhood internalizing problems. Journal of Abnormal Child Psychology, 43, 909-919. https://doi.org/10.1007/s10802-014-9959-5 - PubMed
- Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328. Retrieved from https://www.rasch.org/rmt/ - PubMed
- Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3, 85-106. Retrieved from http://jampress.org/ - PubMed
- Linacre, J. M. (2017a). Winsteps (Version 4.0.1) [Computer software]. Beaverton, OR: Winsteps.com. - PubMed
- Mallinson, T. (2011). Rasch analysis of repeated measures. Rasch Measurement Transactions, 251(1), 1317. Retrieved from https://www.rasch.org/rmt/ - PubMed
- Mancini, V. O., Rigoli, D., Roberts, L. D., Heritage, B., & Piek, J. P. (2017). The relationship between motor skills and psychosocial factors in young children: A test of the elaborated environmental stress hypothesis. British Journal of Educational Psychology, 88, 363-379. https://doi.org/10.1111/bjep.12187 - PubMed
- Mantzicopoulos, P., French, B. F., & Maller, S. J. (2004). Factor structure of the pictorial scale of perceived competence and social acceptance with two pre-elementary samples. Child Development, 75, 1214-1228. https://doi.org/10.1111/j.1467-8624.2004.00734.x - PubMed
- Marsh, H. W., Ellis, L. A., & Craven, R. G. (2002). How do preschool children feel about themselves? Unraveling measurement and multidimensional self-concept structure. Developmental Psychology, 38, 376-393. https://doi.org/10.1037//0012-1649.38.3.376 - PubMed
- Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174. https://doi.org/10.1007/bf02296272 - PubMed
- Mayer, D., Sodian, B., Koerber, S., & Schwippert, K. (2014). Scientific reasoning in elementary school children: Assessment and relations with cognitive abilities. Learning and Instruction, 29, 43-55. https://doi.org/10.1016/j.learninstruc.2013.07.005 - PubMed
- Meijer, R. R., Egberink, I. J., Emons, W. H., & Sijtsma, K. (2008). Detection and validation of unscalable item score patterns using item response theory: An illustration with Harter's self-perception profile for children. Journal of Personality Assessment, 90, 227-238. https://doi.org/10.1080/00223890701884921 - PubMed
- Müller, E., Seiler, C. W., Perren, S., & Simoni, H. (2015). Young children's self-perceived ability: Development, factor structure and initial validation of a self-report instrument for preschoolers. Journal of Psychopathology and Behavioral Assessment, 37, 256-273. https://doi.org/10.1007/s10862-014-9447-9 - PubMed
- Nguyen, T. H., Han, H.-R., Kim, M. T., & Chan, K. S. (2014). An introduction to item response theory for patient-reported outcome measurement. The Patient, 7(1), 23-35. https://doi.org/10.1007/s40271-013-0041-0 - PubMed
- Noordstar, J. J., van der Net, J., Jak, S., Helders, P. J., & Jongmans, M. J. (2016). Global self-esteem, perceived athletic competence, and physical activity in children: A longitudinal cohort study. Psychology of Sport and Exercise, 22, 83-90. https://doi.org/10.1016/j.psychsport.2015.06.009 - PubMed
- O'Neill, T., Peabody, M., Tan, R. J. B., & Du, Y. (2013). How much item drift is too much? Rasch Measurement Transactions, 27, 1423-1424. Retrieved from https://www.rasch.org/rmt/ - PubMed
- Piek, J. P., Kane, R., Rigoli, D., McLaren, S., Roberts, C. M., Rooney, R., … Straker, L. (2015). Does the animal Fun program improve social-emotional and behavioural outcomes in children aged 4-6 years? Human Movement Science, 43, 155-163. https://doi.org/10.1016/j.humov.2015.08.004 - PubMed
- Piek, J. P., McLaren, S., Kane, R., Jensen, L., Dender, A., Roberts, C., … Straker, L. (2013). Does the animal Fun program improve motor performance in children aged 4-6 years? Human Movement Science, 32, 1086-1096. https://doi.org/10.1016/j.humov.2012.08.004 - PubMed
- Piek, J. P., Straker, L. M., Jensen, L., Dender, A., Barrett, N. C., McLaren, S., … Bradbury, G. (2010). Rationale, design and methods for a randomised and controlled trial to evaluate “Animal Fun” - a program designed to enhance physical and mental health in young children. BMC Pediatrics, 10(78), 1-10. https://doi.org/10.1186/1471-2431-10-78 - PubMed
- Plummer, J. D., & Maynard, L. (2014). Building a learning progression for celestial motion: An exploration of students’ reasoning about the seasons. Journal of Research in Science Teaching, 51, 902-929. https://doi.org/10.1002/tea.21151 - PubMed
- Psouni, E., Di Folco, S., & Zavattini, G. C. (2015). Scripted secure base knowledge and its relation to perceived social acceptance and competence in early middle childhood. Scandinavian Journal of Psychology, 56, 341-348. https://doi.org/10.1111/sjop.12208 - PubMed
- Samejima, F. (1997). The graded response model. Handbook of modern item response theory (pp. 85-100). New York, NY: Springer. - PubMed
- Sowislo, J. F., & Orth, U. (2013). Does low self-esteem predict depression and anxiety? A meta-analysis of longitudinal studies. Psychological Bulletin, 139(1), 213-240. https://doi.org/10.1037/a0028931 - PubMed
- Stodden, D. F., Goodway, J. D., Langendorfer, S. J., Roberton, M. A., Rudisill, M. E., Garcia, C., & Garcia, L. E. (2008). A developmental perspective on the role of motor skill competence in physical activity: An emergent relationship. Quest, 60(2), 290-306. https://doi.org/10.1080/00336297.2008.10483582 - PubMed
- Wechsler, D. (2002). WPPSI-III administration and scoring manual. San Antonio, TX: Psychological Corporation. - PubMed
- Zwick, R., Thayer, D. T., & Lewis, C. (1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36(1), 1-28. https://doi.org/10.1111/j.1745-3984.1999.tb00543.x - PubMed
MeSH terms
Publication Types