Display options
Cite
Robitzsch A, Lüdtke O, Goldhammer F, et al. Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects. Front Psychol. 2020;11:884doi: 10.3389/fpsyg.2020.00884.
Robitzsch, A., Lüdtke, O., Goldhammer, F., Kroehne, U., & Köller, O. (2020). Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects. Frontiers in psychology, 11884. https://doi.org/10.3389/fpsyg.2020.00884
Robitzsch, Alexander, et al. "Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects." Frontiers in psychology vol. 11 (2020): 884. doi: https://doi.org/10.3389/fpsyg.2020.00884
Robitzsch A, Lüdtke O, Goldhammer F, Kroehne U, Köller O. Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects. Front Psychol. 2020 May 26;11:884. doi: 10.3389/fpsyg.2020.00884. eCollection 2020. PMID: 32528352; PMCID: PMC7264417.
Copy Download .nbib Format: NLM
Share it on

Front Psychol. 2020 May 26;11:884. doi: 10.3389/fpsyg.2020.00884. eCollection 2020.

Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects.

Frontiers in psychology

Alexander Robitzsch, Oliver Lüdtke, Frank Goldhammer, Ulf Kroehne, Olaf Köller

Affiliations

  1. IPN - Leibniz Institute for Science and Mathematics Education, Kiel, Germany.
  2. Centre for International Student Assessment (ZIB), Kiel, Germany.
  3. DIPF - Leibniz Institute for Research and Information in Education, Frankfurt, Germany.
  4. Centre for International Student Assessment (ZIB), Frankfurt, Germany.

PMID: 32528352 PMCID: PMC7264417 DOI: 10.3389/fpsyg.2020.00884

Abstract

International large-scale assessments, such as the Program for International Student Assessment (PISA), are conducted to provide information on the effectiveness of education systems. In PISA, the target population of 15-year-old students is assessed every 3 years. Trends show whether competencies have changed in the countries between PISA cycles. In order to provide valid trend estimates, it is desirable to retain the same test conditions and statistical methods in all PISA cycles. In PISA 2015, however, the test mode changed from paper-based to computer-based tests, and the scaling method was changed. In this paper, we investigate the effects of these changes on trend estimation in PISA using German data from all PISA cycles (2000-2015). Our findings suggest that the change from paper-based to computer-based tests could have a severe impact on trend estimation but that the change of the scaling model did not substantially change the trend estimates.

Copyright © 2020 Robitzsch, Lüdtke, Goldhammer, Kroehne and Köller.

Keywords: educational measurement; large-scale assessment; linking; mode effects; scaling

References

  1. J Appl Meas. 2007;8(3):305-22 - PubMed
  2. Front Psychol. 2017 Apr 04;8:484 - PubMed
  3. Psychometrika. 2017 Mar;82(1):210-232 - PubMed
  4. Psychometrika. 2015 Sep;80(3):571-600 - PubMed
  5. J Appl Meas. 2007;8(3):323-35 - PubMed
  6. Psychol Methods. 2015 Dec;20(4):523-36 - PubMed
  7. Front Psychol. 2010 Oct 15;1:167 - PubMed

Publication Types