Display options
Share it on

Educ Psychol Meas. 2019 Feb;79(1):170-199. doi: 10.1177/0013164417749679. Epub 2017 Dec 27.

A Semiparametric Approach for Modeling Not-Reached Items.

Educational and psychological measurement

Marit Kristine List, Olaf Köller, Gabriel Nagy

Affiliations

  1. Leibniz Institute for Science and Mathematics Education at Kiel University, Kiel, Germany.

PMID: 30636787 PMCID: PMC6318705 DOI: 10.1177/0013164417749679

Abstract

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel's item response theory model for NRIs by (1) including a semiparametric representation of the distribution of the onset of NRIs, (2) modeling the relationships of NRIs with proficiency via a flexible multinomial logit regression, and (3) including additional covariates to predict NRIs. We show that Glas and Pimentel's and our model have close connections to event history analysis, thereby making it possible to apply tools developed in this context to the analysis of NRIs. Our model was applied to a timed low-stakes test of mathematics achievement. Our model fitted the data better than Glas and Pimentel's model, and allowed for a more fine-grained assessment of the onset of NRIs. The results of a simulation study showed that our model accurately recovered the relationships of proficiency and covariates with the onset of NRIs, and reduced bias in the estimates of item parameters, proficiency distributions, and covariate effects on proficiency.

Keywords: educational assessment; event history analysis; item response theory; latent class analysis; nonlinear relations; not-reached items

Conflict of interest statement

Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

References

  1. Biometrics. 1999 Mar;55(1):117-28 - PubMed
  2. Psychol Methods. 2005 Mar;10(1):21-39 - PubMed
  3. Biostatistics. 2006 Jan;7(1):145-63 - PubMed
  4. Br J Math Stat Psychol. 2008 Nov;61(Pt 2):287-307 - PubMed
  5. Res Hum Dev. 2009;6(2-3):165-194 - PubMed
  6. Psychometrika. 2016 Nov 15;:null - PubMed
  7. Educ Psychol Meas. 2015 Oct;75(5):850-874 - PubMed

Publication Types