Display options
Cite
Charlin B, Gagnon R, Lubarsky S, et al. Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teach Learn Med. 2010;22(3):180-6doi: 10.1080/10401334.2010.488197.
Charlin, B., Gagnon, R., Lubarsky, S., Lambert, C., Meterissian, S., Chalk, C., Goudreau, J., & van der Vleuten, C. (2010). Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teaching and learning in medicine, 22(3), 180-6. https://doi.org/10.1080/10401334.2010.488197
Charlin, Bernard, et al. "Assessment in the context of uncertainty using the script concordance test: more meaning for scores." Teaching and learning in medicine vol. 22,3 (2010): 180-6. doi: https://doi.org/10.1080/10401334.2010.488197
Charlin B, Gagnon R, Lubarsky S, Lambert C, Meterissian S, Chalk C, Goudreau J, van der Vleuten C. Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teach Learn Med. 2010 Jul;22(3):180-6. doi: 10.1080/10401334.2010.488197. PMID: 20563937.
Copy Download .nbib Format: NLM
Share it on

Teach Learn Med. 2010 Jul;22(3):180-6. doi: 10.1080/10401334.2010.488197.

Assessment in the context of uncertainty using the script concordance test: more meaning for scores.

Teaching and learning in medicine

Bernard Charlin, Robert Gagnon, Stuart Lubarsky, Carole Lambert, Sarkis Meterissian, Colin Chalk, Johanne Goudreau, Cees van der Vleuten

Affiliations

  1. Center of Pedagogy Applied to Health Sciences, University of Montreal, Montreal, Quebec, Canada. [email protected]

PMID: 20563937 DOI: 10.1080/10401334.2010.488197

Abstract

BACKGROUND: The Script Concordance Test (SCT) uses authentic, ill-defined clinical cases to compare medical learners' judgment skills with those of experienced physicians. SCT scores are meant to measure the degree of concordance between the performance of examinees and that of the reference panel. Raw test scores have meaning only if statistics (mean and standard deviation) describing the panel's performance are concurrently provided.

PURPOSE: The purpose of this study is to suggest a method for reporting scores that standardizes panel mean and standard deviation, allowing examinees to immediately gauge their performance relative to panel members.

METHODS: Based on a statistical method of standardization, a new method for computing SCT scores is described. According to this method, test raw scores are converted into a scale in which the panel mean is set as the value of reference, and the standard deviation of the panel serves as a yardstick by which examinee performance is measured.

RESULTS: The effect of this transformation on four data sets obtained from SCTs in radio-oncology, surgery, neurology, and nursing is discussed.

CONCLUSION: This transformation method proposes a common metric basis for reporting SCT scores and provides examinees with clear, interpretable insights into their performance relative to that of physicians of the field. We recommend reporting SCT scores with the mean and standard deviation of panel scores set at standard scores of 80 and 5, respectively. Beyond SCT, our transformation method may be generalizable to the scoring of other test formats in which the performance of examinees and those of a panel of reference undertaking the same cognitive tasks are compared.

MeSH terms

Publication Types