Display options
Cite
Tiffin PA, Mwandigha LM, Paton LW, et al. Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study. BMC Med. 2016;14(1):140doi: 10.1186/s12916-016-0682-7.
Tiffin, P. A., Mwandigha, L. M., Paton, L. W., Hesselgreaves, H., McLachlan, J. C., Finn, G. M., & Kasim, A. S. (2016). Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study. BMC medicine, 14(1), 140. https://doi.org/10.1186/s12916-016-0682-7
Tiffin, Paul A, et al. "Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study." BMC medicine vol. 14,1 (2016): 140. doi: https://doi.org/10.1186/s12916-016-0682-7
Tiffin PA, Mwandigha LM, Paton LW, Hesselgreaves H, McLachlan JC, Finn GM, Kasim AS. Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study. BMC Med. 2016 Sep 26;14(1):140. doi: 10.1186/s12916-016-0682-7. PMID: 27638740; PMCID: PMC5026770.
Copy Download .nbib Format: NLM
Share it on

BMC Med. 2016 Sep 26;14(1):140. doi: 10.1186/s12916-016-0682-7.

Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study.

BMC medicine

Paul A Tiffin, Lazaro M Mwandigha, Lewis W Paton, H Hesselgreaves, John C McLachlan, Gabrielle M Finn, Adetayo S Kasim

Affiliations

  1. Department of Health Sciences, University of York, Heslington, York, YO10 5DD, UK. [email protected].
  2. Department of Health Sciences, University of York, Heslington, York, YO10 5DD, UK.
  3. Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK.
  4. Medical Education, School for Medicine, Pharmacy and Health, Durham University Queen's Campus, Stockton-on-Tees, TS17 6BH, UK.
  5. Hull York Medical School, Heslington, York, YO10 5DD, UK.
  6. Wolfson Research Institute for Health and Wellbeing, Durham University Queen's Campus, University Boulevard, Stockton-on-Tees, TS17 6BH, UK.

PMID: 27638740 PMCID: PMC5026770 DOI: 10.1186/s12916-016-0682-7

Abstract

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) has been shown to have a modest but statistically significant ability to predict aspects of academic performance throughout medical school. Previously, this ability has been shown to be incremental to conventional measures of educational performance for the first year of medical school. This study evaluates whether this predictive ability extends throughout the whole of undergraduate medical study and explores the potential impact of using the test as a selection screening tool.

METHODS: This was an observational prospective study, linking UKCAT scores, prior educational attainment and sociodemographic variables with subsequent academic outcomes during the 5 years of UK medical undergraduate training. The participants were 6812 entrants to UK medical schools in 2007-8 using the UKCAT. The main outcome was academic performance at each year of medical school. A receiver operating characteristic (ROC) curve analysis was also conducted, treating the UKCAT as a screening test for a negative academic outcome (failing at least 1 year at first attempt).

RESULTS: All four of the UKCAT scale scores significantly predicted performance in theory- and skills-based exams. After adjustment for prior educational achievement, the UKCAT scale scores remained significantly predictive for most years. Findings from the ROC analysis suggested that, if used as a sole screening test, with the mean applicant UKCAT score as the cut-off, the test could be used to reject candidates at high risk of failing at least 1 year at first attempt. However, the 'number needed to reject' value would be high (at 1.18), with roughly one candidate who would have been likely to pass all years at first sitting being rejected for every higher risk candidate potentially declined entry on this basis.

CONCLUSIONS: The UKCAT scores demonstrate a statistically significant but modest degree of incremental predictive validity throughout undergraduate training. Whilst the UKCAT could be considered a fairly crude screening tool for future academic performance, it may offer added value when used in conjunction with other selection measures. Future work should focus on the optimum role of such tests within the selection process and the prediction of post-graduate performance.

Keywords: Aptitude testing; Medical selection; Predictive validity; Undergraduate performance

References

  1. Psychol Methods. 2006 Dec;11(4):416-38 - PubMed
  2. N Engl J Med. 2005 Dec 22;353(25):2673-82 - PubMed
  3. BMC Med Educ. 2014 Jun 11;14:116 - PubMed
  4. Acad Med. 2007 Jan;82(1):100-6 - PubMed
  5. BMC Med Educ. 2014 Apr 23;14 :88 - PubMed
  6. BMC Med Educ. 2014 Jan 08;14 :7 - PubMed
  7. Stat Methods Med Res. 2007 Jun;16(3):219-42 - PubMed
  8. Med Teach. 2011;33(1):53-7 - PubMed
  9. J R Soc Med. 2002 Jan;95(1):18-22 - PubMed
  10. BMC Med Educ. 2008 Apr 07;8:16 - PubMed
  11. J Appl Psychol. 2006 May;91(3):594-612 - PubMed
  12. Med Teach. 2015 ;37(9):868-80 - PubMed
  13. BMC Med. 2013 Nov 14;11:242 - PubMed
  14. BMC Med. 2013 Nov 14;11:244 - PubMed
  15. Med Educ. 2016 Jun;50(6):624-36 - PubMed
  16. BMC Med Educ. 2011 Nov 24;11:98 - PubMed
  17. BMJ. 2005 Sep 10;331(7516):555-9 - PubMed
  18. BMJ. 2012 Apr 17;344:e1805 - PubMed
  19. BMC Med. 2013 Nov 14;11:243 - PubMed
  20. Acad Med. 2010 Jun;85(6):980-7 - PubMed

MeSH terms

Publication Types

Grant support