Display options
Share it on

BMC Med Educ. 2014 Apr 23;14:88. doi: 10.1186/1472-6920-14-88.

Predictive validity of the UK clinical aptitude test in the final years of medical school: a prospective cohort study.

BMC medical education

Adrian Husbands, Alistair Mathieson, Jonathan Dowell, Jennifer Cleland, Rhoda MacKenzie

Affiliations

  1. School of Medicine, University of Dundee, The Mackenzie Building, Kirsty Semple Way, Dundee DD2 4BF, UK. [email protected].

PMID: 24762134 PMCID: PMC4008381 DOI: 10.1186/1472-6920-14-88

Abstract

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) was designed to address issues identified with traditional methods of selection. This study aims to examine the predictive validity of the UKCAT and compare this to traditional selection methods in the senior years of medical school. This was a follow-up study of two cohorts of students from two medical schools who had previously taken part in a study examining the predictive validity of the UKCAT in first year.

METHODS: The sample consisted of 4th and 5th Year students who commenced their studies at the University of Aberdeen or University of Dundee medical schools in 2007. Data collected were: demographics (gender and age group), UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; Year 4 and 5 degree examination scores. Pearson's correlations were used to examine the relationships between admissions variables, examination scores, gender and age group, and to select variables for multiple linear regression analysis to predict examination scores.

RESULTS: Ninety-nine and 89 students at Aberdeen medical school from Years 4 and 5 respectively, and 51 Year 4 students in Dundee, were included in the analysis. Neither UCAS form nor interview scores were statistically significant predictors of examination performance. Conversely, the UKCAT yielded statistically significant validity coefficients between .24 and .36 in four of five assessments investigated. Multiple regression analysis showed the UKCAT made a statistically significant unique contribution to variance in examination performance in the senior years.

CONCLUSIONS: Results suggest the UKCAT appears to predict performance better in the later years of medical school compared to earlier years and provides modest supportive evidence for the UKCAT's role in student selection within these institutions. Further research is needed to assess the predictive validity of the UKCAT against professional and behavioural outcomes as the cohort commences working life.

References

  1. Acad Med. 2010 Jun;85(6):980-7 - PubMed
  2. Med Educ. 2008 Oct;42(10):999-1006 - PubMed
  3. Med Educ. 2009 Aug;43(8):767-75 - PubMed
  4. BMJ. 2002 Apr 20;324(7343):952-7 - PubMed
  5. Med Educ. 2013 Jul;47(7):717-25 - PubMed
  6. Acad Med. 2007 Jan;82(1):100-6 - PubMed
  7. BMC Med Educ. 2010 Jul 28;10:55 - PubMed
  8. BMJ. 2006 Apr 29;332(7548):1005-9 - PubMed
  9. Med Educ. 2007 Mar;41(3):242-9 - PubMed
  10. Psychol Bull. 1992 Jul;112(1):155-9 - PubMed
  11. Adv Health Sci Educ Theory Pract. 2009 Dec;14(5):759-75 - PubMed
  12. Med Educ. 2010 Nov;44(11):1069-76 - PubMed
  13. BMJ. 2012 Apr 17;344:e1805 - PubMed
  14. Med Educ. 2007 Apr;41(4):378-84 - PubMed
  15. BMC Med. 2013 Nov 14;11:244 - PubMed
  16. BMC Med Educ. 2013 Feb 26;13:32 - PubMed
  17. BMJ. 2005 Sep 10;331(7516):555-9 - PubMed
  18. Acad Med. 2004 Oct;79(10 Suppl):S40-2 - PubMed
  19. Med Educ. 2009 Dec;43(12):1203-9 - PubMed
  20. J R Soc Med. 2009 Oct;102(10):425-30 - PubMed

MeSH terms

Publication Types