Display options
Share it on

Acad Psychiatry. 1990 Dec;14(4):188-96. doi: 10.1007/BF03341354.

Interrater reliability in evaluating trainee interviewing skills.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry

B Templeton, M M Allen

Affiliations

  1. Department of Psychiatry and Human Behavior, Jefferson Medical College, 1015 Walnut Street, 3rd Floor Curtis, Philadelphia, PA, 19107, USA.

PMID: 24436099 DOI: 10.1007/BF03341354

Abstract

The reliability of the evaluative judgments by psychiatric faculty of physician-trainee interviewing skills was studied. Three methods were included: global rating scales, data checklists, and a time-allotment form. Data were obtained during a training workshop for psychiatric instructors in the U.S. The authors found low interrater reliability with all three methods. The study findings were replicated at a second workshop with Canadian faculty. The authors outline some recommended modifications of observational systems that may help improve both the accuracy and reliability of ratings of trainee interviewing skills. The use of more accurate quantitative techniques is briefly reviewed.

References

  1. J Med Educ. 1970 Sep;45(9):700-5 - PubMed
  2. Am J Psychiatry. 1984 Oct;141(10):1145-58 - PubMed
  3. Res Med Educ. 1984;23:3-13 - PubMed
  4. Am J Psychiatry. 1981 Aug;138(8):1069-74 - PubMed
  5. Psychosom Med. 1962 Jul-Aug;24:369-78 - PubMed
  6. J Med Educ. 1987 Aug;62(8):673-7 - PubMed
  7. J Med Educ. 1957 Dec;32(12):853-8 - PubMed
  8. Res Med Educ. 1987;26:222-7 - PubMed
  9. J Med Educ. 1979 Jan;54(1):29-35 - PubMed
  10. J Med Educ. 1966 Feb;41(2):150-61 - PubMed
  11. Am J Psychiatry. 1979 Jun;136(6):815-7 - PubMed
  12. Ann Intern Med. 1964 Apr;60:587-602 - PubMed
  13. J Med Educ. 1969 Oct;44(10):934-8 - PubMed
  14. J Med Educ. 1983 Dec;58(12):941-6 - PubMed
  15. Br J Med Educ. 1973 Sep;7(3):174-8 - PubMed
  16. Pediatrics. 1970 Apr;45(4):623-7 - PubMed
  17. Acad Med. 1989 Nov;64(11):639-43 - PubMed
  18. N Engl J Med. 1965 Jun 24;272:1321-8 - PubMed

Publication Types