Display options
Cite
Cumming TB, Churilov L, Sena ES. The Missing Medians: Exclusion of Ordinal Data from Meta-Analyses. PLoS One. 2015;10(12):e0145580doi: 10.1371/journal.pone.0145580.
Cumming, T. B., Churilov, L., & Sena, E. S. (2015). The Missing Medians: Exclusion of Ordinal Data from Meta-Analyses. PloS one, 10(12), e0145580. https://doi.org/10.1371/journal.pone.0145580
Cumming, Toby B, et al. "The Missing Medians: Exclusion of Ordinal Data from Meta-Analyses." PloS one vol. 10,12 (2015): e0145580. doi: https://doi.org/10.1371/journal.pone.0145580
Cumming TB, Churilov L, Sena ES. The Missing Medians: Exclusion of Ordinal Data from Meta-Analyses. PLoS One. 2015 Dec 23;10(12):e0145580. doi: 10.1371/journal.pone.0145580. eCollection 2015. PMID: 26697876; PMCID: PMC4689383.
Copy Download .nbib Format: NLM
Share it on

PLoS One. 2015 Dec 23;10(12):e0145580. doi: 10.1371/journal.pone.0145580. eCollection 2015.

The Missing Medians: Exclusion of Ordinal Data from Meta-Analyses.

PloS one

Toby B Cumming, Leonid Churilov, Emily S Sena

Affiliations

  1. Florey Institute of Neuroscience and Mental Health, University of Melbourne, Melbourne, Australia.
  2. Centre for Clinical Brain Sciences, School of Clinical Sciences, University of Edinburgh, Edinburgh, United Kingdom.

PMID: 26697876 PMCID: PMC4689383 DOI: 10.1371/journal.pone.0145580

Abstract

BACKGROUND: Meta-analyses are considered the gold standard of evidence-based health care, and are used to guide clinical decisions and health policy. A major limitation of current meta-analysis techniques is their inability to pool ordinal data. Our objectives were to determine the extent of this problem in the context of neurological rating scales and to provide a solution.

METHODS: Using an existing database of clinical trials of oral neuroprotective therapies, we identified the 6 most commonly used clinical rating scales and recorded how data from these scales were reported and analysed. We then identified systematic reviews of studies that used these scales (via the Cochrane database) and recorded the meta-analytic techniques used. Finally, we identified a statistical technique for calculating a common language effect size measure for ordinal data.

RESULTS: We identified 103 studies, with 128 instances of the 6 clinical scales being reported. The majority- 80%-reported means alone for central tendency, with only 13% reporting medians. In analysis, 40% of studies used parametric statistics alone, 34% of studies employed non-parametric analysis, and 26% did not include or specify analysis. Of the 60 systematic reviews identified that included meta-analysis, 88% used mean difference and 22% employed difference in proportions; none included rank-based analysis. We propose the use of a rank-based generalised odds ratio (WMW GenOR) as an assumption-free effect size measure that is easy to compute and can be readily combined in meta-analysis.

CONCLUSION: There is wide scope for improvement in the reporting and analysis of ordinal data in the literature. We hope that adoption of the WMW GenOR will have the dual effect of improving the reporting of data in individual studies while also increasing the inclusivity (and therefore validity) of meta-analyses.

References

  1. Neurology. 1983 Nov;33(11):1444-52 - PubMed
  2. PLoS One. 2015;10(4):e0117705 - PubMed
  3. Stat Med. 1994 Dec 15-30;13(23-24):2503-15 - PubMed
  4. Mov Disord. 1996 Mar;11(2):136-42 - PubMed
  5. Biometrics. 1996 Sep;52(3):1103-11 - PubMed
  6. Alzheimer Dis Assoc Disord. 1997;11 Suppl 2:S13-21 - PubMed
  7. Neurology. 1997 Oct;49(4):1060-5 - PubMed
  8. BMC Med Res Methodol. 2005;5:13 - PubMed
  9. BMC Genomics. 2008;9:98 - PubMed
  10. Biometrics. 2008 Sep;64(3):825-33 - PubMed
  11. Stroke. 2009 Dec;40(12):3828-33 - PubMed
  12. Int J Stroke. 2011 Dec;6(6):472-9 - PubMed
  13. J Clin Neurosci. 2012 Apr;19(4):552-6 - PubMed
  14. N Engl J Med. 2013 Mar 7;368(10):914-23 - PubMed
  15. Acta Neurol Scand. 2013 Aug;128(2):122-9 - PubMed
  16. Int J Stroke. 2014 Dec;9(8):999-1005 - PubMed
  17. J Psychiatr Res. 1975 Nov;12(3):189-98 - PubMed
  18. J Neurol Sci. 1999 Oct 31;169(1-2):13-21 - PubMed
  19. Neurology. 1995 Feb;45(2):251-5 - PubMed

MeSH terms

Publication Types