Display options
Share it on

F1000Res. 2016 Sep 16;5:2333. doi: 10.12688/f1000research.9611.3. eCollection 2016.

Revisiting inconsistency in large pharmacogenomic studies.

F1000Research

Zhaleh Safikhani, Petr Smirnov, Mark Freeman, Nehme El-Hachem, Adrian She, Quevedo Rene, Anna Goldenberg, Nicolai J Birkbak, Christos Hatzis, Leming Shi, Andrew H Beck, Hugo J W L Aerts, John Quackenbush, Benjamin Haibe-Kains

Affiliations

  1. Department of Medical Biophysics, University of Toronto, Toronto, M5G 1L7, Canada.
  2. Princess Margaret Cancer Centre, University Health Network, Toronto, M5G 1L7, Canada.
  3. Institut de Recherches Cliniques de Montréal, Montréal, H2W 1R7, Canada.
  4. Department of Computer Science, University of Toronto, Toronto, M5S 2E4, Canada.
  5. Hospital for Sick Children, Toronto, M5G 1X8, Canada.
  6. University College London, London, WC1E 6BT, UK.
  7. Yale Cancer Center, Yale University, New Haven, CT, 06510, USA.
  8. Section of Medical Oncology, Yale University School of Medicine, New Haven, CT, 06520, USA.
  9. University of Arkansas for Medical Sciences, Little Rock, AR, 72205, USA.
  10. Fudan University, Shanghai City, 200135, China.
  11. Department of Pathology, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, MA, 02215, USA.
  12. Department of Biostatistics and Computational Biology and Center for Cancer Computational Biology, Boston, MA, 02215, USA.
  13. Department of Radiation Oncology and Radiology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, 02215, USA.
  14. Department of Cancer Biology, Dana-Farber Cancer Institute, Boston, MA, 02215, USA.
  15. Ontario Institute of Cancer Research, Toronto, M5G 1L7, Canada.

PMID: 28928933 PMCID: PMC5580432 DOI: 10.12688/f1000research.9611.3

Abstract

In 2013, we published a comparative analysis of mutation and gene expression profiles and drug sensitivity measurements for 15 drugs characterized in the 471 cancer cell lines screened in the Genomics of Drug Sensitivity in Cancer (GDSC) and Cancer Cell Line Encyclopedia (CCLE). While we found good concordance in gene expression profiles, there was substantial inconsistency in the drug responses reported by the GDSC and CCLE projects. We received extensive feedback on the comparisons that we performed. This feedback, along with the release of new data, prompted us to revisit our initial analysis. We present a new analysis using these expanded data, where we address the most significant suggestions for improvements on our published analysis - that targeted therapies and broad cytotoxic drugs should have been treated differently in assessing consistency, that consistency of both molecular profiles and drug sensitivity measurements should be compared across cell lines, and that the software analysis tools provided should have been easier to run, particularly as the GDSC and CCLE released additional data. Our re-analysis supports our previous finding that gene expression data are significantly more consistent than drug sensitivity measurements. Using new statistics to assess data consistency allowed identification of two broad effect drugs and three targeted drugs with moderate to good consistency in drug sensitivity data between GDSC and CCLE. For three other targeted drugs, there were not enough sensitive cell lines to assess the consistency of the pharmacological profiles. We found evidence of inconsistencies in pharmacological phenotypes for the remaining eight drugs. Overall, our findings suggest that the drug sensitivity data in GDSC and CCLE continue to present challenges for robust biomarker discovery. This re-analysis provides additional support for the argument that experimental standardization and validation of pharmacogenomic response will be necessary to advance the broad use of large pharmacogenomic screens.

Keywords: cancer; consistency; drug sensitivity; pharmacogenomic agreement; pharmacogenomics

Conflict of interest statement

Competing interests: No competing interests were disclosed.

References

  1. Biochim Biophys Acta. 1975 Oct 20;405(2):442-51 - PubMed
  2. Biostatistics. 2003 Apr;4(2):249-64 - PubMed
  3. Cancer. 1950 Jan;3(1):32-5 - PubMed
  4. Nat Biotechnol. 2006 Sep;24(9):1151-61 - PubMed
  5. BMC Res Notes. 2008 Aug 19;1:66 - PubMed
  6. Nat Biotechnol. 2010 Aug;28(8):827-38 - PubMed
  7. Nat Protoc. 2012 Mar 01;7(3):562-78 - PubMed
  8. Nature. 2012 Mar 28;483(7391):570-5 - PubMed
  9. Nature. 2012 Mar 28;483(7391):603-7 - PubMed
  10. Nat Biotechnol. 2012 May;30(5):413-21 - PubMed
  11. PLoS One. 2012;7(9):e44483 - PubMed
  12. J Am Med Inform Assoc. 2013 Jul-Aug;20(4):597-602 - PubMed
  13. Genome Biol. 2013;14(10):R110 - PubMed
  14. Nature. 2013 Dec 19;504(7480):389-93 - PubMed
  15. Pac Symp Biocomput. 2014;:63-74 - PubMed
  16. Cancer Res. 2014 Aug 1;74(15):4016-23 - PubMed
  17. Cancer Res. 2014 Nov 15;74(22):6390-6396 - PubMed
  18. Database (Oxford). 2014 Sep 29;2014:null - PubMed
  19. Nature. 2015 Apr 16;520(7547):307-11 - PubMed
  20. BMC Cancer. 2015 Jun 30;15:489 - PubMed
  21. Mol Cancer Res. 2016 Jan;14(1):3-13 - PubMed
  22. Bioinformatics. 2016 Jan 1;32(1):85-95 - PubMed
  23. Nature. 2015 Dec 3;528(7580):84-7 - PubMed
  24. Bioinformatics. 2016 Apr 15;32(8):1244-6 - PubMed
  25. Nature. 2016 May 18;533(7603):333-7 - PubMed
  26. Oncotarget. 2016 Aug 9;7(32):51619-51625 - PubMed
  27. F1000Res. 2016 May 09;5:825 - PubMed
  28. Nature. 2016 Nov 30;540(7631):E1-E2 - PubMed
  29. Nature. 2016 Nov 30;540(7631):E9-E10 - PubMed
  30. Nature. 2016 Nov 30;540(7631):E2-E4 - PubMed
  31. Nat Commun. 2017 Oct 24;8(1):1126 - PubMed
  32. Am J Psychol. 1987 Fall-Winter;100(3-4):441-71 - PubMed
  33. JAMA. 1982 May 14;247(18):2543-6 - PubMed

Publication Types

Grant support