Display options
Share it on

Front Neuroinform. 2010 Dec 08;4:117. doi: 10.3389/fninf.2010.00117. eCollection 2010.

Reproducibility of graph metrics in FMRI networks.

Frontiers in neuroinformatics

Qawi K Telesford, Ashley R Morgan, Satoru Hayasaka, Sean L Simpson, William Barret, Robert A Kraft, Jennifer L Mozolic, Paul J Laurienti

Affiliations

  1. School of Biomedical Engineering and Sciences, Virginia Tech-Wake Forest University Winston-Salem, NC, USA.

PMID: 21165174 PMCID: PMC3002432 DOI: 10.3389/fninf.2010.00117

Abstract

The reliability of graph metrics calculated in network analysis is essential to the interpretation of complex network organization. These graph metrics are used to deduce the small-world properties in networks. In this study, we investigated the test-retest reliability of graph metrics from functional magnetic resonance imaging data collected for two runs in 45 healthy older adults. Graph metrics were calculated on data for both runs and compared using intraclass correlation coefficient (ICC) statistics and Bland-Altman (BA) plots. ICC scores describe the level of absolute agreement between two measurements and provide a measure of reproducibility. For mean graph metrics, ICC scores were high for clustering coefficient (ICC = 0.86), global efficiency (ICC = 0.83), path length (ICC = 0.79), and local efficiency (ICC = 0.75); the ICC score for degree was found to be low (ICC = 0.29). ICC scores were also used to generate reproducibility maps in brain space to test voxel-wise reproducibility for unsmoothed and smoothed data. Reproducibility was uniform across the brain for global efficiency and path length, but was only high in network hubs for clustering coefficient, local efficiency, and degree. BA plots were used to test the measurement repeatability of all graph metrics. All graph metrics fell within the limits for repeatability. Together, these results suggest that with exception of degree, mean graph metrics are reproducible and suitable for clinical studies. Further exploration is warranted to better understand reproducibility across the brain on a voxel-wise basis.

Keywords: Bland–Altman plot; functional MRI; graph theory; intraclass correlation coefficient; network; reproducibility; resting-state

References

  1. Neurobiol Aging. 2011 Apr;32(4):655-68 - PubMed
  2. Nature. 1998 Jun 4;393(6684):440-2 - PubMed
  3. Hum Brain Mapp. 2009 May;30(5):1511-23 - PubMed
  4. Neuroreport. 1998 Nov 16;9(16):3735-9 - PubMed
  5. Nat Rev Neurosci. 2009 Mar;10(3):186-98 - PubMed
  6. Neuroimage. 2008 Nov 15;43(3):528-39 - PubMed
  7. Proc Natl Acad Sci U S A. 2005 Jul 5;102(27):9673-8 - PubMed
  8. Proc Natl Acad Sci U S A. 2006 Dec 19;103(51):19518-23 - PubMed
  9. J Neurosci. 2006 Jan 4;26(1):63-72 - PubMed
  10. Neuroimage. 2009 Feb 1;44(3):715-23 - PubMed
  11. Hum Brain Mapp. 2009 Jul;30(7):2220-31 - PubMed
  12. Neuroimage. 2010 Apr 1;50(2):499-508 - PubMed
  13. Phys Rev E Stat Nonlin Soft Matter Phys. 2003 Feb;67(2 Pt 2):026126 - PubMed
  14. Stat Methods Med Res. 1999 Jun;8(2):135-60 - PubMed
  15. BMC Health Serv Res. 2002 Mar 26;2(1):8 - PubMed
  16. J Neurosci. 2008 Sep 10;28(37):9239-48 - PubMed
  17. Curr Opin Neurol. 2009 Aug;22(4):340-7 - PubMed
  18. Neuroimage. 2009 Oct 1;47(4):1460-8 - PubMed
  19. Front Hum Neurosci. 2010 Mar 12;4:16 - PubMed
  20. Phys Rev Lett. 2005 Jan 14;94(1):018102 - PubMed
  21. Schizophr Res. 2006 Oct;87(1-3):60-6 - PubMed
  22. Neuroimage. 2010 Sep;52(3):1059-69 - PubMed
  23. Phys Rev Lett. 2004 Apr 30;92(17):178702 - PubMed
  24. Neuroimage. 2010 Jul 1;51(3):1106-16 - PubMed
  25. Phys Rev E Stat Nonlin Soft Matter Phys. 2003 Feb;67(2 Pt 2):026112 - PubMed
  26. Neuroimage. 2005 Jul 1;26(3):839-51 - PubMed
  27. PLoS Comput Biol. 2008 Jun 27;4(6):e1000100 - PubMed
  28. Phys Rev E Stat Nonlin Soft Matter Phys. 2008 Jun;77(6 Pt 2):066112 - PubMed

Publication Types

Grant support