Display options
Share it on

Contemp Clin Trials Commun. 2019 Oct 16;17:100474. doi: 10.1016/j.conctc.2019.100474. eCollection 2020 Mar.

Simulation-based power and sample size calculation for designing interrupted time series analyses of count outcomes in evaluation of health policy interventions.

Contemporary clinical trials communications

Wei Liu, Shangyuan Ye, Bruce A Barton, Melissa A Fischer, Colleen Lawrence, Elizabeth J Rahn, Maria I Danila, Kenneth G Saag, Paul A Harris, Stephenie C Lemon, Jeroan J Allison, Bo Zhang

Affiliations

  1. School of Management, Harbin Institute of Technology, Harbin, Heilongjiang 150001, China.
  2. Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, MA, 02115, USA.
  3. Department of Internal Medicine, University of Massachusetts Medical School, Worcester, MA, 01605, USA.
  4. Meyers Primary Care Institute, University of Massachusetts Medical School, Fallon Foundation, and Fallon Community Health Plan, Worcester, MA, 01605, USA.
  5. Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, 37232, USA.
  6. Division of Clinical Immunology and Rheumatology, University of Alabama at Birmingham, Birmingham, AL, 35294, USA.
  7. Department of Biomedical Informatics and Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37203, USA.
  8. Department of Neurology and ICCTR Biostatistics and Research Design Center, Boston Children's Hospital and Harvard Medical School, Boston, MA, 02215, USA.

PMID: 31886433 PMCID: PMC6920506 DOI: 10.1016/j.conctc.2019.100474

Abstract

OBJECTIVE: The purpose of this study was to present the design, model, and data analysis of an interrupted time series (ITS) model applied to evaluate the impact of health policy, systems, or environmental interventions using count outcomes. Simulation methods were used to conduct power and sample size calculations for these studies.

METHODS: We proposed the models and analyses of ITS designs for count outcomes using the Strengthening Translational Research in Diverse Enrollment (STRIDE) study as an example. The models we used were observation-driven models, which bundle a lagged term on the conditional mean of the outcome for a time series of count outcomes.

RESULTS: A simulation-based approach with ready-to-use computer programs was developed to calculate the sample size and power of two types of ITS models, Poisson and negative binomial, for count outcomes. Simulations were conducted to estimate the power of segmented autoregressive (AR) error models when autocorrelation ranged from -0.9 to 0.9, with various effect sizes. The power to detect the same magnitude of parameters varied largely, depending on the testing level change, the trend change, or both. The relationships between power and sample size and the values of the parameters were different between the two models.

CONCLUSION: This article provides a convenient tool to allow investigators to generate sample sizes that will ensure sufficient statistical power when the ITS study design of count outcomes is implemented.

© 2019 The Authors.

Keywords: Count outcomes; Interrupted time series; Policy evaluation; Power; Quasi-experimental design; Sample size calculation; Segmented regression

Conflict of interest statement

None.

References

  1. Med Care Res Rev. 2018 Jan 01;:1077558717751941 - PubMed
  2. Accid Anal Prev. 2013 Mar;52:204-9 - PubMed
  3. Med Care. 2018 May;56(5):382-383 - PubMed
  4. Int J Epidemiol. 2017 Feb 1;46(1):348-355 - PubMed
  5. BMJ. 2015 Jun 09;350:h2750 - PubMed
  6. Biometrics. 1988 Dec;44(4):1019-31 - PubMed
  7. J Clin Pharm Ther. 2002 Aug;27(4):299-309 - PubMed
  8. Acad Pediatr. 2013 Nov-Dec;13(6 Suppl):S38-44 - PubMed
  9. Med Care. 2018 May;56(5):365-372 - PubMed
  10. Stat Med. 2017 Dec 20;36(29):4660-4676 - PubMed
  11. J Eval Clin Pract. 2011 Dec;17(6):1231-8 - PubMed
  12. Cancer. 2008 Jan 15;112(2):228-42 - PubMed
  13. J Clin Epidemiol. 2011 Nov;64(11):1252-61 - PubMed
  14. Prev Sci. 2000 Mar;1(1):31-49 - PubMed
  15. Arch Gerontol Geriatr. 2014 Jul-Aug;59(1):18-24 - PubMed
  16. Am J Public Health. 2014 Feb;104(2):e16-31 - PubMed
  17. J Clin Epidemiol. 2013 Aug;66(8):883-7 - PubMed

Publication Types

Grant support