BMJ Open. 2016 Sep 22;6(9):e011886. doi: 10.1136/bmjopen-2016-011886.
Multimethod study of a large-scale programme to improve patient safety using a harm-free care approach.
BMJ open
Maxine Power, Liz Brewster, Gareth Parry, Ailsa Brotherton, Joel Minion, Piotr Ozieranski, Sarah McNicol, Abigail Harrison, Mary Dixon-Woods
Affiliations
Affiliations
- HAELO, Salford Royal NHS Foundation Trust, Salford, UK.
- Faculty of Health and Medicine, Lancaster Medical School, Lancaster University, Lancaster, UK.
- Institute for Healthcare Improvement, Cambridge, Massachusetts, USA.
- Data to Knowledge Group, School of Social and Community Medicine, University of Bristol, Bristol, UK.
- Department of Social and Policy Sciences, University of Bath, Bath, UK.
- Education and Social Research Institute, Manchester Metropolitan University, Crewe, UK.
- Cambridge Centre for Health Services Research, University of Cambridge School of Clinical Medicine, Cambridge, UK.
PMID: 27660317
PMCID: PMC5051472 DOI: 10.1136/bmjopen-2016-011886
Abstract
OBJECTIVES: We aimed to evaluate whether a large-scale two-phase quality improvement programme achieved its aims and to characterise the influences on achievement.
SETTING: National Health Service (NHS) in England.
PARTICIPANTS: NHS staff.
INTERVENTIONS: The programme sought to (1) develop a shared national, regional and locally aligned safety focus for 4 high-cost, high volume harms; (2) establish a new measurement system based on a composite measure of 'harm-free' care and (3) deliver improved outcomes. Phase I involved a quality improvement collaborative intended to involve 100 organisations; phase II used financial incentives for data collection.
MEASURES: Multimethod evaluation of the programme. In phase I, analysis of regional plans and of rates of data submission and clinical outcomes reported to the programme. A concurrent process evaluation was conducted of phase I, but only data on submission rates and clinical outcomes were available for phase II.
RESULTS: A context of extreme policy-related structural turbulence impacted strongly on phase I. Most regions' plans did not demonstrate full alignment with the national programme; most fell short of recruitment targets and attrition in attendance at the collaborative meetings occurred over time. Though collaborative participants saw the principles underlying the programme as attractive, useful and innovative, they often struggled to convert enthusiasm into change. Developing the measurement system was arduous, yet continued to be met by controversy. Data submission rates remained patchy throughout phase I but improved in reach and consistency in phase II in response to financial incentives. Some evidence of improvement in clinical outcomes over time could be detected but was hard to interpret owing to variability in the denominators.
CONCLUSIONS: These findings offer important lessons for large-scale improvement programmes, particularly when they seek to develop novel concepts and measures. External contexts may exert far-reaching influence. The challenges of developing measurement systems should not be underestimated.
Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
Keywords: improvement programmes; measurement; mixed-methods; patient safety; quality improvement collaboratives
References
- Qual Saf Health Care. 2002 Dec;11(4):345-51 - PubMed
- Lancet. 2004 Mar 27;363(9414):1061-7 - PubMed
- J Health Serv Res Policy. 2005 Jan;10(1):45-53 - PubMed
- JAMA. 2006 Jan 18;295(3):324-7 - PubMed
- BMJ. 2008 Jun 28;336(7659):1491-4 - PubMed
- Circulation. 2009 Jan 20;119(2):330-7 - PubMed
- Int J Qual Health Care. 2009 Apr;21(2):145-50 - PubMed
- JACC Cardiovasc Interv. 2008 Feb;1(1):97-104 - PubMed
- Healthc Q. 2009;12 Spec No Patient:123-8 - PubMed
- Soc Sci Med. 2009 Dec;69(12):1767-76 - PubMed
- Emerg Med J. 2011 Aug;28(8):670-5 - PubMed
- N Engl J Med. 2010 Nov 25;363(22):2124-34 - PubMed
- BMJ. 2011 Feb 03;342:d195 - PubMed
- BMJ. 2011 Feb 03;342:d199 - PubMed
- BMJ Qual Saf. 2011 Sep;20(9):756-63 - PubMed
- Health Aff (Millwood). 2011 Apr;30(4):569-73 - PubMed
- Milbank Q. 2011 Jun;89(2):167-205 - PubMed
- BMJ Qual Saf. 2012 Oct;21(10):876-84 - PubMed
- Cochrane Database Syst Rev. 2012 Jun 13;(6):CD000259 - PubMed
- J Health Organ Manag. 2012;26(2):158-74 - PubMed
- Br J Nurs. 2012 Jun 14-27;21(11):677-83 - PubMed
- BMJ Qual Saf. 2013 Jan;22(1):19-31 - PubMed
- BMJ Qual Saf. 2012 Sep;21(9):737-45 - PubMed
- BMJ Qual Saf. 2013 Feb;22(2):110-23 - PubMed
- Lancet Infect Dis. 2012 Dec;12(12):919-24 - PubMed
- PLoS One. 2012;7(10):e41617 - PubMed
- Lancet. 2013 Feb 2;381(9864):419-21 - PubMed
- BMC Public Health. 2013 Jun 11;13:568 - PubMed
- Implement Sci. 2013 Jun 20;8:70 - PubMed
- BMJ Qual Saf. 2014 Feb;23(2):106-15 - PubMed
- J Health Serv Res Policy. 2013 Oct;18(2 Suppl):11-9 - PubMed
- Implement Sci. 2014 Apr 01;9(1):40 - PubMed
- Int J Qual Health Care. 2014 Jun;26(3):287-97 - PubMed
- Circ Cardiovasc Qual Outcomes. 2014 Sep;7(5):693-700 - PubMed
- J Health Organ Manag. 2014;28(4):562-75 - PubMed
- BMJ Qual Saf. 2015 Jan;24(1):31-7 - PubMed
- Annu Rev Public Health. 2015 Mar 18;36:307-23 - PubMed
- BMJ Qual Saf. 2015 May;24(5):325-36 - PubMed
- J Health Soc Behav. 2015 Sep;56(3):378-97 - PubMed
- BMJ Qual Saf. 2016 May;25(5):303-10 - PubMed
- Health Serv Res. 2015 Dec;50 Suppl 2:2090-115 - PubMed
- Nurse Res. 2006 Jul 1;13(4):84 - PubMed
Publication Types
Grant support