Display options
Share it on

BMJ Open. 2016 Sep 22;6(9):e011886. doi: 10.1136/bmjopen-2016-011886.

Multimethod study of a large-scale programme to improve patient safety using a harm-free care approach.

BMJ open

Maxine Power, Liz Brewster, Gareth Parry, Ailsa Brotherton, Joel Minion, Piotr Ozieranski, Sarah McNicol, Abigail Harrison, Mary Dixon-Woods

Affiliations

  1. HAELO, Salford Royal NHS Foundation Trust, Salford, UK.
  2. Faculty of Health and Medicine, Lancaster Medical School, Lancaster University, Lancaster, UK.
  3. Institute for Healthcare Improvement, Cambridge, Massachusetts, USA.
  4. Data to Knowledge Group, School of Social and Community Medicine, University of Bristol, Bristol, UK.
  5. Department of Social and Policy Sciences, University of Bath, Bath, UK.
  6. Education and Social Research Institute, Manchester Metropolitan University, Crewe, UK.
  7. Cambridge Centre for Health Services Research, University of Cambridge School of Clinical Medicine, Cambridge, UK.

PMID: 27660317 PMCID: PMC5051472 DOI: 10.1136/bmjopen-2016-011886

Abstract

OBJECTIVES: We aimed to evaluate whether a large-scale two-phase quality improvement programme achieved its aims and to characterise the influences on achievement.

SETTING: National Health Service (NHS) in England.

PARTICIPANTS: NHS staff.

INTERVENTIONS: The programme sought to (1) develop a shared national, regional and locally aligned safety focus for 4 high-cost, high volume harms; (2) establish a new measurement system based on a composite measure of 'harm-free' care and (3) deliver improved outcomes. Phase I involved a quality improvement collaborative intended to involve 100 organisations; phase II used financial incentives for data collection.

MEASURES: Multimethod evaluation of the programme. In phase I, analysis of regional plans and of rates of data submission and clinical outcomes reported to the programme. A concurrent process evaluation was conducted of phase I, but only data on submission rates and clinical outcomes were available for phase II.

RESULTS: A context of extreme policy-related structural turbulence impacted strongly on phase I. Most regions' plans did not demonstrate full alignment with the national programme; most fell short of recruitment targets and attrition in attendance at the collaborative meetings occurred over time. Though collaborative participants saw the principles underlying the programme as attractive, useful and innovative, they often struggled to convert enthusiasm into change. Developing the measurement system was arduous, yet continued to be met by controversy. Data submission rates remained patchy throughout phase I but improved in reach and consistency in phase II in response to financial incentives. Some evidence of improvement in clinical outcomes over time could be detected but was hard to interpret owing to variability in the denominators.

CONCLUSIONS: These findings offer important lessons for large-scale improvement programmes, particularly when they seek to develop novel concepts and measures. External contexts may exert far-reaching influence. The challenges of developing measurement systems should not be underestimated.

Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Keywords: improvement programmes; measurement; mixed-methods; patient safety; quality improvement collaboratives

References

  1. Qual Saf Health Care. 2002 Dec;11(4):345-51 - PubMed
  2. Lancet. 2004 Mar 27;363(9414):1061-7 - PubMed
  3. J Health Serv Res Policy. 2005 Jan;10(1):45-53 - PubMed
  4. JAMA. 2006 Jan 18;295(3):324-7 - PubMed
  5. BMJ. 2008 Jun 28;336(7659):1491-4 - PubMed
  6. Circulation. 2009 Jan 20;119(2):330-7 - PubMed
  7. Int J Qual Health Care. 2009 Apr;21(2):145-50 - PubMed
  8. JACC Cardiovasc Interv. 2008 Feb;1(1):97-104 - PubMed
  9. Healthc Q. 2009;12 Spec No Patient:123-8 - PubMed
  10. Soc Sci Med. 2009 Dec;69(12):1767-76 - PubMed
  11. Emerg Med J. 2011 Aug;28(8):670-5 - PubMed
  12. N Engl J Med. 2010 Nov 25;363(22):2124-34 - PubMed
  13. BMJ. 2011 Feb 03;342:d195 - PubMed
  14. BMJ. 2011 Feb 03;342:d199 - PubMed
  15. BMJ Qual Saf. 2011 Sep;20(9):756-63 - PubMed
  16. Health Aff (Millwood). 2011 Apr;30(4):569-73 - PubMed
  17. Milbank Q. 2011 Jun;89(2):167-205 - PubMed
  18. BMJ Qual Saf. 2012 Oct;21(10):876-84 - PubMed
  19. Cochrane Database Syst Rev. 2012 Jun 13;(6):CD000259 - PubMed
  20. J Health Organ Manag. 2012;26(2):158-74 - PubMed
  21. Br J Nurs. 2012 Jun 14-27;21(11):677-83 - PubMed
  22. BMJ Qual Saf. 2013 Jan;22(1):19-31 - PubMed
  23. BMJ Qual Saf. 2012 Sep;21(9):737-45 - PubMed
  24. BMJ Qual Saf. 2013 Feb;22(2):110-23 - PubMed
  25. Lancet Infect Dis. 2012 Dec;12(12):919-24 - PubMed
  26. PLoS One. 2012;7(10):e41617 - PubMed
  27. Lancet. 2013 Feb 2;381(9864):419-21 - PubMed
  28. BMC Public Health. 2013 Jun 11;13:568 - PubMed
  29. Implement Sci. 2013 Jun 20;8:70 - PubMed
  30. BMJ Qual Saf. 2014 Feb;23(2):106-15 - PubMed
  31. J Health Serv Res Policy. 2013 Oct;18(2 Suppl):11-9 - PubMed
  32. Implement Sci. 2014 Apr 01;9(1):40 - PubMed
  33. Int J Qual Health Care. 2014 Jun;26(3):287-97 - PubMed
  34. Circ Cardiovasc Qual Outcomes. 2014 Sep;7(5):693-700 - PubMed
  35. J Health Organ Manag. 2014;28(4):562-75 - PubMed
  36. BMJ Qual Saf. 2015 Jan;24(1):31-7 - PubMed
  37. Annu Rev Public Health. 2015 Mar 18;36:307-23 - PubMed
  38. BMJ Qual Saf. 2015 May;24(5):325-36 - PubMed
  39. J Health Soc Behav. 2015 Sep;56(3):378-97 - PubMed
  40. BMJ Qual Saf. 2016 May;25(5):303-10 - PubMed
  41. Health Serv Res. 2015 Dec;50 Suppl 2:2090-115 - PubMed
  42. Nurse Res. 2006 Jul 1;13(4):84 - PubMed

Publication Types

Grant support