Diabetologia. 2021 Jul;64(7):1550-1562. doi: 10.1007/s00125-021-05448-w. Epub 2021 Apr 27.

Prognostic models for predicting the risk of foot ulcer or amputation in people with type 2 diabetes: a systematic review and external validation study.

Diabetologia

Joline W J Beulens, Josan S Yauw, Petra J M Elders, Talitha Feenstra, Ron Herings, Roderick C Slieker, Karel G M Moons, Giel Nijpels, Amber A van der Heijden

PMID: 33904946 PMCID: PMC8075833 DOI: 10.1007/s00125-021-05448-w

Abstract

AIMS/HYPOTHESIS: Approximately 25% of people with type 2 diabetes experience a foot ulcer and their risk of amputation is 10-20 times higher than that of people without type 2 diabetes. Prognostic models can aid in targeted monitoring but an overview of their performance is lacking. This study aimed to systematically review prognostic models for the risk of foot ulcer or amputation and quantify their predictive performance in an independent cohort.

METHODS: A systematic review identified studies developing prognostic models for foot ulcer or amputation over minimal 1 year follow-up applicable to people with type 2 diabetes. After data extraction and risk of bias assessment (both in duplicate), selected models were externally validated in a prospective cohort with a 5 year follow-up in terms of discrimination (C statistics) and calibration (calibration plots).

RESULTS: We identified 21 studies with 34 models predicting polyneuropathy, foot ulcer or amputation. Eleven models were validated in 7624 participants, of whom 485 developed an ulcer and 70 underwent amputation. The models for foot ulcer showed C statistics (95% CI) ranging from 0.54 (0.54, 0.54) to 0.81 (0.75, 0.86) and models for amputation showed C statistics (95% CI) ranging from 0.63 (0.55, 0.71) to 0.86 (0.78, 0.94). Most models underestimated the ulcer or amputation risk in the highest risk quintiles. Three models performed well to predict a combined endpoint of amputation and foot ulcer (C statistics >0.75).

CONCLUSIONS/INTERPRETATION: Thirty-four prognostic models for the risk of foot ulcer or amputation were identified. Although the performance of the models varied considerably, three models performed well to predict foot ulcer or amputation and may be applicable to clinical practice.

Keywords: Amputation; Foot ulcer; Performance; Prognostic model; Systematic review; Type 2 diabetes

References

1. Standl E, Khunti K, Hansen TB, Schnell O (2019) The global epidemics of diabetes in the 21st century: Current situation and perspectives. Eur J Prev Cardiol 26(2_suppl):7–14. https://doi.org/10.1177/2047487319881021 - PubMed
2. Dal Canto E, Ceriello A, Ryden L, Ferrini M, Hansen TB, Schnell O et al (2019) Diabetes as a cardiovascular risk factor: An overview of global trends of macro and micro vascular complications. Eur J Prev Cardiol 26(2_suppl):25–32. https://doi.org/10.1177/2047487319878371 - PubMed
3. van DS, Beulens JW, van der Schouw YT, Grobbee DE, Neal B (2010) The global burden of diabetes and its complications: an emerging pandemic. Eur J Cardiovasc Prev Rehabil 17(Suppl 1):S3–S8 - PubMed
4. Deruaz-Luyet A, Raabe C, Garry EM, Brodovicz KG, Lavery LA (2020) Incidence of lower extremity amputations among patients with type 1 and type 2 diabetes in the United States from 2010 to 2014. Diabetes Obes Metab 22(7):1132–1140. https://doi.org/10.1111/dom.14012 - PubMed
5. American Diabetes Association (2018) 10. Microvascular Complications and Foot Care: Standards of Medical Care in Diabetes-2018. Diabetes Care 41(Suppl 1):S105–SS18. https://doi.org/10.2337/dc18-S010 - PubMed
6. Moons KG, Royston P, Vergouwe Y, Grobbee DE, Altman DG (2009) Prognosis and prognostic research: what, why, and how? BMJ. 338:b375. https://doi.org/10.1136/bmj.b375 - PubMed
7. Monteiro-Soares M, Martins-Mendes D, Vaz-Carneiro A, Sampaio S, Dinis-Ribeiro M (2014) Classification systems for lower extremity amputation prediction in subjects with active diabetic foot ulcer: a systematic review and meta-analysis. Diabetes Metab Res Rev 30(7):610–622. https://doi.org/10.1002/dmrr.2535 - PubMed
8. Crawford F, Cezard G, Chappell FM, Group P (2018) The development and validation of a multivariable prognostic model to predict foot ulceration in diabetes using a systematic review and individual patient data meta-analyses. Diabet Med 35(11):1480–1493. https://doi.org/10.1111/dme.13797 - PubMed
9. Monteiro-Soares M, Martins-Mendes D, Vaz-Carneiro A, Dinis-Ribeiro M (2015) Lower-limb amputation following foot ulcers in patients with diabetes: classification systems, external validation and comparative analysis. Diabetes Metab Res Rev 31(5):515–529 - PubMed
10. Monteiro-Soares M, Ribas R, Pereira da Silva C, Bral T, Mota A, Pinheiro Torres S et al (2017) Diabetic foot ulcer development risk classifications’ validation: A multicentre prospective cohort study. Diabetes Res Clin Pract 127:105–114. https://doi.org/10.1016/j.diabres.2017.02.034 - PubMed
11. Debray TP, Damen JA, Snell KI, Ensor J, Hooft L, Reitsma JB et al (2017) A guide to systematic review and meta-analysis of prediction model performance. BMJ. 356:i6460. https://doi.org/10.1136/bmj.i6460 - PubMed
12. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M et al (2015) Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 350:g7647. https://doi.org/10.1136/bmj.g7647 - PubMed
13. Collins GS, Reitsma JB, Altman DG, Moons KG (2015) Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med 162(1):55–63. https://doi.org/10.7326/M14-0697 - PubMed
14. Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW et al (2015) Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med 162(1):W1–W73. https://doi.org/10.7326/M14-0698 - PubMed
15. Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG et al (2014) Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med 11(10):e1001744. https://doi.org/10.1371/journal.pmed.1001744 - PubMed
16. Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS et al (2019) PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann Intern Med 170(1):W1–W33. https://doi.org/10.7326/M18-1377 - PubMed
17. Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS et al (2019) PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Ann Intern Med 170(1):51–58. https://doi.org/10.7326/M18-1376 - PubMed
18. van der Heijden AA, Rauh SP, Dekker JM, Beulens JW, Elders P, t Hart LM et al (2017) The Hoorn Diabetes Care System (DCS) cohort. A prospective cohort of persons with type 2 diabetes treated in primary care in the Netherlands. BMJ Open 7(5):e015599. https://doi.org/10.1136/bmjopen-2016-015599 - PubMed
19. R Core Team (2016) R: A Language and Environment for Statistical Computing Vienna, Austria: R Foundation for Statistical Computing - PubMed
20. Brizuela Sanz JA, Gonzalez Fajardo JA, Taylor JH, Rio Sola L, Munoz Moreno MF, Vaquero Puerta C (2016) Design of a New Risk Score in Critical Limb Ischaemia: The ERICVA Model. Eur J Vasc Endovasc Surg 51(1):90–99. https://doi.org/10.1016/j.ejvs.2015.09.025 - PubMed
21. Crawford F, McCowan C, Dimitrov BD, Woodburn J, Wylie GH, Booth E et al (2011) The risk of foot ulceration in people with diabetes screened in community settings: findings from a cohort study. QJM. 104(5):403–410. https://doi.org/10.1093/qjmed/hcq227 - PubMed
22. Hippisley-Cox J, Coupland C (2015) Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ. 351:h5441. https://doi.org/10.1136/bmj.h5441 - PubMed
23. Hurley L, Kelly L, Garrow AP, Glynn LG, McIntosh C, Alvarez-Iglesias A et al (2013) A prospective study of risk factors for foot ulceration: the West of Ireland Diabetes Foot Study. QJM. 106(12):1103–1110. https://doi.org/10.1093/qjmed/hct182 - PubMed
24. Jones RBGR, Murray KJ, Titterington DM, Allison SP (1995) A simple rule to identify people with diabetes at risk of foot ulceration. Pract Diabetes Int 12(6):256–258 - PubMed
25. Martins-Mendes D, Monteiro-Soares M, Boyko EJ, Ribeiro M, Barata P, Lima J et al (2014) The independent contribution of diabetic foot ulcer on lower extremity amputation and mortality risk. J Diabetes Complicat 28(5):632–638. https://doi.org/10.1016/j.jdiacomp.2014.04.011 - PubMed
26. Pickwell K, Siersma V, Kars M, Apelqvist J, Bakker K, Edmonds M et al (2015) Predictors of lower-extremity amputation in patients with an infected diabetic foot ulcer. Diabetes Care 38(5):852–857. https://doi.org/10.2337/dc14-1598 - PubMed
27. Venermo M, Biancari F, Arvela E, Korhonen M, Soderstrom M, Halmesmaki K et al (2011) The role of chronic kidney disease as a predictor of outcome after revascularisation of the ulcerated diabetic foot. Diabetologia. 54(12):2971–2977. https://doi.org/10.1007/s00125-011-2279-1 - PubMed
28. Dagliati A, Marini S, Sacchi L, Cogni G, Teliti M, Tibollo V et al (2018) Machine Learning Methods to Predict Diabetes Complications. J Diabetes Sci Technol 12(2):295–302. https://doi.org/10.1177/1932296817706375 - PubMed
29. Beaney AJ, Nunney I, Gooday C, Dhatariya K (2016) Factors determining the risk of diabetes foot amputations--A retrospective analysis of a tertiary diabetes foot care service. Diabetes Res Clin Pract 114:69–74. https://doi.org/10.1016/j.diabres.2016.02.001 - PubMed
30. Heald A, Lunt M, Rutter MK, Anderson SG, Cortes G, Edmonds M et al (2019) Developing a foot ulcer risk model: what is needed to do this in a real-world primary care setting? Diabet Med 36(11):1412–1416 - PubMed
31. Boyko EJ, Ahroni JH, Cohen V, Nelson KM, Heagerty PJ (2006) Prediction of diabetic foot ulcer occurrence using commonly available clinical information: the Seattle Diabetic Foot Study. Diabetes Care 29(6):1202–1207. https://doi.org/10.2337/dc05-2031 - PubMed
32. Dyck PJ, Davies JL, Wilson DM, Service FJ, Melton LJ 3rd, O’Brien PC (1999) Risk factors for severity of diabetic polyneuropathy: intensive longitudinal assessment of the Rochester Diabetic Neuropathy Study cohort. Diabetes Care 22(9):1479–1486. https://doi.org/10.2337/diacare.22.9.1479 - PubMed
33. Goodney PP, Nolan BW, Schanzer A, Eldrup-Jorgensen J, Bertges DJ, Stanley AC et al (2010) Factors associated with amputation or graft occlusion one year after lower extremity bypass in northern New England. Ann Vasc Surg 24(1):57–68. https://doi.org/10.1016/j.avsg.2009.06.015 - PubMed
34. Resnick HE, Carter EA, Sosenko JM, Henly SJ, Fabsitz RR, Ness FK et al (2004) Incidence of lower-extremity amputation in American Indians: the Strong Heart Study. Diabetes Care 27(8):1885–1891. https://doi.org/10.2337/diacare.27.8.1885 - PubMed
35. Tseng CL, Rajan M, Miller DR, Hawley G, Crystal S, Xie M et al (2005) Use of administrative data to risk adjust amputation rates in a national cohort of medicare-enrolled veterans with diabetes. Med Care 43(1):88–92 - PubMed
36. Basu S, Sussman JB, Berkowitz SA, Hayward RA, Yudkin JS (2017) Development and validation of Risk Equations for Complications Of type 2 Diabetes (RECODe) using individual participant data from randomised trials. Lancet Diabetes Endocrinol 5(10):788–798. https://doi.org/10.1016/S2213-8587(17)30221-8 - PubMed
37. Iida O, Soga Y, Hirano K, Kawasaki D, Suzuki K, Miyashita Y et al (2012) Midterm outcomes and risk stratification after endovascular therapy for patients with critical limb ischaemia due to isolated below-the-knee lesions. Eur J Vasc Endovasc Surg 43(3):313–321. https://doi.org/10.1016/j.ejvs.2011.11.025 - PubMed
38. Kasbekar PU, Goel P, Jadhav SP (2017) A Decision Tree Analysis of Diabetic Foot Amputation Risk in Indian Patients. Front Endocrinol (Lausanne) 8:25 - PubMed
39. Li CI, Lin CC, Cheng HM, Liu CS, Lin CH, Lin WY et al (2020) Derivation and validation of a clinical prediction model for assessing the risk of lower extremity amputation in patients with type 2 diabetes. Diabetes Res Clin Pract 165:108231. https://doi.org/10.1016/j.diabres.2020.108231 - PubMed
40. Crawford F, Cezard G, Chappell FM, Murray GD, Price JF, Sheikh A et al (2015) A systematic review and individual patient data meta-analysis of prognostic factors for foot ulceration in people with diabetes: the international research collaboration for the prediction of diabetic foot ulcerations (PODUS). Health Technol Assess 19(57):1–210. https://doi.org/10.3310/hta19570 - PubMed
41. Aspelund T, Thornorisdottir O, Olafsdottir E, Gudmundsdottir A, Einarsdottir AB, Mehlsen J et al (2011) Individual risk assessment and information technology to optimise screening frequency for diabetic retinopathy. Diabetologia. 54(10):2525–2532. https://doi.org/10.1007/s00125-011-2257-7 - PubMed
42. Emamipour S, van der Heijden A, Nijpels G, Elders P, Beulens JWJ, Postma MJ et al (2020) A personalised screening strategy for diabetic retinopathy: a cost-effectiveness perspective. Diabetologia. 63(11):2452–2461. https://doi.org/10.1007/s00125-020-05239-9 - PubMed
43. Heggie R, Chappell F, Crawford F, Martin A, Gupta S, Hawkins N et al (2020) Complication rate among people with diabetes at low risk of foot ulceration in Fife, UK: an analysis of routinely collected data. Diabet Med 37(12):2116–2123. https://doi.org/10.1111/dme.14339 - PubMed
44. Lavery LA, Peters EJ, Armstrong DG (2008) What are the most effective interventions in preventing diabetic foot ulcers? Int Wound J 5(3):425–433. https://doi.org/10.1111/j.1742-481X.2007.00378.x - PubMed
45. Lincoln NB, Radford KA, Game FL, Jeffcoate WJ (2008) Education for secondary prevention of foot ulcers in people with diabetes: a randomised controlled trial. Diabetologia. 51(11):1954–1961. https://doi.org/10.1007/s00125-008-1110-0 - PubMed
46. Collins GS, Ogundimu EO, Altman DG (2016) Sample size considerations for the external validation of a multivariable prognostic model: a resampling study. Stat Med 35(2):214–226. https://doi.org/10.1002/sim.6787 - PubMed
47. Vergouwe Y, Steyerberg EW, Eijkemans MJ, Habbema JD (2005) Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol 58(5):475–483. https://doi.org/10.1016/j.jclinepi.2004.06.017 - PubMed

Publication Types

• Journal Article
• Research Support, Non-U.S. Gov't