Display options
Share it on

PLoS One. 2017 Jun 08;12(6):e0178749. doi: 10.1371/journal.pone.0178749. eCollection 2017.

Use of the FDA nozzle model to illustrate validation techniques in computational fluid dynamics (CFD) simulations.

PloS one

Prasanna Hariharan, Gavin A D'Souza, Marc Horner, Tina M Morrison, Richard A Malinauskas, Matthew R Myers

Affiliations

  1. US Food and Drug Administration, Silver Spring, Maryland, United States of America.
  2. ANSYS, Inc., Evanston, Illinois, United States of America.

PMID: 28594889 PMCID: PMC5464577 DOI: 10.1371/journal.pone.0178749

Abstract

A "credible" computational fluid dynamics (CFD) model has the potential to provide a meaningful evaluation of safety in medical devices. One major challenge in establishing "model credibility" is to determine the required degree of similarity between the model and experimental results for the model to be considered sufficiently validated. This study proposes a "threshold-based" validation approach that provides a well-defined acceptance criteria, which is a function of how close the simulation and experimental results are to the safety threshold, for establishing the model validity. The validation criteria developed following the threshold approach is not only a function of Comparison Error, E (which is the difference between experiments and simulations) but also takes in to account the risk to patient safety because of E. The method is applicable for scenarios in which a safety threshold can be clearly defined (e.g., the viscous shear-stress threshold for hemolysis in blood contacting devices). The applicability of the new validation approach was tested on the FDA nozzle geometry. The context of use (COU) was to evaluate if the instantaneous viscous shear stress in the nozzle geometry at Reynolds numbers (Re) of 3500 and 6500 was below the commonly accepted threshold for hemolysis. The CFD results ("S") of velocity and viscous shear stress were compared with inter-laboratory experimental measurements ("D"). The uncertainties in the CFD and experimental results due to input parameter uncertainties were quantified following the ASME V&V 20 standard. The CFD models for both Re = 3500 and 6500 could not be sufficiently validated by performing a direct comparison between CFD and experimental results using the Student's t-test. However, following the threshold-based approach, a Student's t-test comparing |S-D| and |Threshold-S| showed that relative to the threshold, the CFD and experimental datasets for Re = 3500 were statistically similar and the model could be considered sufficiently validated for the COU. However, for Re = 6500, at certain locations where the shear stress is close the hemolysis threshold, the CFD model could not be considered sufficiently validated for the COU. Our analysis showed that the model could be sufficiently validated either by reducing the uncertainties in experiments, simulations, and the threshold or by increasing the sample size for the experiments and simulations. The threshold approach can be applied to all types of computational models and provides an objective way of determining model credibility and for evaluating medical devices.

References

  1. Ann Biomed Eng. 2002 Jun;30(6):743-52 - PubMed
  2. Ann Thorac Surg. 2005 Jun;79(6):2094-102 - PubMed
  3. J Biomech Eng. 2011 Mar;133(3):031001 - PubMed
  4. Ann Biomed Eng. 2011 Jul;39(7):1947-60 - PubMed
  5. J Biomech Eng. 2011 Apr;133(4):041002 - PubMed
  6. J Biomech Eng. 2011 Apr;133(4):041003 - PubMed
  7. Ann Biomed Eng. 2012 Apr;40(4):860-70 - PubMed
  8. J Biomech Eng. 2011 Nov;133(11):111006 - PubMed
  9. J Biomech Eng. 2013 Feb;135(2):021016 - PubMed
  10. Cardiovasc Eng Technol. 2013 Dec 1;4(4):null - PubMed
  11. Comput Biol Med. 2014 Apr;47:113-9 - PubMed
  12. PLoS One. 2014 Mar 25;9(3):e92638 - PubMed
  13. Cardiovasc Eng Technol. 2014 Jun 1;5(2):189-201 - PubMed
  14. J Biomech. 2014 Sep 22;47(12):3210-6 - PubMed
  15. PLoS One. 2014 Aug 29;9(8):e105357 - PubMed
  16. J Thorac Cardiovasc Surg. 2015 Jan;149(1):247-55 - PubMed
  17. J Biomech. 2015 Apr 13;48(6):1147-57 - PubMed
  18. Int J Numer Method Biomed Eng. 2016 Mar;32(3):e02737 - PubMed
  19. ASAIO J. 2017 Mar/Apr;63(2):150-160 - PubMed
  20. Comput Fluids. 2017 Jan 5;142:128-138 - PubMed
  21. J Biomech. 2016 Dec 8;49(16):3815-3823 - PubMed
  22. J Med Device. 2017;11(2):null - PubMed
  23. Biophys J. 1972 Mar;12(3):257-73 - PubMed

MeSH terms

Publication Types