Display options
Cite
Najarian M, Lim GJ. Design and Assessment Methodology for System Resilience Metrics. Risk Anal. 2019;39(9):1885-1898doi: 10.1111/risa.13274.
Najarian, M., & Lim, G. J. (2019). Design and Assessment Methodology for System Resilience Metrics. Risk analysis : an official publication of the Society for Risk Analysis, 39(9), 1885-1898. https://doi.org/10.1111/risa.13274
Najarian, Mohammad, and Lim, Gino J. "Design and Assessment Methodology for System Resilience Metrics." Risk analysis : an official publication of the Society for Risk Analysis vol. 39,9 (2019): 1885-1898. doi: https://doi.org/10.1111/risa.13274
Najarian M, Lim GJ. Design and Assessment Methodology for System Resilience Metrics. Risk Anal. 2019 Sep;39(9):1885-1898. doi: 10.1111/risa.13274. Epub 2019 Feb 14. PMID: 30763465.
Copy Download .nbib Format: NLM
Share it on

Risk Anal. 2019 Sep;39(9):1885-1898. doi: 10.1111/risa.13274. Epub 2019 Feb 14.

Design and Assessment Methodology for System Resilience Metrics.

Risk analysis : an official publication of the Society for Risk Analysis

Mohammad Najarian, Gino J Lim

Affiliations

  1. Department of Industrial Engineering, University of Houston, Houston, TX, USA.

PMID: 30763465 DOI: 10.1111/risa.13274

Abstract

By providing objective measures, resilience metrics (RMs) help planners, designers, and decisionmakers to have a grasp of the resilience status of a system. Conceptual frameworks establish a sound basis for RM development. However, a significant challenge that has yet to be addressed is the assessment of the validity of RMs, whether they reflect all abilities of a resilient system, and whether or not they overrate/underrate these abilities. This article covers this gap by introducing a methodology that can show the validity of an RM against its conceptual framework. This methodology combines experimental design methods and statistical analysis techniques that provide an insight into the RM's quality. We also propose a new metric that can be used for general systems. The analysis of the proposed metric using the presented methodology shows that this metric is a better indicator of the system's abilities compared to the existing metrics.

© 2019 Society for Risk Analysis.

Keywords: Experimental design; power systems; resilience metric; resilience metric assessment; resilience quantification; statistical analysis

References

  1. Abbasi, S., Barati, M., & Lim, G. J. (2017aa). A parallel sectionalized restoration scheme for resilient smart grid systems. IEEE Transactions on Smart Grid. https://doi.org/10.1109/TSG.2017.2775523 - PubMed
  2. Abbasi, S., Barati, M., & Lim, G. J. (2017b). A GPP-based sectionalization toward a fast power transmission system restoration. Presented at the International Conference on Applied Human Factors and Ergonomics (pp. 11-21). Los Angeles, CA: Springer. - PubMed
  3. Abbasi, S., Barati, M., & Lim, G. J. (2017c). A multi-objective MPEC model for disaster management of power system restoration. Proceedings of the 2017 Industrial and Systems Engineering Conference, Pittsburgh, PA. - PubMed
  4. Ahmadian, S., Vahidi, B., Jahanipour, J., Hoseinian, S. H., & Rastegar, H. (2016). Price restricted optimal bidding model using derated sensitivity factors by considering risk concept. Transmission Distribution IET Generation, 10, 310-324. - PubMed
  5. Alexander, D. E. (2013). Resilience and disaster risk reduction: An etymological journey. Natural Hazards and Earth System Sciences, 13, 2707-2716. - PubMed
  6. Ayyub, B. M. (2014). Systems resilience for multihazard environments: Definition, metrics, and valuation for decision making. Risk Analysis, 34, 340-355. - PubMed
  7. Barker, K., Ramirez-Marquez, J. E., & Rocco, C. M. (2013). Resilience-based network component importance measures. Reliability Engineering & System Safety, 117, 89-97. - PubMed
  8. Baroud, H., Barker, K., Ramirez-Marquez, J. E., & Rocco S, C. M. (2014). Importance measures for inland waterway network resilience. Transportation Research Part E: Logistics and Transportation Review, 62, 55-67. - PubMed
  9. Bertsimas, D., Litvinov, E., Sun, X. A., Zhao, J., & Zheng, T. (2013). Adaptive robust optimization for the security constrained unit commitment problem. IEEE Transactions on Power Systems, 28, 52-63. - PubMed
  10. Brink, T. L. (1994). R.L. Keeney, H. Raiffa: Decisions with multiple objectives-preferences and value tradeoffs, Cambridge University Press, Cambridge & New York, 1993, 569 pages, ISBN 0-521-44185-4 (hardback), 0-521-43883-7 (paperback). Behavioral Science, 39, 169-170. - PubMed
  11. Brown, R. (2015). Building children and young people's resilience: Lessons from psychology. International Journal of Disaster Risk Reduction, 14, 115-124. - PubMed
  12. Bruneau, M., Chang, S. E., Eguchi, R. T., Lee, G. C., O'Rourke, T. D., Reinhorn, A. M., … von Winterfeldt, D. (2003). A framework to quantitatively assess and enhance the seismic resilience of communities. Earthquake Spectra, 19, 733-752. - PubMed
  13. Buchta, J., Oziemski, A., & Pawlik, M. (2014). Probabilistic issue of reliability for power machinery operating in coal fired power plants. Journal of Power and Energy Engineering, 2, 139-145. - PubMed
  14. Cadwallader, L. C. (2012). Review of maintenance and repair times for components in technological facilities. Idaho Falls, ID: Idaho National Laboratory Experimental Programs. - PubMed
  15. Cai, E. (2014). Applied statistics lesson of the day-Choosing the number of levels for factors in experimental design. Retrieved from https://chemicalstatistician.wordpress.com/2014/01/07/statistics-lesson-of-the-day-choosing-the-range-of-levels-for-quantitative-factors-in-experimental-design/. - PubMed
  16. Calixto, E. (2016). Gas and Oil Reliability Engineering: Modeling and Analysis, 2nd ed. (pp. 269-470). Boston, MA: Gulf Professional Publishing. - PubMed
  17. Capacity planning. (2018). Wikipedia. Retrieved from https://en.wikipedia.org/w/index.php?title=Capacity_planning&oldid=825878948. - PubMed
  18. Carlson, L., Basset, G., Buehring, W., Collins, M., Folga, S., Haffenden, B., … Whitfield, R. (2012). Resilience theory and applications. Technical Report. Argonne, IL: Argonne National Laboratory. - PubMed
  19. Chanda, S., & Srivastava, A. K. (2016). Defining and enabling resiliency of electric distribution systems with multiple microgrids. IEEE Transactions on Smart Grid, 7. https://doi.org/10.1109/TSG.2016.2561303 - PubMed
  20. Cimellaro, G. P., Reinhorn, A. M., & Bruneau, M. (2010). Framework for analytical quantification of disaster resilience. Engineering Structures, 32, 3639-3649. - PubMed
  21. Cimellaro, G. P., Villa O., & Bruneau, M. (2015). Resilience-based design of natural gas distribution networks. Journal of Infrastructure Systems, 21, 05014005. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000204 - PubMed
  22. Collier, Z. A., Panwar, M., Ganin, A. A., Kott, A., & Linkov, I. (2016). Security metrics in industrial control systems. In Cyber-security of SCADA and other industrial control systems (pp. 167-185). Cham, Switzerland: Springer. - PubMed
  23. Corotis, R. B. (2012). Robustness versus resilience: Hurricanes and other natural hazard risks (pp. 900-911). ATC & SEI Conference on Advances in Hurricane Engineering 2012, American Society of Civil Engineers, Miami, FL. - PubMed
  24. ENISA. (2011). Resilience metrics and measurements. Technical Report. Heraklion, Greece: Author. - PubMed
  25. FEMA. (2006). Hurricane Katrina in the Gulf Coast Mitigation Assessment Team Report (No. FEMA 549). Washington, DC: Author. - PubMed
  26. FEMA. (2017). FEMA fact sheet: Mitigation Assessment Team results-Hurricane Sandy. Washington, DC: Author. - PubMed
  27. Francis, R., & Bekera, B. (2014). A metric and frameworks for resilience analysis of engineered and infrastructure systems. Reliability Engineering & System Safety, 121, 90-103. - PubMed
  28. Ganin, A. A., Massaro, E., Gutfraind, A., Steen, N., Keisler, J. M., Kott, A., … Linkov, I. (2016). Operational resilience: Concepts, design and analysis. Scientific Reports, 6, 19540. https://doi.org/10.1038/srep19540 - PubMed
  29. Goodykoontz, E., Taylor, A., Jackson, B., Jones, E., Nashed, S., Reichow, S., & Smith, A. (2015). Measuring for results: Application of key concepts to resilience measurement (series on performance management). Falls Church, VA: Homeland Security Studies and Analysis Institute. - PubMed
  30. Heinimann, H. R., & Hatfield, K. (2017). Infrastructure resilience assessment, management and governance-state and perspectives. In I. Linkov, & J. M. Palma-Oliveira. (Eds.), Resilience and risk, pp. 147-187. Dordrecht: Springer. - PubMed
  31. Henry, D., & Emmanuel Ramirez-Marquez, J. (2012). Generic metrics and quantitative approaches for system resilience as a function of time. Reliability Engineering & System Safety, 99, 114-122. - PubMed
  32. Holling, C. S. (1973). Resilience and stability of ecological systems. Annual Review of Ecology and Systematics, 4, 1-23. - PubMed
  33. Hosseini, S., Barker, K., & Ramirez-Marquez, J. E. (2016). A review of definitions and measures of system resilience. Reliability Engineering & System Safety, 145, 47-61. - PubMed
  34. IBM Knowledge Center. (2018). Java tutorial. Retrieved from https://www.ibm.com/support/knowledgecenter/en/SSSA5P_12.6.3/ilog.odms.cplex.help/CPLEX/GettingStarted/topics/tutorials/Java/Java_synopsis.html. - PubMed
  35. Jen, E. (2003). Stable or robust? What's the difference? Complexity, 8, 12-18. - PubMed
  36. Ji, C., & Wei, Y. (2015). Dynamic resilience for power distribution and customers. In 2015 IEEE International Conference on Smart Grid Communications, IEEE SmartGridComm, Miami, FL (pp. 822-827). - PubMed
  37. Jin, J. G., Tang, L. C., Sun, L., & Lee, D.-H. (2014). Enhancing metro network resilience via localized integration with bus services. Transportation Research Part E: Logistics and Transportation Review, 63, 17-30. - PubMed
  38. Kadri, F., & Chaabane, S. (2015). Resilience-based performance assessment of strain situations in emergency departments. Presented at the 6th IESM Conference, Seville, Spain. - PubMed
  39. Kamalahmadi, M., & Parast, M. M. (2016). A review of the literature on the principles of enterprise and supply chain resilience: Major findings and directions for future research. International Journal of Production Economics, 171(Part 1), 116-133. - PubMed
  40. Khayatian, A., Barati, M., & Lim, G. J. (2016). Market-based and resilient coordinated microgrid planning under uncertainty. 2016 IEEE/PES Transmission and Distribution Conference and Exposition (T & D) (pp. 1-5), Dallas, TX. - PubMed
  41. Khayatian, A., Barati, M., & Lim, G. J. (2018). Integrated microgrid expansion planning in electricity market with uncertainty. IEEE Transactions on Power Systems, 33, 3634-3643. - PubMed
  42. Khodaei, A., & Shahidehpour, M. (2010). Transmission switching in security-constrained unit commitment. IEEE Transactions on Power Systems, 25, 1937-1945. - PubMed
  43. Kiran, D. R. (2017). Chapter 27-Reliability engineering. In Total quality management (pp. 391-404). Oxford, UK: Butterworth-Heinemann. - PubMed
  44. Kwasinski, A. (2016). Quantitative model and metrics of electrical grids’ resilience evaluated at a power distribution level. Energies, 9, 93. https://doi.org/10.3390/en9020093 - PubMed
  45. Kwok, A. H., Doyle, E. E. H., Becker, J., Johnston, D., & Paton, D. (2016). What is “social resilience”? Perspectives of disaster researchers, emergency management practitioners, and policymakers in New Zealand. International Journal of Disaster Risk Reduction, 19, 197-211. - PubMed
  46. Liu, Y., Wu, Q. H., & Zhou, X. X. (2016). Co-ordinated multiloop switching control of DFIG for resilience enhancement of wind power penetrated power systems. IEEE Transactions on Sustainable Energy, 7, 1089-1099. - PubMed
  47. Matos, M., Bessa, R., Botterud, A., & Zhou, Z. (2017). Chapter 11-Forecasting and setting power system operating reserves. In G. Kariniotakis (Ed.), Renewable energy forecasting (pp. 279-308). Cambridge, UK: Woodhead Publishing. - PubMed
  48. Montgomery, D. C. (1991). Design and analysis of experiments. Hoboken, NJ: John Wiley & Sons. - PubMed
  49. National Hurricane Center. (2018). Costliest U.S. tropical cyclones: Tables update. Silver Spring, MD: NOAA. - PubMed
  50. National Infrastructure Advisory Council. (2009). Critical infrastructure resilience, Final report and recommendations. Arlington, VA: Author. - PubMed
  51. O'Connor, P. (2002). Practical reliability engineering (4th ed). Hoboken, NJ: Wiley. - PubMed
  52. Omer, M., Nilchiani, R., & Mostashari, A. (2009). Measuring the resilience of the global Internet infrastructure system. 2009 3rd Annual IEEE Systems Conference (pp. 156-162), Vancouver, Canada. - PubMed
  53. Ouyang, M., & Dueñas-Osorio, L. (2012). Time-dependent resilience assessment and improvement of urban infrastructure systems. Chaos: An Interdisciplinary Journal of Nonlinear Science, 22, 033122. https://doi.org/10.1063/1.4737204 - PubMed
  54. Ouyang, M., & Dueñas-Osorio, L. (2014). Multi-dimensional hurricane resilience assessment of electric power systems. Structural Safety, 48, 15-24. - PubMed
  55. Oyedepo, S. O., Fagbenle, R. O., & Adefila, S. S. (2015). Assessment of performance indices of selected gas turbine power plants in Nigeria. Energy Science & Engineering, 3, 239-256. - PubMed
  56. Phillips, J., Finster, M., Pillon, J., Petit, F., & Trail, J. (2016). State energy resilience framework. Argonne, IL: Argonne National Laboratory. - PubMed
  57. Podofillini, L., Sudret, B., Stojadinovic, B., Zio, E., & Kröger, W. (2015). Safety and reliability of complex engineered systems. London, UK: CRC Press. - PubMed
  58. Renschler, C. S., Frazier, A. E., Arendt, L. A., Cimellaro, G. P., Reinhorn, A. M., & Bruneau, M. (2010). Developing the “PEOPLES” resilience framework for defining and measuring disaster resilience at the community scale. Proceedings of the 9th US National and 10th Canadian Conference on Earthquake Engineering (9USN/10CCEE) (pp. 25-29), Toronto. - PubMed
  59. Rose, A. Z. (2004). Defining and measuring economic resilience to disasters. Disaster Prevention and Management: An International Journal, 13, 307-314. - PubMed
  60. Sahebjamnia, N., Torabi, S. A., & Mansouri, S. A. (2018). Building organizational resilience in the face of multiple disruptions. International Journal of Production Economics, 197, 63-83. - PubMed
  61. Shen, L., & Tang, L. (2015). A resilience assessment framework for critical infrastructure systems. 2015 First International Conference on Reliability Systems Engineering (ICRSE) (pp. 1-5), Beijing, China. - PubMed
  62. Smith, A. B., & Katz, R. W. (2013). US billion-dollar weather and climate disasters: Data sources, trends, accuracy and biases. Natural Hazards, 67, 387-410. - PubMed
  63. Sterbenz, J. P. G., Hutchison, D., Çetinkaya, E. K., Jabbar, A., Rohrer, J. P., Schöller, M., & Smith, P. (2010). Resilience and survivability in communication networks: Strategies, principles, and survey of disciplines. Computer Networks, 54, 1245-1265. - PubMed
  64. The National Academy. (2012). Disaster resilience: A national imperative. Washington, DC: National Academies Press. Retrieved from http://www.nap.edu/catalog/13457/disaster-resilience-a-national-imperative. - PubMed
  65. Tolk, J., Fritts, S., Cantu, J., & Gharehyakheh, A. (2017). Deriving quantitative measures for high reliability organizations. International Annual Conference of the American Society for Engineering Management, Huntsville, AL. - PubMed
  66. Vugrin, E. D., Stamber, K. L., Baca, M., Kao, G., Le, H., Mtchell, M., … Welch, K. (2012). A mission resilience assessment methodology for infrastructure disruptions. 2012 IEEE International Carnahan Conference on Security Technology (ICCST) (pp. 53-58), Boston, MA. - PubMed
  67. Wang, J. W., Gao, F., & Ip, W. H. (2010). Measurement of resilience and its application to enterprise information systems. Enterprise Information Systems, 4, 215-223. - PubMed
  68. Watson, J.-P., Guttromson, R., Silva-Monroy, C., Jeffers, R., Jones, K., Ellison, J., … Walker, L. T. (2014). Conceptual framework for developing resilience metrics for the electricity, oil, and gas sectors in the United States (No. SAND2014-18019) (pp. 104). Albuquerque, NM: Sandia National Laboratories. - PubMed
  69. Whitson, J. C., & Ramirez-Marquez, J. E. (2009). Resiliency as a component importance measure in network reliability. Reliability Engineering & System Safety, 94, 1685-1693. - PubMed
  70. Willis, H. H., & Loa, K. (2015). Measuring the resilience of energy distribution systems. Santa Monica, CA: RAND Corporation. - PubMed
  71. Yodo, N., & Wang, P. (2016). Engineering resilience quantification and system design implications: A literature survey. Journal of Mechanical Design, 138, 111408. https://doi.org/10.1115/1.4034223 - PubMed
  72. Zhang, W., & Wang, N. (2016). Resilience-based risk mitigation for road networks. Structural Safety, 62, 57-65. - PubMed
  73. Zobel, C. W., & Khansa, L. (2014). Characterizing multi-event disaster resilience. Multiple Criteria Decision Making in Emergency Management, 42, 83-94. - PubMed

Publication Types