Three Hour Professional Short Course

Simulation Verification and Validation for Managers
 

About the Course

Modern scientific and engineering systems increasingly rely on computational simulation for predicted performance, reliability, and safety. Management personnel working in both private corporations and government agencies that develop simulation capabilities, or produce or use simulation results must pass judgment on the adequacy of computer simulations for their own needs or the needs of their customers. This short course is designed so that managers with little or no training in science or engineering will be able to understand the technical concepts behind verification and validation (V&V) and how they can assess and improve simulation credibility. The roles, responsibilities, and implementation costs of simulation developers, producers, and customers will be addressed.

This course includes a brief description of the value proposition of computer simulations of scientific and engineering systems, such as automobiles, medical devices, power generation equipment, and aircraft engines. This course will describe how V&V procedures contribute to the improved credibility of the simulations, thereby improving decision making by individuals and organizations. Since we recognize that time and resources are required for V&V, strong rationale will be presented for the value added to the reliability of the information provided by simulation activities. Distinctions are made between V&V, model calibration, and uncertainty quantification (UQ). This course will stress that the value proposition of conducting VV&UQ should be viewed as a trade-off between increased confidence in simulation results versus increased risk by using simulation results with unknown or unsupported credibility.

Upon completion of this course, attendees will be able to:

• Define the objectives of VV&UQ
• Improve management of code and solution verification and software quality assurance
• Improve the integration of simulation, design, and experimental testing
• Comprehend the concepts of nondeterministic simulation and UQ
• Identify sources of uncertainty including both aleatory and epistemic uncertainties
• Understand the contribution of sensitivity analyses
• Recognize the practical and organizational difficulties in implementing VV&UQ procedures

Who Should Attend

This course benefits both line and project managers directing and using simulation results in their organization, project, or workflow. In addition, management in regulatory or policy-making agencies will be able to improve the reliability of simulation-informed decisions. The course will discuss the responsibilities of organizations and individuals serving in various positions where computational simulation software, mathematical models, and simulation results are produced and/or used in decision-support roles. Attendees need not have education or training in engineering or science to benefit from this course.

Course Offering

This course is only offered as a supplement to the technical short course "Verification and Validation in Scientific Computing" for engineers and scientists. This two or three hour course can be presented either immediately before or after the two-day technical short course. This course can also be offered either in-person or fully online via Zoom.

Outline of the Course

Lecture 1: Introduction and Terminology

• Simulation-informed decision making
• Verification, validation, model calibration, and predictive capability
• Integration of simulation, design, and testing capabilities

Lecture 2: Risks and Trade-Offs in Simulation

• Diverse perspectives of risk and decision errors
• Simulation and testing trade-offs is risk, cost and schedule
• Simulation governance for management of simulation
• Corporate and regulatory perspectives of simulation credibility

Lecture 3: Simulation Responsibilities and Costs

• Software developers
• Simulation producers
• Simulation customers