Two Day Professional Short Course
Verification and Validation in Scientific Computing
About the Course
Now available as an online offering.
Engineering systems must increasingly rely on computational simulation for predicted performance, reliability, and safety. Computational analysts, designers, decision makers, and project managers who rely on simulation must have practical techniques and methods for assessing simulation credibility. This short course presents modern terminology and effective procedures for verification of numerical simulations, validation of mathematical models, and uncertainty quantification of nondeterministic simulations. The techniques presented in this course are applicable to a wide range of engineering and science applications, including fluid dynamics, heat transfer, solid mechanics, and structural dynamics. The mathematical models considered are given in terms of partial differential or integral equations, formulated as initial and boundary value problems. The computer codes that implement the mathematical models can use any type of numerical method (e.g., finite volume, finite element) and can be developed by commercial, corporate, government, or research organizations. A framework is provided for incorporating a wide range of error and uncertainty sources identified during the modeling, verification, and validation processes with the goal of estimating the total prediction uncertainty of the simulation. While the focus of the course is on modeling and simulation, experimentalists will benefit from a detailed discussion of techniques for designing and conducting high quality validation experiments. Application examples are primarily taken from the fields of fluid dynamics and heat transfer, but the techniques and procedures apply to all application areas in engineering and science. The course closely follows the course instructors' book, Verification and Validation in Scientific Computing, Cambridge University Press (2010).
Upon completion of this course, attendees will be able to:
- Define the objectives of verification, validation, and uncertainty quantification
- Implement procedures for code verification and software quality assurance
- Implement procedures for solution verification, (i.e., numerical error estimation)
- Plan and design validation experiments
- Understand procedures for model accuracy assessment
- Comprehend the concepts and procedures for non-deterministic simulation
- Identify sources of uncertainty, including both aleatory and epistemic uncertainties
- Recognize the goals of model calibration/updating
- Interpret local and global sensitivity analyses
- Recognize the practical difficulties in implementing VVUQ techniques
Who Should Attend
This course benefits model developers, computational analysts, code developers, software engineers, and experimentalists working with computational analysts. Managers directing simulation work and project engineers relying on computational simulations for decision- making will also find this course beneficial. The course will discuss the responsibilities of organizations and individuals serving in various positions where computational simulation software, mathematical models, and simulation results are produced. An undergraduate or advanced degree in engineering or the physical sciences is highly recommended. Training and experience in computational simulation of physical systems is also recommended.
Course Offering
This course can be offered as a 2 day in-person format or a 4 day fully online format via Zoom, see details below for schedule information. To discuss details and scheduling, contact Briana Blanchard bnblanch@vt.edu.
Outline of the Course (for in-person delivery)
Day 1
Lecture 1: Introduction to Verification and Validation
- Terminology and fundamental concepts
- Credibility in scientific simulation
Lecture 2: introduction to Uncertainty Quantification
- Concept of non-deterministic simulation
- Example of non-deterministic simulation
- Decision making under uncertainty
Lecture 3: Code Verification
- Software engineering
- Criteria and definitions
- Order of accuracy
- Traditional exact solutions
- Method of manufactured solutions
Lecture 4: Solution Verification
- Iterative convergence and error estimation
- Discretization error estimation
- Reliability of discretization error estimators
- Discretization error and uncertainty
Day 2
Lecture 5: Validation Experiments
- Validation fundamentals
- Validation experiment hierarchy
- Validation experiments vs. traditional experiments
- Six characteristics of validation experiments
- Detailed example of a wind tunnel validation experiment
Lecture 6: Model Accuracy Assessment
- What are validation metrics?
- Various approaches to validation metrics
- Recommended characteristics for validation metrics
- Identification of model discrepancy
- Cumulative distribution function approach
Lecture 7: Predictive Capability of Modeling and Simulation
- Identify all sources of uncertainty
- Characterize each source of uncertainty
- Estimate solution error in system responses of interest
- Estimate total uncertainty in system responses of interest
- Procedures for updating model parameters
- Types of sensitivity analysis
Lecture 8: Final Topics
- Planning and prioritization in modeling and simulation
- Maturity assessment of modeling and simulation
- Practical difficulties in implementing VVUQ technologies
Outline of the Course (for online delivery)
Day 1
Lecture 1: Introduction to Verification and Validation
Lecture 2: Introduction to Uncertainty Quantification
Day 3
Lecture 5: Validation Experiments
Lecture 6: Model Accuracy Assessment
Day 2
Lecture 3: Code Verification
Lecture 4: Solution Verification
Day 4
Lecture 7: Predictive Capability of Modeling and Simulation
Lecture 8: Final Topics