Developers of computer codes, analysts who use the codes, and decision makers who rely on the results of the analyses face a critical question: How should confidence in modeling and simulation be critically assessed? Verification and validation (V&V) of computational simulations are the primary methods for building and quantifying this confidence. Briefly, verification is the assessment of the accuracy of the solution to a computational model. Validation is the assessment of the accuracy of a computational simulation by comparison with experimental data. In verification, the relationship of the simulation to the real world is not an issue. In validation, the relationship between computation and the real world, ie, experimental data, is the issue. This paper presents our viewpoint of the state of the art in V&V in computational physics. (In this paper we refer to all fields of computational engineering and physics, eg, computational fluid dynamics, computational solid mechanics, structural dynamics, shock wave physics, computational chemistry, etc, as computational physics.) We describe our view of the framework in which predictive capability relies on V&V, as well as other factors that affect predictive capability. Our opinions about the research needs and management issues in V&V are very practical: What methods and techniques need to be developed and what changes in the views of management need to occur to increase the usefulness, reliability, and impact of computational physics for decision making about engineering systems? We review the state of the art in V&V over a wide range of topics, for example, prioritization of V&V activities using the Phenomena Identification and Ranking Table (PIRT), code verification, software quality assurance (SQA), numerical error estimation, hierarchical experiments for validation, characteristics of validation experiments, the need to perform nondeterministic computational simulations in comparisons with experimental data, and validation metrics. We then provide an extensive discussion of V&V research and implementation issues that we believe must be addressed for V&V to be more effective in improving confidence in computational predictive capability. Some of the research topics addressed are development of improved procedures for the use of the PIRT for prioritizing V&V activities, the method of manufactured solutions for code verification, development and use of hierarchical validation diagrams, and the construction and use of validation metrics incorporating statistical measures. Some of the implementation topics addressed are the needed management initiatives to better align and team computationalists and experimentalists in conducting validation activities, the perspective of commercial software companies, the key role of analysts and decision makers as code customers, obstacles to the improved effectiveness of V&V, effects of cost and schedule constraints on practical applications in industrial settings, and the role of engineering standards committees in documenting best practices for V&V. There are 207 references cited in this review article.
Skip Nav Destination
Article navigation
September 2004
Review Articles
Verification, validation, and predictive capability in computational engineering and physics
William L Oberkampf,
William L Oberkampf
Validation and Uncertainty Estimation Department, MS 0828, Sandia National Laboratories, PO Box 5800, Albuquerque NM 87185-0828; wloberk@sandia.gov
Search for other works by this author on:
Timothy G Trucano,
Timothy G Trucano
Optimization and Uncertainty Estimation Department, Sandia National Laboratories, Albuquerque NM; tgtruca@sandia.gov
Search for other works by this author on:
Charles Hirsch
Charles Hirsch
Department of Fluid Mechanics, Vrije Universiteit Brussel, Brussels, Belgium; hirsch@stro.vub.ac.be
Search for other works by this author on:
William L Oberkampf
Validation and Uncertainty Estimation Department, MS 0828, Sandia National Laboratories, PO Box 5800, Albuquerque NM 87185-0828; wloberk@sandia.gov
Timothy G Trucano
Optimization and Uncertainty Estimation Department, Sandia National Laboratories, Albuquerque NM; tgtruca@sandia.gov
Charles Hirsch
Department of Fluid Mechanics, Vrije Universiteit Brussel, Brussels, Belgium; hirsch@stro.vub.ac.be
Appl. Mech. Rev. Sep 2004, 57(5): 345-384 (40 pages)
Published Online: December 21, 2004
Article history
Online:
December 21, 2004
Citation
Oberkampf , W. L., Trucano , T. G., and Hirsch , C. (December 21, 2004). "Verification, validation, and predictive capability in computational engineering and physics ." ASME. Appl. Mech. Rev. September 2004; 57(5): 345–384. https://doi.org/10.1115/1.1767847
Download citation file:
Get Email Alerts
Cited By
Related Articles
Editorial Policy Statement on the Control of Numerical Accuracy
J. Fluids Eng (March,1986)
Level Set Methods and Dynamic Implicit Surfaces
Appl. Mech. Rev (May,2004)
JCISE Editorial – August 2022
J. Comput. Inf. Sci. Eng (August,2022)
Related Proceedings Papers
Related Chapters
Managing Energy Resources from within the Corporate Information Technology System
Industrial Energy Systems
A Bayesian Approach to Setting Equipment Performance Criteria (PSAM-0438)
Proceedings of the Eighth International Conference on Probabilistic Safety Assessment & Management (PSAM)
An Outline / Structure of Software Engineering Group Project
International Conference on Computer Technology and Development, 3rd (ICCTD 2011)