Research Papers

Definition and Implementation of a Method for Uncertainty Aggregation in Component-Based System Simulation Models

[+] Author and Article Information
Magnus Eek

Vehicle Systems,
Saab Aeronautics,
Linköping SE-581 88, Sweden
e-mail: magnus.eek@saabgroup.com

Hampus Gavel

Aeronautical Engineering & Weapons,
Saab Aeronautics,
Linköping SE-581 88, Sweden
e-mail: hampus.gavel@saabgroup.com

Johan Ölvander

Division of Machine Design,
Department of Management and Engineering,
Linköping University,
Linköping SE-581 83, Sweden
e-mail: johan.olvander@liu.se

1Corresponding author.

Manuscript received November 13, 2015; final manuscript received December 23, 2016; published online February 6, 2017. Assoc. Editor: Kevin Dowding.

J. Verif. Valid. Uncert 2(1), 011006 (Feb 06, 2017) (12 pages) Paper No: VVUQ-15-1053; doi: 10.1115/1.4035716 History: Received November 13, 2015; Revised December 23, 2016

Component-based system simulation models are used throughout all development phases for design and verification of both physical systems and control software, not least in the aeronautical industry. However, the application of structured methods for uncertainty quantification (UQ) of system simulation models is rarely seen. To enable dimensionality reduction of a UQ problem and to thereby make UQ more feasible for industry-grade system simulation models, this paper describes a pragmatic method for uncertainty aggregation. The central idea of the proposed aggregation method is to integrate information obtained during common practice component-level validation directly into the components, and to utilize this information in model-level UQ. A generic component output uncertainty description has been defined and implemented in a Modelica library for modeling and simulation (M&S) of aircraft vehicle systems. An example is provided on how to characterize and quantify a component's aggregated output uncertainty based on the component-level bench test measurement data. Furthermore, the industrial applicability of the uncertainty aggregation method is demonstrated in an approximate UQ of an aircraft liquid cooling system simulation model. For cases when the concept of thorough UQ resulting in probability boxes is not feasible, the demonstrated approximate UQ using aggregated uncertainties is considered to be a pragmatic alternative fairly in reach for the common M&S practitioner within the area of system simulation.

Copyright © 2017 by ASME
Your Session has timed out. Please sign back in to continue.


Steinkellner, S. , Andersson, H. , Gavel, H. , Lind, I. , and Krus, P. , 2010, “ Modeling and Simulation of Saab Gripens Vehicle Systems, Challenges in Processes and Data Uncertainties,” 27th International Congress of the Aeronautical Sciences (ICAS), Nice, France, Sept. 19–24.
Cooke, R. M. , and Kelly, G. N. , 2010, “ Climate Change Uncertainty Quantification: Lessons Learned From the Joint EU-USNRC Project on Uncertainty Analysis of Probabilistic Accident Consequence Codes,” Resources for the Future, Washington, DC, RFF DP 10-29.
Katz, R. W. , Craigmile, P. F. , Guttorp, P. , Haran, M. , Sanso, B. , and Stein, M. L. , 2013, “ Uncertainty Analysis in Climate Change Assessments,” Nat. Clim. Change, 3(9): pp. 769–771. [CrossRef]
Eek, M. , Kharrazi, S. , Gavel, H. , and Ölvander, J. , 2015, “ Study of Industrially Applied Methods for Verification, Validation & Uncertainty Quantification of Simulator Models,” Int. J. Model., Simul., Sci. Comput., 6(2), p. 1550014.
Carlsson, M. , Steinkellner, S. , Gavel, H. , and Ölvander, J. , 2013, “ Enabling Uncertainty Quantification of Large Aircraft System Simulation Models,” Council of European Aerospace Societies (CEAS) Conference, Linköping, Sweden, Sept. 16–19, pp. 682–692.
Saltelli, A. , Ratto, M. , Andres, T. , Campolongo, F. , Cariboni, J. , Gatelli, D. , Saisana, M. , and Tarantola, S. , 2008, Global Sensitivity Analysis: The Primer, Wiley, New York.
Helton, J. C. , Johnson, J. D. , Sallaberry, C. J. , and Storlie, C. B. , “ Survey of Sampling-Based Methods for Uncertainty and Sensitivity Analysis,” Reliability Engineering & System Safety, 91(10–11): pp. 1175–1209, 2006. [CrossRef]
Zhang, Y. , Liu, Y. , Yang, X. , and Yue, Z. , 2014, “ A Global Nonprobabilistic Reliability Sensitivity Analysis in the Mixed Aleatory–Epistemic Uncertain Structures,” Proc. Inst. Mech. Eng., Part G, 228(10), pp. 1802–1814. [CrossRef]
Roy, C. J. , and Oberkampf, W. L. , 2011, “ A Comprehensive Framework for Verification, Validation, and Uncertainty Quantification in Scientific Computing,” Comput. Methods Appl. Mech. Eng., 200(25–28), pp. 2131–2144. [CrossRef]
Coleman, H. W. , and Steele, W. G. , 2009, Experimentation, Validation, and Uncertainty Analysis for Engineers, 3 ed., Wiley, Hoboken, NJ.
Helton, J. C. , 1994, “ Treatment of Uncertainty in Performance Assessments for Complex Systems,” Risk Analysis, 14(4), pp. 483–511. [CrossRef]
Helton, J. C. , 1996, “ Probability, Conditional Probability and Complementary Cumulative Distribution Functions in Performance Assessment for Radioactive Waste Disposal,” Reliab. Eng. Syst. Safety, 54(2–3), pp. 145–163. [CrossRef]
Pace, D. K. , 2013, “ Comprehensive Consideration of Uncertainty in Simulation Use,” J. Def. Model. Simul.: Appl., Methodol., Technol., 10(4), pp. 367–380.
Pace, D. K. , 2009, “ Simulation Uncertainty and Validation,” Spring Simulation Interoperability Workshop (SISO), San Diego, CA, Mar. 23–27, pp. 547–555.
Carlsson, M. , 2013, “ Methods for Early Model Validation: Applied on Simulation Models of Aircraft Vehicle Systems,” Lic.Eng. thesis, Linköping University, Linköping, Sweden.
Krus, P. , 2005, “ Robust System Modelling Using Bi-Lateral Delay Lines,” 2nd Conference on Modeling and Simulation for Safety and Security (SimSafe), Linköping, Sweden, May 30.
Braun, R. , 2013, “ Multi-Threaded Distributed System Simulations: Using Bi-Lateral Delay Lines,” Lic.Eng. thesis, Linköping University, Linköping, Sweden.
Sjölund, M. , Braun, R. , Fritzon, P. , and Krus, P. , 2010, “ Towards Efficient Distributed Simulation in Modelica Using Transmission Line Modeling,” 3rd International Workshop on Equation-Based Object-Oriented Languages and Tools (EOOLT), Oslo, Norway, Oct. 3, pp. 71–77.
Borutzky, W. , 2002, “ Bond Graphs and Object-Oriented Modelling—A Comparison,” Proc. Inst. Mech. Eng., Part I, 216(1), pp. 21–33.
Krus, P. , 2008, “ Distributed Modelling Techniques for System Simulation,” Linköping University, Linköping, Sweden, Report No. LIU-IEI-R-08/0020-SE.
Franke, R. , Casella, F. , Sielemann, M. , Proelss, K. , Otter, M. , and Wetter, M. , 2009, “ Standardization of Thermo-Fluid Modeling in Modelica Fluid,” 7th International Modelica Conference, Como, Italy, Sept. 20–22, pp. 122–131.
Fritzson, P. , 2014, Principles of Object Oriented Modeling and Simulation With Modelica 3.3: A Cyber-Physical Approach, 2nd ed., Wiley, Hoboken, NJ.
Pace, D. K. , 2004, “ Modeling and Simulation Verification and Validation Challenges,” Johns Hopkins APL Tech. Dig., 25(2), pp. 163–172.
Carlsson, M. , Andersson, H. , Gavel, H. , and Ölvander, J. , 2012, “ Methodology for Development and Validation of Multipurpose Simulation Models,” AIAA Paper No. 2012-0877.
Simpson, T. W. , Poplinski, J. D. , Koch, P. N. , and Allen, J. K. , 2001, “ Metamodels for Computer-Based Engineering Design: Survey and Recommendations,” Eng. Comput., 17(2), pp. 129–150. [CrossRef]
Hemez, F. , Atamturktur, H. S. , and Unal, C. , 2010, “ Defining Predictive Maturity for Validated Numerical Simulations,” Comput. Struct., 88(7–8), pp. 497–505. [CrossRef]
Carlsson, M. , Gavel, H. , and Ölvander, J. , 2012, “ Utilizing Uncertainty Information in Early Model Validation,” AIAA Paper No. 2012-4852.
Carlsson, M. , Gavel, H. , and Ölvander, J. , 2012, “ Evaluating Model Uncertainty Based on Probabilistic Analysis and Component Output Uncertainty Descriptions,” ASME Paper No. IMECE2012-85236.


Grahic Jump Location
Fig. 1

Classification of modeling approaches

Grahic Jump Location
Fig. 2

Graphical view of the radar liquid cooling simulation model

Grahic Jump Location
Fig. 3

Process for specification, development, and V&V of a simulation model, supported by UQ using the component output uncertainty method. The original workflow described in Ref. [24] is here detailed in terms of possible input data used and extended with two additional dash-masked steps showing the concept of using the component output uncertainty method to support the traditional model validation against the measurement data. The dashed activities represent the UQ, and the dashed arrows indicate that the UQ make use of data from the component-level validation and is a support to the model-level validation.

Grahic Jump Location
Fig. 4

A new uncertain component (dashed) based on an original component (in this case a pipe component) connected with an uncertainty description component (here named UC). The original component's nominal pressure drop Δpcomponent is shown, as well as the added uncertainty in the pressure drop ΔpUC.

Grahic Jump Location
Fig. 5

Left: Simulation results for a ±50% variation of the pressure uncertainty parameter of a pipe component with relative output uncertainty. Right: Simulation results for a ±50% variation of the temperature uncertainty parameter of a pipe component with relative output uncertainty.

Grahic Jump Location
Fig. 6

Left: Simulation results plotted together with the measurement data. Each dot represents a steady-state measurement point, and each circle represents a simulation result for the corresponding boundary conditions. Right: The residual E for varying mass flow, computed from S and D with corresponding boundary conditions.

Grahic Jump Location
Fig. 7

Histogram representing the estimated relative output uncertainty (URUC) of the pump's pressure difference

Grahic Jump Location
Fig. 8

Mean value comparison of heat load inlet pressure and temperature using Monte Carlo sampling and LHS, respectively

Grahic Jump Location
Fig. 9

Resulting PDF and CDF for the heat load inlet pressure using Monte Carlo sampling and LHS, respectively

Grahic Jump Location
Fig. 10

LHS 250 intervals; scatter plots including result from the linear regression, R2-values in title of each subplot

Grahic Jump Location
Fig. 11

Monte Carlo, 1.5 × ·105 samples; scatter plots including the result from linear regression, R2-values in title of each subplot




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In