Abstract
This paper develops a simulation-based mission mobility reliability (MMR) analysis framework to account for uncertainty in mobility prediction of off-road ground vehicles in mission planning. A concept of MMR is first proposed to quantify reliability of a mission path which passes through different types of soils. A single-loop Kriging surrogate modeling method is then employed to overcome the computational challenge in MMR assessment caused by expensive mobility simulations. Built upon the surrogate model-based MMR analysis, a dynamic updating scheme is proposed to update the MMR estimation using online mobility data, during the course of a specific mission and for a particular vehicle. The online dynamic updating of MMR allows us for effective and dynamic decision-making during the mission phase, thus proactively avoid rare events of immobility during the mission. A case study demonstrates the efficacy of the proposed MMR analysis and updating framework.
1 Introduction
Off-road vehicle mobility analysis and its modeling and simulation (M&S) are important steps in developing and operating off-road vehicles [1]. In battlefield especially, using M&S tools to predict the capability of a vehicle to go through a certain area can provide important guidelines in designing off-road ground vehicles and planning operations [2]. In order to make good use of off-road ground vehicle M&S, the U.S. Army Tank Automotive Research, Development, and Engineering Center (TARDEC) which is now called Ground Vehicle Systems Center (GVSC) developed the North Atlantic Treaty Organization (NATO) Reference Mobility Model (NRMM) in the 1960s [2–6]. Other than the developed NRMM and its upgrades, a next-generation NRMM (NG-NRMM) using multibody dynamic modeling and new simulation techniques is being developed to further improve the prediction capability and accuracy of the mobility models [2,7,8].
In addition to the NRMM and NG-NRMM, many other mobility analysis models have also been developed in the past decades to predict ground vehicle performance under different off-road conditions. For instance, using Bekker's equations, an analytical tool called Bekker's Derived Terramechanics Model (BDTM) has been developed to evaluate vehicle off-road mobility [9]. Recuero et al. [10] developed a mobility simulation model using nonlinear finite element tires on granular material. Serban et al. [11] proposed a co-simulation framework for vehicle–terrain interaction simulation. By developing a computer program called WinMaku, Korlath et al. performed a simulation of mobility performance for off-road vehicles. Also, Hetherington [12] suggested a model using mean maximum pressure (MMP) to specify off-road performance of vehicles. The problem is that all models above treat road conditions as deterministic values. However, in reality, there are many sources of uncertainty such as the uncertainty in vehicle parameters, uncertainty in soil property, and uncertainty in the soil map [13], which lead to uncertainty in the predicted off-road vehicle mobility. In order to account for uncertainty in mobility prediction, Lessem et al. [14,15] and Priddy [16] converted deterministic NRMM into a stochastic model so that the variability of vehicle mobility can be included in the prediction.
Similarly, for NG-NRMM, the stochastic mobility modeling is still one of the most important topics in mobility prediction [17]. Several approaches have been proposed to meet the need of performing stochastic mobility prediction in NG-NRMM. For example, using a hardware-in-the-loop real-time simulator, Bradbury et al. [7] proposed a Monte Carlo simulation method (MCS) to predict the vehicle performance under uncertainty; Gonzalez et al. used the Kriging surrogate modeling approach to model terrain elevation in predicting off-road mobility over large spatial regions [18]; they also used Kriging surrogate model to develop a stochastic mobility map [19]; a dynamic Kriging-based method was developed in Ref. [17] to improve the effectiveness of Kriging surrogate modeling in generating stochastic off-road mobility map; Hu et al. [13] proposed a mobility testing design method to effectively reduce the uncertainty in mobility prediction and select the best mobility model from competing mobility models; Detweiler et al. [20] developed interpolation approaches for terrain maps to get a high-fidelity 3D terrain surface.
Despite the above progress in stochastic vehicle mobility prediction, there are several challenging issues that need to be addressed to meet the demand of NG-NRMM. For instance, (1) current approaches only considered the uncertainty in mobility prediction at specific locations and have not investigated effects of mobility prediction uncertainty on mission planning; (2) even though Kriging surrogate model has been used to reduce the computational time in vehicle mobility prediction, the required computational effort is still high; and (3) the integration of the off-road ground vehicle M&S and vehicle online operation data have been rarely studied.
In order to solve the aforementioned challenging issues and fill the void in simulation-based mobility prediction under uncertainty, this paper develops a new simulation-based mission mobility reliability (MMR) analysis framework for off-road ground vehicles. In contrast to the current approaches which focus only on mobility prediction uncertainty at specific locations, the proposed framework not only investigates the effects of mobility dependence over space on mission planning, but also overcomes the computational challenges in mobility prediction under uncertainty without sacrificing the accuracy. The main contributions can be summarized as (1) definition of MMR for the first time to quantify the effects of mobility prediction uncertainty on mission planning; (2) employment of a single-loop Kriging surrogate modeling method [21] to efficiently evaluate MMR by refining the Kriging surrogate model in regions which are critical for the MMR analysis; and (3) development of a Bayesian updating scheme which allows for dynamical updating of MMR over the course of a mission based on vehicle operational data. The synthesis of the aforementioned three contributions enables the off-road ground vehicle to proactively avoid rare events of immobility during a mission, and thus guarantee the safety of the vehicle on the battlefield.
The remainder of this paper is organized as follows: Sec. 2 introduces the background of off-road vehicle mobility model and MMR. Section 3 describes the proposed simulation-based off-road ground vehicle MMR analysis framework. Section 4 uses a case study to demonstrate the proposed framework. Section 5 concludes the results, contributions, and future works.
2 Background
2.1 Off-Road Vehicle Mobility Model.
Among the developed models, NRMM is one of the most commonly used models. Its development started in the 1950s [23]. There are also other upgrades such as NRMM II, in order to increase the performance of the mobility prediction model [16,24]. Since NRMMs were developed several decades ago, the performance of these models is limited by the analysis methods and computing capabilities. With the development of powerful computational tools such as finite element analysis (FEA), high-performance computation, and simulation techniques, and with the need of developing advanced vehicle systems such as autonomous vehicles, there is an urgent need to develop the NG-NRMM [25]. One of the important aspects of the NG-NRMM is to account for the uncertainty in the vehicle mobility prediction.
2.2 Mission Mobility Reliability.
As mentioned earlier, accounting for the uncertainty in vehicle mobility prediction is one of the most important aspects of NG-NRMM. The inherent uncertainty in the terrain and soil properties and variability of the vehicle performances lead to the uncertainty of the vehicle mobility. As shown in Fig. 1, if a vehicle design and a soil region are selected, a soil map can be used in conjunction with the vehicle mobility model to generate a mobility map. Due to the uncertainty in both the vehicle systems and the soil map, there is uncertainty in the vehicle mobility for any given spatial location d.
The aforementioned MMR quantifies the probability that the vehicle completes the mission path without immobility. Once an event of immobility happens, it implies that the mission is failed. Evaluating this MMR plays a vital role in guaranteeing the safety of the off-road ground vehicle in the battlefield and avoiding events of immobility, especially for autonomous ground vehicles.
Due to the involvement of computer simulation models of vehicle–terrain interaction and soil maps, the evaluation of Eqs. (8) or (9) is not straightforward. There are two main challenges that need to be addressed to perform the MMR analysis.
First, the mobility prediction model given in Eqs. (8) and (9) is usually high-fidelity M&S. The evaluation of MMR needs to execute the high-fidelity M&S numerous times, which is computationally prohibitive.
Second, there are many sources of uncertainty presented in the mobility analysis. Some of the uncertainty sources, such as the variability in the soil properties, can be reduced when a particular vehicle starts to proceed on a pre-specified mission path. As the vehicle proceeds over the path, more and more field information about the vehicle mobility will be collected. The probability of accomplishing the mission (i.e., MMR) will then change over time and needs to be updated. How to leverage the field information in the MMR analysis is the second challenging issue that needs to be addressed.
In order to tackle the above-mentioned challenges, in the subsequent section (Sec. 3), a simulation-based off-road ground vehicle MMR analysis approach is proposed.
3 Simulation-Based Off-Road Ground Vehicle Mission Mobility Reliability Analysis
In this section, we first provide a brief overview of the proposed simulation-based MMR analysis framework. Following that, we explain the proposed framework in details.
3.1 Overview.
Figure 3 shows an overview of the proposed framework. As shown in this figure, there are two phases of off-road ground vehicle MMR analysis, namely (1) mission-planning phase and (2) during-mission phase. The two phases are connected through the mobility M&S as indicated in the figure. The main objectives of the two phases are explained as below:
Phase 1-mission-planning phase: In the mission-planning phase, the MMR of a given mission path is evaluated with the consideration of the natural variability of soil properties over the mission path. The main objective is to address the challenges in solving Eq. (8) to provide the probability of completing a mission in the early planning stage.
Phase 2-during-mission phase: In the mission-planning phase, the MMR analysis is purely based on the M&S and soil maps. Even though there is uncertainty in the soil properties and vehicle system, the soil properties and vehicle system parameters are deterministic values in reality for a particular vehicle and a specific mission path. As a result, a mission can only have two states: success or fail. In the during-mission phase, vehicle mobility measurement data collected through sensors on the vehicle are used to update the MMR estimate dynamically based on the MMR analysis approach developed in Phase 1. This dynamic updating of MMR allows us to predict the failure (i.e., immobility) with high confidence before it happens and thus proactively avoid the situation of immobility. As illustrated in Fig. 3, the MMR gets close to the ground truth (i.e., success or fail) as the vehicle proceeds on the mission path.
Next, we provide more details about the two phases of the simulation-based MMR analysis.
3.2 Simulation-Based Mission Mobility Reliability Analysis in Mission-Planning Phase.
In the mission-planning phase, the simulation-based MMR analysis is very similar to the time-dependent reliability analysis problems [28,29]. In recent years, various time-dependent reliability analysis approaches, such as first-order reliability method-based methods [30,31], sampling-based approaches [32,33], and adaptive surrogate-modeling-based methods [34–38], have been proposed to overcome the computational issue in reliability analysis. For the MMR analysis, the reliability is space-dependent instead of time-dependent. Moreover, the MMR needs to be updated in the during-mission phase using the Bayesian method. Considering the fact that the M&S is shared by both the mission-planning and during-mission phases, the surrogate-modeling-based method is employed. More specifically, the single-loop Kriging (SILK) surrogate modeling approach [21] is employed in this paper, since SILK can easily handle the presence of both random variables and stochastic processes in reliability analysis.
The employment of SILK in the mission-planning phase, however, is not very straightforward. Two issues need to be addressed in order to perform MMR analysis with SILK. The first issue is the simulation of soil properties over the mission path, and the second one is the generation of training points for surrogate modeling. In what follows, we discuss how to tackle these two issues in detail.
3.2.1 Simulation of Soil Properties Over the Mission Path.
Using Eqs. (10) through (16), random realizations can be generated for . As illustrated in Fig. 4, the random realizations of are then assembled together according to the coordinates on the mission path to obtain random realizations of . The random realizations of are used as the inputs in the SILK method [21] for (1) the selection of new training points in refining the surrogate model of the mobility model and (2) MMR analysis. Next, we will discuss how to generate initial training points for the surrogate modeling of the mobility model .
3.2.2 Generation of Training Points for Surrogate Modeling.
Generation initial training points. For any specific coordinates , Fig. 5 shows the relationships between the map coordinates, soil type (i.e., ID), slope type/ID, and space-dependent parameters .
As shown in the previous figure, the soil property parameters share the same soil ID for any given spatial point, . The soil ID represented as integer values governs the statistical parameters of soil properties (e.g., bulk density, friction coefficient, and cohesive strength). It indicates that there are strong dependences among the soil-type-related parameters. In order to maintain the strong dependences in generating initial training points for , in this paper, two sets of initial training points are first generated using Latin hypercube sampling method [39].
Since may not accurately represent the original high-fidelity mobility model, it could lead to large error in the MMR analysis. To improve the accuracy of reliability analysis, many adaptive surrogate modeling methods have been proposed. As mentioned earlier, the SILK method is employed in this paper for the MMR analysis because it is capable to handle time-dependent problem which is similar to the space-dependent problem. Next, we discuss how to adaptively add new training points to refine the surrogate model.
Until now, we have discussed all the details for simulation-based MMR analysis in the mission-planning phase. By overcoming the computational challenge in this phase, we are able to efficiently perform the MMR analysis and ensure the MMR in mission planning. While the planned mission path usually has a high MMR, there is still a risk of having immobility (i.e., failure) events when the vehicle proceeds on the path. The dynamic updating of MMR in the during-mission phase (as discussed in Sec. 3.3) allows us to sense the immobility events before it happens and thus proactively avoid rare events of failures (i.e., immobility).
3.3 Dynamic Updating of Mission Mobility Reliability in the During-Mission Phase.
The goal of dynamic updating of MMR in the during-mission phase is to proactively forecast the failure based on vehicle measurement data given that a vehicle has already accomplished part of the mission path (as illustrated in Fig. 6).
A critical step in evaluating Eq. (29) is to update and based on . The challenge of performing this updating is that there is no direct relationship between the random variables and and . Fortunately, the vehicle mobility M&S provides such a bridge between these variables and the measurement data. In this section, a sequential updating scheme is proposed to dynamically update MMR (as shown in Fig. 7). It consists of three main steps, namely, (1) Bayesian inference of uncertainty parameters, (2) uncertainty sources updating, and (3) MMR updating and remaining mobilable distance estimation.
3.3.1 Bayesian Inference of Uncertain Parameters in the Mobility Model.
The posterior samples will be directly used as the prior samples for at the next spatial point since random variables are constant over space. However, cannot be directly used as prior samples of at due to the spatially varying characteristics of . In addition, the discontinuity of soil type and slope ID also complicates the generation of prior samples for at . This paper develops a numerical procedure (as depicted in Fig. 8) to tackle these challenges.
3.3.2 Uncertainty Sources Updating.
Implementing Eqs. (35) through (38) for all i = 1, 2, …, NT and j = 1, 2, …, NPF, we obtain NPF samples for or . The samples are then assembled together according to their coordinates (as indicated in Fig. 8) to form random samples of . Defining the obtained samples as , is then the prior samples of at spatial point . By implementing the above procedure recursively, we are able to sequentially estimate the soil properties and vehicle parameters based on the vehicle mobility measurement data.
3.3.3 Mission Mobility Reliability Updating and Remaining Mobilable Distance Estimation.
As the vehicle proceeds on the mission pass, and will be updated. If the updated MMR shows that the is too low, the decision-maker needs to decide whether the vehicle should continue this path or a new path needs to be identified based on . Next, a case study is used to demonstrate the two phases of the proposed simulation-based MMR analysis.
4 Case Study
In this section, an off-road map is used to demonstrate the efficacy of the proposed framework. The application problem is first introduced in Sec. 4.1. Following that, Sec. 4.2 implements the MMR analysis in mission-planning phase, and Sec. 4.3 demonstrates the dynamic updating of MMR during the mission.
4.1 Description of the Mission Mobility Reliability Analysis Problem.
A map taken from ArcGIS/ENVI database [43] and US Geological Survey database [44] is selected to demonstrate the proposed framework. The slope and soil maps of the selected area are shown in Fig. 9 accordingly, which are discretized by 1046 points in the coordinate d1 and 707 points in the coordinate d2. As shown in Fig. 9, there are 10 different slope intervals and soil types represented by different IDs, with slope ID zero and soil ID zero represents water. Additionally, each slope ID is associated with a slope parameter, and each soil ID is associated with three different soil parameters, i.e., cohesive strength, friction coefficient, and bulk density. In this paper, all these parameters are considered as stationary Gaussian random field. Table 1 presents statistical information of different parameters corresponding to different slope/soil IDs, which are assumed based on the data obtained from the US Geological Survey database [44].
For the mission planning of the ground vehicle at the selected map, a path is selected from coordinates (250,150) to (900,450) as shown in Fig. 10. As a result, there are 400 spatial points (coordinates) on the selected route. Figure 11 gives the slope IDs and soil IDs of each point.
Next, we will demonstrate how to perform surrogate-modeling-based MMR analysis in the mission-planning phase and how to update the MMR in the during-mission phase.
4.2 Mission-Planning Phase: Surrogate-Modeling-Based Mission Mobility Reliability Analysis.
As discussed earlier, the parameters are space-dependent random fields. Before estimating MMR, random realizations of these parameters are generated using the KL expansion method using Eqs. (13) through (16). In addition, 15 initial training points are generated for using the approach discussed in Sec. 3.2. After that, an initial surrogate is constructed based on the training points.
The surrogate model is then adaptively refined using the SILK method as discussed in Sec. 3.2. Figure 12 shows the predicted mission mobility failure probability (pf(Ω)) with respect to the added number of function evaluations. The result shows that the SILK-based MMR analysis method only needs additional four function evaluations to get a very accurate estimate of the mission mobility failure probability. In this figure, the true mission mobility failure probability is estimated using the brutal-force MCS method with Ns = 104 samples. This demonstrates the high efficiency of the adaptive surrogate-modeling-based MMR analysis method.
4.3 During-Mission Phase: Dynamic Updating of Mission Mobility Reliability.
From the mission-planning phase, as depicted in Fig. 12, it shows that the mission mobility failure probability of the selected mission path (i.e., Fig. 10) is 0.1022 from both the MCS and adaptive Kriging surrogate-modeling-based method. Even though the failure probability is quite low, rare events of immobility are still possible to happen. To proactively avoid the rare events, MMR is dynamically updated based on the online mobility data as discussed in Sec. 3.3.
In order to demonstrate the dynamic updating process, we first select a realization of the terrain properties that leads to failure of the mission. The selected terrain properties are then assumed to be unknown during the updating process. Figure 13 depicts the vehicle speed corresponds to the selected realization of terrain properties at each point. It shows that if the vehicle proceeds on the mission path (i.e., Fig. 10), an immobility event (i.e., maximum attainable speed <2 m/s) will happen at the 232th point. If the proposed framework can predict the immobility event before the vehicle reaches to the 232-th point, it could save the vehicle from the immobility event.
In this paper, the slope at each location is assumed to be directly measurable when a vehicle passes a certain point, while the other soil properties are not directly measurable. Using the Bayesian method discussed in Sec. 3.2, we can estimate the posterior distributions of the soil properties as mobility data of the vehicle are collected. Figure 14 shows the estimated posterior distributions of soil parameters at the first point, when the vehicle starts to proceed on the selected mission path. Comparing with the prior distribution, it is observed that the uncertainty in the soil property parameters is reduced. Based on the Bayesian inference at the first point, we can then update the distribution of the remaining points on the mission path by following the procedure as shown in Fig. 8. Based on the updated distributions, we can further calculate the mission mobility failure probability of the remaining part of the mission path. As discussed in Sec. 3.2, the updated distributions of the parameters are also used as the prior distributions for the next spatial point. The aforementioned process continues as the vehicle proceeds on the mission path.
Figure 15 presents the 95% confidence interval and mean value of the posterior distributions of the soil property parameters after the vehicle proceeds 50 points on the mission path. The results show that the mean values of the posterior distribution of soil parameters are close to the underlying true values which are assumed to be unknown. Following that, Fig. 16 presents the updating history of the mission mobility failure probability as the vehicle proceeds over the mission path. It shows that goes up close to 1 at a point close to the 30th point which is way ahead the 232th point where the failure (i.e., immobility) actually happens. Figure 17 presents the updating history of the RMD over the mission path as the vehicle proceeds on the route. It can see that the proposed dynamic updating framework is able to accurately estimate the RMD as the vehicle proceeds on the route and more observations of the vehicle mobility are collected. This demonstrates the effectiveness of proposed framework in proactively identifying the rare events of immobility before it happens.
5 Conclusions and Future Work
This paper proposes a simulation-based MMR analysis framework to account for the uncertainty and improve the prediction accuracy of off-road ground vehicle mobility. The framework has two phases, including a mission-planning phase and a during-mission phase. For the mission-planning phase, a single-loop Kriging surrogate modeling approach is employed to reduce the computational cost by selecting the most critical training points as well as maintaining the prediction accuracy of MMR. For the during-mission phase, a Bayesian updating framework is proposed to reduce the uncertainty of terrain parameters with observed vehicle mobility information. Using the conditional Gaussian process, we can also reduce the uncertainty of the path that has not been accomplished and thus dynamically update the MMR. The dynamic updating of MMR allows us to proactively avoid the rare occurrence of failures before it happens. A case study using the data from ArcGIS/ENVI database and US Geological Survey database demonstrates the efficacy of the proposed framework.
Even though the developed framework is applied to off-ground vehicle MMR analysis, it is also applicable to other type of engineering systems where time-dependent or space-dependent variables are presented. In this paper, only several sources of uncertainty (e.g., slope and soil properties) are considered in the MMR analysis and dynamical updating of MMR. In reality, however, heterogenous sources of uncertainty may affect the mobility prediction. One of the most important uncertainty sources is the model discrepancy between the simulation model and the underlying true physics. The model discrepancy will affect the effectiveness of Bayesian inference and thus the MMR prediction, since the M&S is the basis of MMR analysis and dynamical updating in the proposed framework. In a recent work, a sequential calibration and validation (SeCAV) framework has been proposed to tackle model uncertainty in Bayesian inference [45]. Integrating the SeCAV framework with the proposed framework will make the proposed framework robust to the inadequacy in the M&S and is worth studying in the future. Moreover, this paper focuses on the MMR analysis and MMR updating for any given mission plan. Performing mission-planning optimization based on the developed framework will allow us to identify the optimal mission path that is reliable for the off-road ground vehicle. Reliability-based mission planning is one of our future work.
In addition, synthetic data are used to demonstrate the effectiveness of the proposed framework. The application of the proposed framework to the actual off-road ground vehicles using real experiments is also an important topic that needs to be studied in the future. In this paper, the soil and slope maps are assumed to be correct. Considering the uncertainty in the soil and slope maps is another topic that worth pursuing.
Acknowledgment
This research was supported by the Automotive Research Center (ARC) in accordance with Cooperative Agreement W56HZV-04-2-0001 U.S. Army CCDC Ground Vehicle Systems Center (GVSC), Warren, MI. The support is gratefully acknowledged.
Nomenclature
- b=
track width
- e=
minimum required maximum attainable speed
- m=
number of random field variables related to soil property or slope
- =
spatial coordinates with with d1 and d2 represent the coordinate in direction 1 and 2 respectively.
- V=
vehicle mobility variable (e.g., the maximum attainable speed in this paper)
- W=
weight of vehicle
- =
a vector of vehicle parameters
- ba=
overall width of the tire inflated but unloaded
- da=
overall diameter of the tire inflated but unloaded
- dw=
road-wheel diameter
- mw=
total number of road-wheels
- na=
number of axles
- nMCS=
number of MCS samples
- pw=
track plate length
- =
current location
- =
previous location
- =
next location
- =
the spatial coordinates at location i,
- =
mobility data collected at spatial point
- =
measured vehicle mobility data of the finished part Ωf
- Nc=
number of observations at location
- Nd=
number of discretized spatial points on a mission path
- Nij=
number of expansion terms in KL expansion for Yij(·)
- Nin=
number of initial training points
- NKL=
number of expansion terms in KL expansion
- NPF=
number of particles in particle filtering
- Nslope=
number of slope IDs
- Nsoil=
number of soil types
- NT=
NT = Nslope if is a slope-related variable
- NT=
Nsoil if is a soil-type-related variable
- =
posterior samples of soil/slope properties of the finished part of the mission path
- =
of the finished part of the mission path
- =
associated with the ith slope ID or soil type in the finished part of the mission path
- =
of the unfinished part of the mission path
- =
associated with the ith slope ID or soil type in the unfinished part of the mission path
- fs(·, ·)=
a function mapping to training point of
- pf(Ω)=
mission failure probability of a mission path Ω
- =
vehicle mobility reliability at location
- G(·, ·)=
vehicle mobility simulation model
- Ns(j), j = 1, …, NT=
number of spatial points associated with the jth slope or soil ID on a mission path Ω
- R(Ω)=
mission mobility reliability of a mission path Ω
- =
MMR conditioned on
- =
the ith space-dependent soil property or terrain parameter
- Yij(k), k = 1, 2, …, Ns(j)=
associated with the jth slope ID or soil ID at the kth location
- =
coordinates corresponding to the pth slope ID
- =
coordinates corresponding to the hth soil type
- =
the lth training point of
- =
a vector of terrain parameters
- α(l), l = 1, …, Nin=
the lth training point of soil/slope ID
- =
integer training samples of soil/slope IDs
- βi, i = 1, 2=
correlation length parameter of coordinate i
- =
covariance matrix between and
- =
auto-covariance matrix of
- =
auto-covariance matrix of
- Ω=
domain of a mission path
- Ωf=
spatial points of the finished part of the mission path
- Ωuf=
spatial points of the unfinished part of the mission path