Abstract
Computer simulations of dynamic systems are really important to better understand some processes or phenomena without having to physically execute them, and/or to make offline decisions, or decisions that do not need immediate, “on-the-fly” answers in general. However, given a set of equations describing a dynamic phenomenon, wouldn’t it be nice to be able to exploit them more? Instead of simulating a situation, could we gear it or even veer it to a predefined performance? This paper is concerned with the identification of parameters of dynamic systems that ensure a specific performance or behavior. We propose to carry such computations using intervals and constraint solving techniques. However, realistically, aiming to enable such identification and decision on an on-going process or phenomena requires being able to conduct very fast computations on possibly very large systems of equations. We further propose to combine interval and constraint solving techniques with reduced-order modeling techniques to guarantee results in a practical amount of time.
1 Introduction
Computer simulations of dynamic systems are really important to better understand some processes or phenomena without having to physically execute them, and/or to make offline decisions, or decisions that do not need immediate, “on-the-fly” answers in general. These simulations use models derived from observations of natural phenomena, which are often very complex and involving millions of variables. Running simulations on these high-fidelity models yields significant CPU time issues. However, given a set of equations describing a dynamic phenomenon, wouldn’t it be nice to be able to exploit them more? Instead of simulating a situation, could we gear it or even veer it to a predefined performance?
We propose to carry such computations using interval computations and constraint solving techniques. By using intervals, we account for the uncertainty from observations that are never 100% accurate. However, realistically, aiming to enable such identification and decision on an on-going process or phenomena requires being able to conduct very fast computations on possibly very large systems of equations. We further propose to combine interval and constraint solving techniques with reduced-order modeling techniques to guarantee results in a practical amount of time.
2 Background
Modeling real-life phenomena can result in very large (most likely) nonlinear systems of equations. One way to solve these problems is to find the zeroes of large-dimensional functions using some real-valued solvers, e.g. Newton’s method. The convergence of the real-valued solvers depends on several factors: selection of the initial point, continuity of the partial derivatives, condition on the Jacobian or the Hessian matrix, among others. To overcome these issues, the solution can be sought on a subspace where the convergence conditions are met, hence also reducing the size of the problem to be solved: such general approach is called Reduced-Order Modeling. We review it in what follows (Subsect. 2.1).
Another challenge with solving dynamic systems is that we often assume that the models are 100% accurate. This is seldom the case. Moreover, in the specific case that we tackle in this article, where we aim to react to observations (possibly a disruption) of an unwinding dynamic phenomenon by identifying new parameters to adapt it “on the fly”, observations are not \(100\%\) accurate and such uncertainty needs to be taken into account. As a result, if we are to solve such problems, we need to be able to handle uncertainty, and to quantify it, to be able to assess the quality of our solutions. Techniques that allow handling and quantifying uncertainty are reviewed in Subsect. 2.2.
2.1 Reduced-Order Modeling (ROM)
The models used in simulations of real-life phenomena often consist in very large (most likely) nonlinear systems of equations: \(F(X)=0\), where \(F: \mathbb {R}^n \rightarrow \mathbb {R}^n\). Such systems are called the Full-Order Model (or FOM) of a given problem. As very large problems can yield significant solving time, a common approach consists in decreasing/reducing the size of FOM, while remaining truthful to its original aim: this process is called Model-Order Reduction (MOR) and results in a Reduced-Order Model (ROM).
The main idea of ROM is to find an approximation to a solution \(\tilde{X}\) such that \(||F(\tilde{x})||\) is sufficiently small in a k-dimensional subspace W of \(\mathbb {R}^n\), where \(k\ll n\). Common techniques for Model-Order Reduction consist of two stages: (1) finding the referred subspace and its corresponding basis \(\varPhi \), here represented as an \(n\times k\) matrix [9, 10]Footnote 1; and (2) finding \(Y^*\), the solution of the overdetermined \((n \times k)\) system \(F(\varPhi \cdot Y)=0\), i.e., \(Y^*=\displaystyle \min _{W}\{Y: F(\varPhi \cdot Y)=0\} \), where W is the spanned subspace of the columns of \(\varPhi \). Once \(Y^*\) is found, the approximation \(\tilde{X}\) of X such that \(||F(X)||=0\) is determined by \(\tilde{X}=\varPhi \cdot Y^*\), see Fig. 1 [11, 12].
2.2 Interval Computations
In this article, we aim to address situations in which an unfolding dynamic phenomenon, for which we know F as well as all input parameters and other properties, is perturbated and requires recomputation of some parameters so as to ensure that some properties be satisfied (e.g., the below helicopter example where the landing zone is guaranteed even after perturbation, see Fig. 2). In general, if we priori restrict ourselves to a lower- dimensional space, we only get an approximation solution.
In the event of a perturbation, observations are essential to understanding the perturbation but observations are inherently inaccurate. As a result, if we are to solve such problems, we need to handle and quantify uncertainty to assess the quality of our solutions. We use interval computations to handle uncertainty.
In this paper, we propose to handle uncertainty as intervals. Whenever a quantity is not known for sure, e.g., observed value \(v \pm \varepsilon \), we will represent this uncertainty as a closed interval: \([\underline{v-\varepsilon }, \overline{v + \varepsilon }]\), where given any real value r, \(\underline{r}\) is the largest floating-point number \(\le r\), and \(\overline{r}\) is the smallest floating-point number \(\ge r\). Such floating-point-bounded intervals are carried in any computation originally involving seemingly 100% accurate real values, following interval arithmetic rules, generally described as follows:
where \(\square A\) stands for the hull of set A, and Z is the smallest floating-point-bounded interval including \(\square \{x \bowtie y\ | \ x \in X, \ y\in Y\}\).
How to Solve Nonlinear Equations with Intervals? The premise of our approach is to replace all real-valued computations with interval-based computations by abstracting real-valued parameters into interval parameters, and using interval constraint solving techniques to find solutions [3]. In our case, each of our nonlinear equations \(f_i(x_1, \dots , x_n) = 0\) of the system to be solved is a constraint and our system of nonlinear equations a system of constraints. Our goal is to find values of its variables \(\{x_1, \dots , x_n\} \in R\) that are such that: \(\forall i,\ f_i(x_1, \dots , x_n) = 0\).
Constraint solving techniques allow us to identify all values of the parameters that satisfy the constraints. Interval constraint solving techniques [4, 5] produce a solution set (set of the solutions of the constraint system) that is interval in nature: it is a set of multi-dimensional intervals (or boxes whose dimension is n, the number of variables): this set is guaranteed to contain all the solutions of the constraint problem (in our case, of the nonlinear system of equations).
Most importantly, if the solving process returns no solution, we know for sure that it is because there is no solution. This guarantee of completeness provided by interval constraint solving techniques comes from the underlying solving mode: a branch-and-bound [6] approach (or branch-and-prune for faster convergence [7]) that uses the whole search space as a starting point and successively assess the likeliness of finding solutions in the given domain (via interval computations) and possibly (if Branch and Prune) reduce it, and discard domains that are guaranteed not to contain any solution.
Using ICST, it is possible to determine if \(F(\varPhi \cdot P)=0\) has no solution, a unique solution, or many solutions in the subspace W defined by \(\varPhi \) (see [2, 3]).
3 Problem Statement and Proposed Approach
Let us recall the problem we want to solve. Using the model of a dynamic system, we aim to find certain parameter values that guarantee a specific outcome of the modeled dynamic phenomenon.
Assuming this phenomenon is modeled as a parametric differential equation (ODE/PDE), the parameters that lead to a certain outcome can be found as follows:
-
1.
Discretize the ODE/PDE equation leading to a parametric system of equations \(F(X,P)=0\), where \(X=(x_1,x_2,\ldots ,x_n)\) is the approximation of the solution and P are the parameters of the ODE/PDE equation, and \(F:\mathbb {R}^n \rightarrow \mathbb {R}^n\).
-
2.
Let \([i_1, i_2, \ldots , i_m]\) a subset of \([1,2,\ldots ,n]\) where n is the dimension. Fix the values of \(x_{i_j}=[\underline{x_{i_j}}, \overline{x_{i_j}}]\), with \(j=1,2,\ldots , m\) representing the expected outcomes. Solve for P using ICST the following system:
$$ \begin{array}{rcl} \varPhi (i_1,:)Y=x_{i_1} &{} =&{} [\underline{x_{i_1}}, \overline{x_{i_1}}] \\ \varPhi (i_2,:)Y=x_{i_2} &{}=&{} [\underline{x_{i_2}}, \overline{x_{i_2}}] \\ \ldots &{} &{} \ldots \\ \varPhi (i_m,:)Y=x_{i_m} &{}=&{} [\underline{x_{i_m}}, \overline{x_{i_m}}] \\ F(\varPhi Y,P)&{}=&{} 0 \end{array} $$
Where \(\varPhi (i_j,:)\) is the \(i_j\)-row of \(\varPhi \). The solutions P correspond to the sought parameters.
4 Experimental Results and Analysis
In this section, we report on preliminary experiments of our approach on one well-known problem: a particular case of the Lotka-Volterra problem. The Lotka-Volterra problem models a predator-prey system. We use the following equations to describe this problem:
where v and w respectively represent the number of preys and predators represented in thousands. The system was integrated from time \(t_0 = 0\) to \(t_m = 10\) with a constant step size \(h = 0.1\). We used \(\theta _1=3\) and \(\theta _2=1\). Let us assume that at \(t=5\), a perturbation occurs, which changes the number of predators and preys. Since, it is not possible to know the new real number of animals of each species, the new number of both species is handled with uncertainty, i.e. \(v(t=6)= [0.8062,0.8116]\), \(w(t=6) = [1.0834, 1.0884]\). Using ICST, it is possible to determine that, with \(\theta _1= [2.964, 3.039]\) and \(\theta _2=[0.9863, 1.014]\), we reach a balance of the two species at time \(t=10\), \(v(t=10)=[0.7675,0.7738]\), \(w(t=10)=[0.9903, 1.0086]\), see Fig. 3.
In a similar setting, we were able to conclude that it is impossible to reach 1000 animal of each species by time \(t=10\), i.e., \(v(t=10)=w(t=10)=1000\).
5 Conclusions
In this article, we aimed to design a technique that allows to identify parameters of a given (known and observed) dynamic system that has been perturbated, in such a way that some final conditions still hold. We used Reduced-Order Modeling and interval constraint solving techiques to determine such values of the phenomenon’s parameters.
We were able to identify reliable intervals in which the desired parameters’ values lie. We improved the runtime of this method by using ROM.
Future work includes taking into account the recomputation time and not assuming that new behavior can be “plugged” directly from where perturbation happened. As a result, more uncertainty needs to be taken into account, which includes time uncertainty. Additionally, we plan to consider perturbations as fuzzy numbers. This will require us to consider our dynamic system with uncertainty differently (e.g., with fuzzy derivatives). But most importantly, this is expected to help us make more informed decision: if we can label our input uncertainty with fuzzy values, how does this inform us about labels on uncertain solutions to focus on the best ones? [13].
Notes
- 1.
In this paper, we assume that the basis \(\varPhi \) is given.
References
Moore, R.E., Kearfott, R.B., Cloud, M.J.: Introduction to Interval Analysis, 1st edn. SIAM, Philadelphia (2009)
Benhamou, F., Goualard, F., Granvilliers, V., Puget, J.: Revising hull and box consistency. In: Proceedings of the 1999 International Conference on Logic Programming. MIT Press (1999)
Granvilliers, L., Benhamou, F.: RealPaver: an interval solver using constraint satisfaction techniques. ACM Trans. Math. Softw. 32(1), 138–156 (2006)
Mackworth, A.K.: Consistency in networks of relations. Artif. Intell. 8(1), 99–118 (1977)
Jaffar, J., Maher, M.: Constraint logic programming: a survey. J. Log. Program. 19(20), 503–581 (1994)
Kearfott, R.B.: Verified branch and bound for singular linear and nonlinear programs: an epsilon-inflation process, April 2007
Caroa, S., Chablata, S., Goldsztejnb, A., Ishiic, D., Jermannd, C.: A branch and Prune algorithm for the computation of generalized aspects of parallel robots. Artif. Intell. 211, 34 (2014)
Kearfott, R.B., Kreinovich, V.: Where to bisect a box? a theoretical explanation of the experimental results. In: Alefeld, G., Trejo, R.A., (eds.) Proceedings of MEXICON 1998, Workshop on Interval Computations, 4th World Congress on Expert Systems, Mexico City (1998)
Schilders, W.H., Vorst, H.A.: Model Order Reduction: Theory Research Aspects and Applications. Springer, Heidelberg (2008)
White, J.: A trajectory piecewise-linear approach to model order reduction and fast simulation of nonlinear circuits and micromachined devices. IEEE Trans. Comput. Aided Des. Integr. Circ. Syst. 22(2), 155–170 (2003)
Kelly, C.T.: Reduction of model order based on proper orthogonal decomposition for lithium-ion battery simulations. J. Electrochem. Soc. 156, A154–A161 (2009)
Willcox, K., Peraire, J.: Balanced model reduction via the proper orthogonal decomposition. AIAA J. 40(11), 2323–2330 (2002)
Lodwick, A., Bassanezy, R.C., de Barros, L.: A First Course in Fuzzy Logic, Fuzzy Dynamical Systems, and Biomathematics: Theory and Applications. Studies in Fuzziness and Soft Computing, vol. 347. Springer, Heidelberg (2017)
Acknowledgment
This work was supported by Stanford’s Army High-Performance Computing Research Center funded by the Army Research Lab, and by the National Science Foundation award #0953339.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Valera, L., Contreras, A.G., Ceberio, M. (2018). “On-the-fly” Parameter Identification for Dynamic Systems Control, Using Interval Computations and Reduced-Order Modeling. In: Melin, P., Castillo, O., Kacprzyk, J., Reformat, M., Melek, W. (eds) Fuzzy Logic in Intelligent System Design. NAFIPS 2017. Advances in Intelligent Systems and Computing, vol 648. Springer, Cham. https://doi.org/10.1007/978-3-319-67137-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-67137-6_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67136-9
Online ISBN: 978-3-319-67137-6
eBook Packages: EngineeringEngineering (R0)