Elsevier

Information Sciences

Volume 180, Issue 8, 15 April 2010, Pages 1434-1457
Information Sciences

Artificial neural network approach for solving fuzzy differential equations

https://doi.org/10.1016/j.ins.2009.12.016Get rights and content

Abstract

The current research attempts to offer a novel method for solving fuzzy differential equations with initial conditions based on the use of feed-forward neural networks. First, the fuzzy differential equation is replaced by a system of ordinary differential equations. A trial solution of this system is written as a sum of two parts. The first part satisfies the initial condition and contains no adjustable parameters. The second part involves a feed-forward neural network containing adjustable parameters (the weights). Hence by construction, the initial condition is satisfied and the network is trained to satisfy the differential equations. This method, in comparison with existing numerical methods, shows that the use of neural networks provides solutions with good generalization and high accuracy. The proposed method is illustrated by several examples.

Introduction

Uncertainty is an attribute of information, [28] and the use of fuzzy differential equations (FDEs) is a natural way to model dynamic systems with embedded uncertainty. Most practical problems can be modeled as FDEs (e.g. [5], [8] and Section 3.2). The method of fuzzy mapping was initially introduced by Chang and Zadeh [10]. Later, Dubois and Prade [11] presented a form of elementary fuzzy calculus based on the extension principle [27]. Puri and Ralescue [23] suggested two definitions for the fuzzy derivative of fuzzy functions. The first method was based on H-difference notation and was further investigated by Kaleva [16]. Several approaches were later proposed for FDEs and the existence of their solutions (e.g. [15], [19], [21], [24], [26]). The approach based on H-derivative has the disadvantage that it leads to solutions which have an increasing length of their support. This shortcoming was resolved by interpreting the FDE as a family of differential inclusions. Later, the authors of [6], [7] introduced the concept of generalized differentiability. According to this new definition, the solution of the FDE may have decreasing length of its support. Other researchers have proposed several approaches to the solutions of FDE (e.g. [9], [19]).

Another group of researchers tried to extend some numerical methods to solve FDEs (e.g. [1], [12], [13]) such as Runge–Kutta method [2], Adomian method [4], predictor–corrector method and multi-step methods [3]. These methods are extended versions of the equivalent methods for solving ordinary differential equations (ODEs).

Lagaris et al. [17] used artificial neural networks to solve ordinary differential equations (ODEs) and partial differential equations (PDEs) for both boundary value problems and initial value problems. They used multilayer perceptron to estimate the solution of differential equation. Their neural network model was trained over an interval (over which the differential equation must be solved), so the inputs of the neural network model were the training points. The comparison of their method with the existing numerical methods shows that their method was more accurate and the solution had also more generalizations. The ability of neural networks in function approximation is our main objective. In this paper, we will construct a new model with the use of neural networks to obtain a solution for FDE. In this new model, the inputs of the neural network are the training points as well as a parameter r which shows the domain of uncertainty.

In Section 2, the basic notations of fuzzy numbers, fuzzy derivative and fuzzy functions are briefly presented. In Section 3, fuzzy differential equations and their applications are introduced; in addition, a general Cauchy problem is defined. In Section 4, the proposed new method (based on the use of a feed-forward neural network) is described. In Section 5, the applicability of the method is illustrated by several examples in which the exact solution and the computed results are compared with each other. In order to show the applicability of the method, a nonlinear FDE and a nonlinear FDE containing a fuzzy parameter are solved. Also, a problem in electrical circuit analysis is solved. Finally, Section 6 presents concluding remarks.

Section snippets

Preliminaries

Definition 2.1

see [25]

A fuzzy number u is completely determined by any pair u=(u̲,u¯) of functions u̲(r),u¯(r):[0,1]R, satisfying the three conditions:

  • (i)

    u̲(r) is a bounded, monotonic, increasing (nondecreasing) left-continuous function for all r(0,1] and right-continuous for r=0.

  • (ii)

    u¯(r) is a bounded, monotonic, decreasing (nonincreasing) left-continuous function for all r(0,1] and right-continuous for r=0.

  • (iii)

    For all r(0,1] we have: u̲(r)u¯(r).

For every u=(u̲,u¯),v=(v̲,v¯) and k>0 we define addition and multiplication

Fuzzy differential equations

In this section, a first order fuzzy differential equation is defined. Then it is replaced by its equivalent parametric form, and the new system, which contains two ordinary differential equations, is solved. A fuzzy differential equation of the first order is in the following form:x(t)=f(t,x(t)),where x is a fuzzy function of t and f(t,x) is a fuzzy function of the crisp variable t and the fuzzy variable x. Here x is the fuzzy derivative (according to Definition 2.5) of x. If an initial

Neural networks

The use of neural networks provides solutions with very good generalizability (such as differentiability). On the other hand, an important feature of multilayer perceptrons is their utility to approximate functions, which leads to a wide applicability in most problems.

In this paper, the function approximation capabilities of feed-forward neural networks is used by expressing the trial solutions for a system (10) as the sum of two terms (see Eq. (13)). The first term satisfies the initial

Numerical examples

To show the behavior and properties of this new method, six problems will be solved in this section. To minimize the objective function in (17) the Matlab 7 optimization toolbox was employed using the quasi-Newton BFGS method. For each example, the accuracy of the method is illustrated by computing the deviations E̲(t,r)=x̲T(t,r)-x̲a(t,r),E¯(t,r)=x¯T(t,r)-x¯a(t,r) (for a constant t and various values of r), where xa(t,r)=(x̲a(t,r),x¯a(t,r)) is the known exact solution and xT(t,r)=(x̲T(t,r),x¯T(t

Concluding remarks

The use of FDEs is a natural way to model dynamical systems under possibilistic uncertainty. In this paper, we presented a new method for solving fuzzy differential equations. We demonstrate, for the first time, the ability of neural networks to approximate the solutions of FDEs. By comparing our results with the results obtained by using numerical methods (e.g. [3]), it can be observed that the proposed new method yields more accurate approximations. Even better results (specially in nonlinear

Acknowledgments

The authors wish to thank the referees and the Editor-in-Chief for their kind comments and valuable remarks.

References (28)

  • L.J. Jowers et al.

    Simulating continuous fuzzy systems

    Information Sciences

    (2007)
  • O. Kaleva

    Fuzzy differential equations

    Fuzzy Sets and Systems

    (1987)
  • M.T. Mizukoshi et al.

    Fuzzy differential equations and the extension principle

    Information Sciences

    (2007)
  • J.J. Nieto

    The Cauchy problem for continuous fuzzy differential equations

    Fuzzy Sets and Systems

    (1999)
  • Cited by (109)

    View all citing articles on Scopus
    View full text