Qinghua Tao
ABSTRACT
Adaptive hinging hyperplanes (AHH) is a popular continuous piecewise linear (CPWL) model. It has been proved that any continuous nonlinear function can be approximated by a CPWL function with arbitrary precision. The existing identification of AHH simply traverses all the dimensions on the pre-given splitting points to select the best, which fails to consider all the parameters synchronously and the randomness in the splitting, thus the identified model may not be optimal. In this paper, we propose an improved method to identify AHH model with coordinate update strategy. We first use the existing identification method of AHH to initially obtain a basic model structure, and afterwards alternatively optimize the parameters to improve accuracy. Specifically, to explore the interactive and global effects among all the nonlinear parameters, adaptive block coordinate DIRECT (ABCD) algorithm is employed to simultaneously optimize the nonlinear parameters, while the linear parameters can be calculated by least squares (LS) method. Besides, the proposed method is promising to conduct extensions to identify different CWPL models or other nonlinear models even with various error criteria. Numerical experiments show that the proposed method improves the accuracy and stability in identifying AHH and it can even achieve higher accuracy with simpler model structure.
- M. Bjorkman, K. Holmstrom, Global Optimization Using the DIRECT Algorithm in Matlab, Matlab Advanced Modeling & Optimization. 1(2) (1999) 1--8.Google Scholar
- Breiman. L, Hinging hyperplanes for regression, classification, and function approximation, IEEE Transactions on Information Theory.39(3) (2002) 999--1013. Google ScholarDigital Library
- L. O. Chua, K. M. Kang, Section-wise piecewise-linear functions: Canonical representation, properties, and applications, in: Proceedings of the IEEE. 65(6) (1977) 915--929.Google ScholarCross Ref
- P. Craven, G. Wahba, Smoothing noisy data with spline functions, Springer. 1978.Google Scholar
- J. H Friedman, Multivariate Adaptive Regression Splines, Annals of Statistics. 19(1) (1991) 1--67.Google ScholarCross Ref
- X. Huang, J. Xu, S. Wang, Nonlinear system identification with continuous piecewise linear neural network, Neurocomputing. 77(1) (2012) 167--177. Google ScholarDigital Library
- X. Huang, J. Xu, S. Wang, Identification algorithm for standard continuous piecewise linear neural network, in: Proceedings of the IEEE American Control Conference. 2010, 4931--4936.Google Scholar
- X. Huang, X. Mu, S. Wang, Continuous Piecewise Linear Identification with Moderate Number of Subregions, in: Proceedings of IFAC Symposium on System Identification. 45(16) (2012) 535--540.Google Scholar
- X. Huang, J. Xu, S. Wang, Parameters estimation of hinging hyperplanes using median squared error criterion, International Journal of Control Automation & Systems. 9(4) (2011) 627--635.Google ScholarCross Ref
- D. R. Jones, C. D. Perttunen, B. Stuckman, Lipschitzian optimization without the Lipschitz constant, Plenum Press. 1993.Google Scholar
- P. Julian, A. Desages, O. Agamennoni, High-level canonical piecewise linear representation using a simplicial partition, IEEE Transactions on Circuits & Systems I Fundamental Theory & Applications. 46(4) (1999) 463--480.Google ScholarCross Ref
- S. Kang, L. O. Chua, A global representation of multidimensional piecewise-linear functions with linear partitions, IEEE Transactions on Circuits & Systems, 25(11) (1978) 938--940.Google ScholarCross Ref
- Q. Tao, X. Huang, S. Wang, et al., Adaptive block coordinate DIRECT algorithm, Journal of Global Optimization. (2016) 1--26 Google ScholarDigital Library
- S. Wang, X. Sun, Generalization of hinging hyperplanes, IEEE Transactions on Information Theory. 51(12) (2005) 4425--4431. Google ScholarDigital Library
- C. Wen, S. Wang, X. Jin, et al., Identification of dynamic systems using Piecewise-Affine basis function models, Automatica, 43(10) (2007) 1824--1831. Google ScholarDigital Library
- J. Xu, X. Huang, S. Wang, Adaptive Hinging Hyperplanes, in: Proceedings of World Congress of the International Federation of Automatic Control. 41(2) (2008) 4036--4041.Google Scholar
- J. Xu, X. Huang, S. Wang, Adaptive hinging hyperplanes and its applications in dynamic system identification, Automatica. 45(10) (2009) 2325--2332. Google ScholarDigital Library
- J. Xu, X. Huang, X. Mu, et al., Model predictive control based on adaptive hinging hyperplanes model, Journal of Process Control. 22(10) (2012) 1821--1831.Google ScholarCross Ref
Recommendations
Urban Traffic Flow Forecasting Based on Adaptive Hinging Hyperplanes
AICI '09: Proceedings of the International Conference on Artificial Intelligence and Computational IntelligenceIn this paper, after a review of traffic forecasting methods and the development of piecewise linear functions, a new traffic flow forecasting model based on adaptive hinging hyperplanes was proposed. Adaptive hinging hyperplanes (AHH) is a kind of ...
Fuzzy Clustering for the Identification of Hinging Hyperplanes Based Regression Trees
WILF '07: Proceedings of the 7th international workshop on Fuzzy Logic and Applications: Applications of Fuzzy Sets TheoryThis article deals with the identification of hinging hyperplane models. This type of non-linear black-box models is relatively new, and its identification is not thoroughly examined and discussed so far. They can be an alternative to artificial neural ...
Generalization of hinging hyperplanes
The model of hinging hyperplanes (HH) can approximate a large class of nonlinear functions to arbitrary precision, but represent only a small part of continuous piecewise-linear (CPWL) functions in two or more dimensions. In this correspondence, the ...
Comments