Abstract
As a well-known regression clustering algorithm, fuzzy c-regressions (FCR) has been widely studied and applied in various areas. However, FCR appears to be rather sensitive to the undesirable initialization and the presence of noise or outliers in data sets. As a modified alternative, possibilistic c-regressions (PCR) can ameliorate the problem of noise and outliers, but it depends more heavily on initial values. Besides, the number of models should be determined a priori in both algorithms. To overcome these issues, this paper proposes a generalized alternative, called fuzzy weighted c-harmonic regressions (FWCHR), in which, a dynamic-like weight term based on the distinguished feature of the harmonic average is first introduced to enhance robustness. Furthermore, FWCHR can encompass FCR and PCR if some conditions are satisfied. And then a generalized mountain method (GMM) is proposed to automatically determine the number of models and estimate the initial values, which makes the proposed FWCHR algorithm totally unsupervised. Some numerical simulations and real applications are conducted to validate the performance of our algorithms.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Arminger G, Stein P, Wittenberg J (1999) Mixtures of conditional mean-and covariance-structure models. Psychometrika 64(4):475–494
Bai X, Yao W, Boyer JE (2012) Robust fitting of mixture regression models. Comput Stat Data Anal 56(7):2347–2359
Barni M, Cappellini V, Mecocci A (1996) Comments on “a possibilistic approach to clustering”. IEEE Trans Fuzzy Syst 4(3):393–396
Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2):191–203
Biernacki C, Celeux G, Govaert G (2003) Choosing starting values for the em algorithm for getting the highest likelihood in multivariate gaussian mixture models. Comput Stat Data Anal 41(3):561–575
Böhning D (2000) Computer-assisted analysis of mixtures and applications. Technometrics 42(4):442–442
Brinkman ND (1981) Ethanol fuel—a single-cylinder engine study of efficiency and exhaust emissions. Technical report, SAE Technical Paper
Campbell N, Mahon R (1974) A multivariate study of variation in two species of rock crab of the genus Leptograpsus. Aust J Zool 22(3):417–425
Chang S-T, Lu K-P, Yang M-S (2015) Fuzzy change-point algorithms for regression models. IEEE Trans Fuzzy Syst 23(6):2343–2357
Chang S-T, Lu K-P, Yang M-S (2016) Stepwise possibilistic c-regressions. Inf Sci 334:307–322
Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278
Chuang C-C, Hsiao C-C, Jeng J-T (2003) Adaptive fuzzy regression clustering algorithm for TSK fuzzy modeling. In: 2003 IEEE international symposium on computational intelligence in robotics and automation, 2003, vol 1. Proceedings. IEEE
Cohen EA (1984) Some effects of inharmonic partials on interval perception. Music Percept Interdiscip J 1(3):323–349
Frühwirth-Schnatter S (2001) Markov chain monte carlo estimation of classical and dynamic switching and mixture models. J Am Stat Assoc 96(453):194–209
Frühwirth-Schnatter S (2006) Finite mixture and Markov switching models. Springer, Berlin
Hathaway RJ, Bezdek JC (1993) Switching regression models and fuzzy clustering. IEEE Trans Fuzzy Syst 1(3):195–204
Hennig C (2000) Identifiability of models for clusterwise linear regression. J Classif 17(2):273–296
Jiang W, Tanner MA (1999) Hierarchical mixtures-of-experts for exponential family regression models: approximation and maximum likelihood estimation. Ann Stat 27:987–1011
Kim J, Krishnapuram R, Dave R (1995) On robustifying the c-means algorithms. In: Proceedings of ISUMA-NAFIPS’95 of third international symposium on uncertainty modeling and analysis, 1995, and annual conference of the North American fuzzy information processing society. IEEE
Krishnapuram R, Keller JM (1993) A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1(2):98–110
Kung C-C, Chang S-C, Chen T-H (2012) The fuzzy c-regression model for lithium battery. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC). IEEE
Kung C-C, Ku H-C, Su J-Y (2013) Possibilistic c-regression models clustering algorithm. In: 2013 international conference on system science and engineering (ICSSE). IEEE
Leski JM (2004) \(\varepsilon \)-insensitive fuzzy c-regression models: introduction to \(\varepsilon \)-insensitive fuzzy modeling. IEEE Trans Syst Man Cybern Part B (Cybern) 34(1):4–15
Leski JM, Kotas M (2015) On robust fuzzy c-regression models. Fuzzy Sets Syst 279:112–129
Li C, Zhou J, Xiang X, Li Q, An X (2009) T–S fuzzy model identification based on a novel fuzzy c-regression model clustering algorithm. Eng Appl Artif Intell 22(4):646–653
Li C, Zhou J, Li Q, An X, Xiang X (2010) A new T–S fuzzy-modeling approach to identify a boiler–turbine system. Expert Syst Appl 37(3):2214–2221
Ménard M, Dardignac P-A, Courboulay V (2000) Switching regression models using ambiguity and distance rejects: application to ionogram analysis. In: Proceedings of 15th international conference on pattern recognition, 2000, vol 2. IEEE
Nasraoui O, Krishnapuram R (1995) Crisp interpretations of fuzzy and possibilistic clustering algorithms. In: 3rd European congress on intelligent techniques and soft computing, vol 3. Aachen, pp 1312–1318
Papastamoulis P, Martin-Magniette M-L, Maugis-Rabusseau C (2016) On the estimation of mixtures of poisson regression models with large number of components. Comput Stat Data Anal 93:97–106
Peters G (2001) A linear forecasting model and its application to economic data. J Forecast 20(5):315–328
Reddy CK, Chiang H-D, Rajaratnam B (2008) Trust-tech-based expectation maximization for learning finite mixture models. IEEE Trans Pattern Anal Mach Intell 30(7):1146–1157
Skrondal A, Rabe-Hesketh S (2004) Generalized latent variable modeling: multilevel, longitudinal, and structural equation models. CRC Press, Boca Raton
Soltani M, Chaari A, BenHmida F, Gossa M (2011) A new objective function for fuzzy c-regression model and its application to TS fuzzy model identification. In: 2011 international conference on communications, computing and control applications (CCCA). IEEE
Song W, Yao W, Xing Y (2014) Robust mixture regression model fitting by Laplace distribution. Comput Stat Data Anal 71:128–137
Turner TR (2000) Estimating the propagation rate of a viral infection of potato plants via mixtures of regressions. J R Stat Soc Ser C (Appl Stat) 49(3):371–384
Wedel M, Kamakura WA (2012) Market segmentation: conceptual and methodological foundations, vol 8. Springer, Berlin
Wu Q, Sampson AR (2009) Mixture modeling with applications in schizophrenia research. Comput Stat Data Anal 53(7):2563–2572
Wu K-L, Yang M-S, Hsieh J-N (2010) Mountain c-regressions method. Pattern Recognit 43(1):86–98
Wu X, Wu B, Sun J, Qiu S, Li X (2015) A hybrid fuzzy k-harmonic means clustering algorithm. Appl Math Model 39(12):3398–3409
Yager RR, Filev DP (1994) Approximate clustering via the mountain method. IEEE Trans Syst Man Cybern 24(8):1279–1284
Yang M-S, Wu K-L (2005) A modified mountain clustering algorithm. Pattern Anal Appl 8(1–2):125–138
Yang M-S, Wu K-L, Hsieh J-N, Yu J (2008) Alpha-cut implemented fuzzy clustering algorithms and switching regressions. IEEE Trans Syst Man Cybern Part B (Cybern) 38(3):588–603
Yao W, Wei Y, Yu C (2014) Robust mixture regression using the t-distribution. Comput Stat Data Anal 71:116–127
Zhang B, Hsu M, Dayal U (1999) K-harmonic means-a data clustering algorithm. Hewlett-Packard Labs Technical Report HPL-1999-124
Acknowledgements
The authors would like to thank the editors and the anonymous referees for their helpful comments. This work was supported by National Key Technology R & D Program of the Ministry of Science and Technology of China (2015BAA03B02) and the Key Project of Yunnan Power Grid Co. Ltd. (YNYJ2016043).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that they have no conflict of interest.
Ethical standard
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Human and animals rights
This article does not contain any studies with animals performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Communicated by V. Loia.
Rights and permissions
About this article
Cite this article
Zhao, Y., Wang, Ph., Li, Yg. et al. Fuzzy weighted c-harmonic regressions clustering algorithm. Soft Comput 22, 4595–4611 (2018). https://doi.org/10.1007/s00500-017-2642-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-017-2642-3