Abstract
Representation of compound information in a truthful, coarse way forms the layout of the granular computing paradigm. In granular computing, the continuous variables are mapped into intervals to be utilized in the extraction of fuzzy graphs from the given dataset. The objective of Granular Box Regression is to establish a relationship between the predictor and the target variables using multidimensional boxes. However, the traditional box regression technique uses a greedy approach due to which the algorithm tends to converge to some local optima, and optimal box configuration may not be obtained. In this article, we suggest overcoming the problem of getting stuck into local optima using randomized search and optimization techniques of Simulated Annealing and Genetic Algorithms. The major advantage of using Simulated Annealing is that it allows occasional acceptance of poor solutions to avoid getting trapped into some local optima. Genetic Algorithms also provide efficient, robust search optimization techniques that minimize the chances of a local optimum problem. A comparative analysis is conducted while implementing Granular Box Regression using Simulated Annealing and Genetic Algorithm, and the results are demonstrated on some artificial datasets, economic datasets, and some datasets of COVID-19 cases. As per the quantitative analysis of the Granular Box Regression (GBR) methods, both GBR-SA and GBR-GA significantly outperformed the baseline GBR algorithm across various datasets. For instance in the 3DED1 dataset, GBR-SA and GBR-GA showed an improvement of \(16.02\%\) while for 2DCD2, they showed an improvement of \(22.22\%\). However, the execution time varied for GBR-GA by \(95.4\%\) with the GBR-SA algorithm, which in turn took about \(26\%\) average time more than the base algorithm of GBR.




















We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Availability of Data and Materials
The publicly available datasets analysed during the study have been mentioned in Sects. 4.2 and 4.3 respectively. The datasets generated during the current study are not publicly available due to some technical constraints but are available from the corresponding author on reasonable request and may be accessed accordingly.
References
Zadeh LA. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst. 1997;90(2):111–27.
Peters G. Granular box regression. IEEE Trans Fuzzy Syst. 2011;19(6):1141–52.
Zadeh LA. Toward human level machine intelligence-is it achievable? the need for a paradigm shift. IEEE Comput Intell Mag. 2008;3(3):11–22.
Yao Y. In 2005 IEEE international conference on granular computing, vol. 1 (IEEE), 2005; pp. 85–90
Shen Y, Pedrycz W, Wang X. Clustering homogeneous granular data: formation and evaluation. IEEE Trans Cybern. 2019;49(4):1391–402. https://doi.org/10.1109/TCYB.2018.2802453.
Zadeh LA. Fuzzy sets, fuzzy logic, and fuzzy systems: selected papers by lotfi a zadeh 1996;pp. 394–432
Pawlak Z. Rough sets: theoretical aspects of reasoning about data, vol. 9. Springer Science & Business Media; 2012.
Zhu X, Pedrycz W, Li Z. A granular approach to interval output estimation for rule-based fuzzy models. IEEE Trans Cybern. 2020. https://doi.org/10.1109/TCYB.2020.3025668.
Draper NR, Smith H. Applied regression analysis, vol. 326. John Wiley & Sons; 1998.
Maulud D, Abdulazeez AM. A review on linear regression comprehensive in machine learning. J Appl Sci Technol Trends. 2020;1(2):140–7.
Van Laarhoven PJ, Aarts EH. in Simulated annealing: theory and applications. Springer; 1987. pp. 7–15
Delahaye D, Chaimatanan S, Mongeau M. Simulated annealing: from basics to applications. Handbook of metaheuristics. 2019;pp. 1–35.
Crama Y, Schyns M. Simulated annealing for complex portfolio selection problems. Eur J Oper Res. 2003;150(3):546–71.
Goldberg DE, Holland JH. Genetic algorithms and machine learning 1988.
Davis L. Handbook of genetic algorithms 1991.
Kaufman L, Rousseeuw PJ. Finding groups in data: an introduction to cluster analysis, vol. 344. John Wiley & Sons; 2009.
Kirkpatrick S, Gelatt CD, Vecchi MP. Optimization by simulated annealing. Science. 1983;220(4598):671–80.
Geman S, Geman D. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell. 1984;6:721–41.
Busetti F. Simulated annealing overview. World Wide Web URL www. geocities. com/francorbusetti/saweb. pdf 2003;4.
Mukhopadhyay A, Maulik U, Bandyopadhyay S. Multiobjective genetic algorithm-based fuzzy clustering of categorical attributes. IEEE Trans Evol Comput. 2009;13(5):991–1005.
Michalewicz Z. Genetic algorithms+ data structures= evolution programs. Springer Science & Business Media; 2013.
Miller BL, Goldberg DE, et al. Genetic algorithms, tournament selection, and the effects of noise. Compl Syst. 1995;9(3):193–212.
Pandey HM, Shukla A, Chaudhary A, Mehrotra D. In: Information systems design and intelligent applications. Springer; 2016. pp. 731–738
Maulik U, Bandyopadhyay S, Trinder JC. Safe: an efficient feature extraction technique. Knowl Inf Syst. 2001;3(3):374–87.
Brown DE, Huntley CL. A practical application of simulated annealing to clustering. Pattern Recogn. 1992;25(4):401–12.
Zivkovic M, K V, Bacanin N, Djordjevic A, Antonijevic M, Strumberger I, Rashid TA. Hybrid genetic algorithm and machine learning method for covid-19 cases prediction 2021;pp. 169–184.
Ghosal S, Sengupta S, Majumder M, Sinha B. Linear regression analysis to predict the number of deaths in India due to sars-cov-2 at 6 weeks from day 0 (100 cases-march 14th 2020). Diabetes Metab Syndr: Clin Res Rev. 2020;14(4):311–5.
Chakraborty M, Mukhopadhyay A, Maulik U. In: 2020 IEEE 5th international conference on computing communication and automation (ICCCA) (IEEE), 2020;pp. 519–524
Marjit S, Bhattacharyya T, Chatterjee B, Sarkar R. Simulated annealing aided genetic algorithm for gene selection from microarray data. Comput Biol Med. 2023;158: 106854.
Xiong J, Liu X, Zhu X, Zhu H, Li H, Zhang Q. Semi-supervised fuzzy c-means clustering optimized by simulated annealing and genetic algorithm for fault diagnosis of bearings. IEEE Access. 2020;8:181976–87.
Botchkarev A. Performance metrics (error measures) in machine learning regression, forecasting and prognostics: properties and typology. arXiv preprint arXiv:1809.03006 2018.
Peters G, Lacic Z. Tackling outliers in granular box regression. Inf Sci. 2012;212:44–56.
Bandyopadhyay S, Saha S, Maulik U, Deb K. A simulated annealing-based multiobjective optimization algorithm: Amosa. IEEE Trans Evol Comput. 2008;12(3):269–83.
Funding
M. Chakraborty and U. Maulik acknowledges the support received from the Indo-French Centre for the Promotion of Advanced Research, Ministry of Science and Technology, Govt. of India through the project: 6702-1 ‘Exploring Graph Neural Networks (GNN’s) for Data-Driven Modeling of Poly-Pharmacy Adverse Drug Events from drug-drug interactions’. A. Mukhopadhyay acknowledges the support received from the MATRICS project grant MTR/2020/000326 of DST-SERB, Govt. of India.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation and concept, data collection and analysis were performed by Mrittika Chakraborty, Ujjwal Maulik and Anirban Mukhopadhyay. The first draft of the manuscript was written by Mrittika Chakraborty and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of Interest
The authors have no relevant financial or non-financial interests to disclose.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chakraborty, M., Maulik, U. & Mukhopadhyay, A. Granular Box Regression Using Simulated Annealing and Genetic Algorithm: A Comparative Study. SN COMPUT. SCI. 5, 978 (2024). https://doi.org/10.1007/s42979-024-03333-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-024-03333-y