Ioannis Markoulidakis
ABSTRACT
The paper presents a novel method for reducing a multi-class Confusion Matrix into a 2 × 2 version enabling the use of the relevant performance metrics and methods like the Receiver Operator Characteristic and the Area Under the Curve for the assessment of different classification algorithms. The reduction method is based on class grouping and leads to a specific Confusion Matrix type. The developed method is then exploited for the assessment of several state-of-the-art machine learning algorithms applied on a customer experience metric.
- Lerzan Aksoy, Alexander Buoye, Pelin Aksoy, Bart Larivière, and T. L. Keiningham. 2013. A Cross-National Investigation of the Satisfaction and Loyalty Linkage for Mobile Telecommunications Services across Eight Countries. JOURNAL OF INTERACTIVE MARKETING 27, 1 (2013), 74–82. Issue 1. https://doi.org/10.1016/j.intmar.2012.09.003Google Scholar
Cross Ref
- Ethem Alpaydin. 2010. Introduction to Machine Learning. The MIT Press. https://mitpress.mit.edu/books/introduction-machine-learningGoogle ScholarDigital Library
- N. Bakalos, A. Voulodimos, N. Doulamis, A. Doulamis, A. Ostfeld, E. Salomons, J. Caubet, V. Jimenez, and P. Li. 2019. Protecting Water Infrastructure From Cyber and Physical Threats: Using Multimodal Data Fusion and Adaptive Deep Learning to Monitor Critical Systems. IEEE Signal Processing Magazine 36, 2 (2019), 36–48. https://doi.org/10.1109/MSP.2018.2885359Google ScholarCross Ref
- Ruth N. Bolton and James H. Drew. 1991. A Multistage Model of Customers’ Assessments of Service Quality and Value. Journal of Consumer Research 17, 4 (1991), 375–384. https://doi.org/10.1086/208564Google ScholarCross Ref
- Anastasios D Doulamis, Nikolaos D Doulamis, and Stefanos D Kollias. 2000. On-line retrainable neural networks: improving the performance of neural networks in image analysis problems. IEEE Transactions on neural networks 11, 1 (2000), 137–155.Google ScholarDigital Library
- Nikolaos Doulamis and Athanasios Voulodimos. 2016. FAST-MDL: Fast Adaptive Supervised Training of multi-layered deep learning models for consistent object tracking and classification. In 2016 IEEE International Conference on Imaging Systems and Techniques (IST). IEEE, 318–323.Google ScholarDigital Library
- Tom Fawcett. 2006. An Introduction to ROC Analysis. Pattern Recognition Letters 27, 8 (2006), 861–874. https://doi.org/10.1016/j.patrec.2005.10.010Google ScholarDigital Library
- Chiara Gentile, Nicola Spiller, and Giuliano Noci. 2007. How to Sustain the Customer Experience:: An Overview of Experience Components That Co-Create Value With the Customer. European Management Journal 25, 5 (2007), 395–410. https://ideas.repec.org/a/eee/eurman/v25y2007i5p395-410.htmlGoogle ScholarCross Ref
- G. Kopsiaftis, E. Protopapadakis, A. Voulodimos, N. Doulamis, and A. Mantoglou. 2019. Gaussian Process Regression Tuned by Bayesian Optimization for Seawater Intrusion Prediction. Computational Intelligence and Neuroscience 2019 (2019), 2859429. https://doi.org/10.1155/2019/2859429Google ScholarCross Ref
- I. Markoulidakis, I. Rallis, I. Georgoulas, G. Kopsiaftis, A. Doulamis, and N. Doulamis. 2020. A Machine Learning Based Classification Method for Customer Experience Survey Analysis. Technologies 8, 4 (2020), 76. Issue 4. https://doi.org/10.3390/technologies8040076Google ScholarCross Ref
- Dana Petcu and Jos Luis Vzquez-Poletti. 2012. European Research Activities in Cloud Computing. Cambridge Scholars Publishing, Newcastle upon Tyne, GBR.Google Scholar
- David Powers and Ailab. 2011. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation. J. Mach. Learn. Technol 2 (2011), 2229–3981. https://doi.org/10.9735/2229-3981Google Scholar
- Ahmed Rageh Ismail, TC Melewar, Lynn Lim, and Arch Woodside. 2011. Customer Experiences with Brands: Literature Review and Research Directions. The Marketing Review 11, 3 (2011), 205–225. https://doi.org/10.1362/146934711X589435Google ScholarCross Ref
- I. Rallis, I. Markoulidakis, I. Georgoulas, and G. Kopsiaftis. 2020. A Novel Classification Method for Customer Experience Survey Analysis. In Proceedings of the 13th ACM PETRA 2020 (New York, NY, USA). Association for Computing Machinery, 1–9. https://doi.org/10.1145/3389189.3397999Google ScholarDigital Library
- F. F. Reichheld and S. R. Covey. 2006. The Ultimate Question: Driving Good Profits and True Growth. Vol. 211. Harvard Business School Press Boston.Google Scholar
- Stephen V. Stehman. 1997. Selecting and Interpreting Measures of Thematic Classification Accuracy. Remote Sensing of Environment 62, 1 (1997), 77–89. https://doi.org/10.1016/S0034-4257(97)00083-7Google ScholarCross Ref
- Alaa Tharwat. 2020. Classification Assessment Methods. Applied Computing and Informatics ahead-of-print (2020). Issue ahead-of-print. https://doi.org/10.1016/j.aci.2018.08.003Google Scholar
Recommendations
Confusion Matrix Analysis for NPS
PCI '20: Proceedings of the 24th Pan-Hellenic Conference on InformaticsNet Promoter Score (NPS) is a widely used Customer Experience Metric which when analyzed against specific attributes of experience (e.g., satisfaction associated with call center, website, etc.) leads to a classification problem with an 11×11 confusion ...
Scaling multi-class support vector machines using inter-class confusion
KDD '02: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data miningSupport vector machines (SVMs) excel at two-class discriminative learning problems. They often outperform generative classifiers, especially those that use inaccurate generative models, such as the naïve Bayes (NB) classifier. On the other hand, ...
PAC-Bayesian generalization bound on confusion matrix for multi-class classification
ICML'12: Proceedings of the 29th International Coference on International Conference on Machine LearningIn this paper, we propose a PAC-Bayes bound for the generalization risk of the Gibbs classifier in the multi-class classification framework. The novelty of our work is the critical use of the confusion matrix of a classifier as an error measure; this ...
Comments