Skip to main content
SpringerLink
Log in

An efficient system for customer churn prediction through particle swarm optimization based feature selection model with simulated annealing

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Churn prediction in telecom has gained a huge prominence in the recent times due to the extensive interests exhibited by the stakeholders, large number of competitors and huge revenue losses incurred due to churn. Predicting telecom churn is challenging due to the voluminous and sparse nature of the data. This paper presents a technique for the telecom churn prediction that employs particle swarm optimization (PSO) and proposes three variants of PSO for churn prediction namely, PSO incorporated with feature selection as its pre-processing mechanism, PSO embedded with simulated annealing and finally PSO with a combination of both feature selection and simulated annealing. The proposed classifiers were compared with decision tree, naive bayes, K-nearest neighbor, support vector machine, random forest and three hybrid models to analyze their predictability levels and performance aspects. Accuracy, true positive rate, true negative rate, false positive rate, Precision, F-Measures, receiver operating characteristic and precision-recall plots were used as performance metrics. Experiments reveal that the performance of metaheuristics was more efficient and they also exhibited better predictability levels.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Bhattacharya, C.B.: When customers are members: customer retention in paid membership contexts. J. Acad. Marketing Sci. 26(1), 31–44 (1998)

    Article  MathSciNet  Google Scholar 

  2. Dyche, J.: The CRM handbook: a business guide to customer relationship management. Addison-Wesley Professional, Boston (2002)

    Google Scholar 

  3. Nie, G., Rowe, W., Zhang, L., Tian, Y., Shi, Y.: Credit card churn forecasting by logistic regression and decision tree. Expert Syst. Appl. 38(12), 15273–15285 (2011)

    Article  Google Scholar 

  4. Gunther, C.C., Tvete, I.F., Aas, K., Sandnes, G.I., Borgan, O.: Modelling and predicting customer churn from an insurance company. Scand. Actuar. J. 2014(1), 58–71 (2014)

    Article  MathSciNet  Google Scholar 

  5. Khan, A.A., Jamwal, S., Sepehri, M.M.: Applying data mining to customer churn prediction in an internet service provider. Int. J. Comput. Appl. 9(7), 8–14 (2010)

    Google Scholar 

  6. Huang, S.Y., Yen, D.C., Wang, H.Y.: Applying data mining to telecom churn management. J. Expert Syst. Appl. 31(3), 515–524 (2006)

    Article  Google Scholar 

  7. Xia, G.E., Jin, W.D.: Model of customer churn prediction on support vector machine. J. Syst. Eng. Theor. Pract. 28(1), 71–77 (2008)

    Article  Google Scholar 

  8. Larivire, B., Poel, D.V.D.: Predicting customer retention and profitability by using random forests and regression forests techniques. J. Expert Syst. Appl. 29, 472–484 (2014)

    Article  Google Scholar 

  9. Burez, J., Van den Poel, D.: Handling class imbalance in customer churn prediction. J. Expert Syst. Appl. 36(3), 4626–4636 (2009)

    Article  Google Scholar 

  10. Huang, B.Q., Kechadi, M.T., Buckley, B.: Customer churn prediction in telecommunications. J. Expert Syst. Appl. 39(1), 1414–1425 (2012)

    Article  Google Scholar 

  11. Hwang, H., Jung, T., Suh, E.: An LTV model and customer segmentation based on customer value: a case study on the wireless telecommunication industry. J. Expert Syst. Appl. 26(2), 181–188 (2004)

    Article  Google Scholar 

  12. Ruta, D., Dymitr, Nauck, D., Azvine, B.: K nearest sequence method and its application to churn prediction. In: Intelligent Data Engineering and Automated Learning IDEAL, pp. 207–215. Springer, Berlin (2006)

  13. Zhang, Y., et al.: A hybrid KNN-LR classifier and its application in customer churn prediction. In: IEEE International Conference on Systems, Man and Cybernetics-ISIC 2007. IEEE (2007)

  14. Tsai, C.F., Lu, Y.H.: Customer churns prediction by hybrid neural networks. J. Expert Syst. Appl. 36(10), 12547–12553 (2012)

    Article  Google Scholar 

  15. Khashei, M., Hamadani, A.Z., Bijari, M.: A novel hybrid classification model of artificial neural networks and multiple linear regression models. J. Expert Syst. Appl. 39(3), 2606–2620 (2012)

    Article  Google Scholar 

  16. Bose, I., Chen, X.: Hybrid models using unsupervised clustering for prediction of customer churn. J. Organizational Comput. Electron. Commer. 19(2), 133–151 (2009)

    Article  Google Scholar 

  17. Huang, Y., Kechadi, T.: An effective hybrid learning system for telecommunication churn prediction. J. Expert Syst. Appl. 40, 5635–5647 (2013)

    Article  Google Scholar 

  18. Yeshwanth, V., Raj, V.V., Saravanan, M.: Evolutionary churn prediction in mobile networks using hybrid learning. In: Proceedings of the twenty-fourth international Florida artificial intelligence research society conference, (FLAIRS), Palm Beach, Florida, USA, May 1820. AAAI Press (2011)

  19. Idris, A., Khan, A., Lee, Y.S.: Intelligent churn prediction in telecom: employing mRMR feature selection and RotBoost based ensemble classification. Appl. Intell. 39(3), 659–672 (2013)

    Article  Google Scholar 

  20. Xiao, Jin, et al.: Feature-selection-based dynamic transfer ensemble model for customer churn prediction. Knowl. Inf. Syst. 43(1), 29–51 (2015)

    Article  Google Scholar 

  21. Xiao, J. et al.: One-step classifier ensemble model for customer churn prediction with Imbalanced Class. In: Proceedings of the Eighth International Conference on Management Science and Engineering Management. Springer Berlin, vol. 281, pp. 843–854 (2014)

  22. Alessandro, D., Johnson, L., Gray, D.: Consumer satisfaction versus churn in the case of upgrades of 3G to 4G cell networks. Marketing Lett. 26(4), 489–500 (2015)

    Article  Google Scholar 

  23. Droftina, U., Stular, M., Kosir, A.: A diffusion model for churn prediction based on sociometric theory. Adv. Data Anal. Classif. 9(3), 341–365 (2015)

    Article  MathSciNet  Google Scholar 

  24. Chen, K., Hu, Y.H.: Predicting customer churn from valuable B2B customers in the logistics industry: a case study. Inf. Syst. e-Bus. Manag. 13(3), 475–494 (2015)

    Article  Google Scholar 

  25. Faris, H., et al.: Neighborhood cleaning rules and particle swarm optimization for predicting customer churn behavior in telecom industry. Int. J. Adv. Sci. Technol. 68, 11–22 (2014)

    Article  Google Scholar 

  26. Idris, A., Rizwan, M., Khan, A.: Churn prediction in telecom using random forest and PSO based data balancing in combination with various feature selection strategies. Comput. Electr. Eng. 38(6), 1808–1819 (2012)

    Article  Google Scholar 

  27. Bianchi, L., et al.: A survey on metaheuristics for stochastic combinatorial optimization. Nat. Comput. 8(2), 239–287 (2009)

    Article  MathSciNet  Google Scholar 

  28. Dalessandro, B.: Bring the noise: Embracing randomness is the key to scaling up machine learning algorithms. Big Data 1(2), 110–112 (2013)

    Article  Google Scholar 

  29. Bousquet, O., Bottou, L.: The tradeoffs of large scale learning. Adv. Neural Inf. Process. Syst. 20, 161–168 (2008)

    Google Scholar 

  30. Bottou, L.: Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT-2010, pp. 177–186 Physica, Heidelberg (2010)

  31. Dorigo, M., et al.: Ant system: an autocatalytic optimizing process (1991)

  32. Dorigo, Marco, Gambardella, Luca Maria: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans. Evolut. Comput. 1(1), 53–66 (1997)

    Article  Google Scholar 

  33. Yang, X.-S.: Firefly algorithm. Nat. Inspir. Metaheuristic Algorithms 20, 79–90 (2008)

    Google Scholar 

  34. Pham, D.T., et al.: The Bees Algorithm, Technical note. Manufacturing Engineering Centre, Cardiff University, UK, pp. 1–57 (2005)

  35. Kennedy, J.: Eberhart. RC: particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, pp. 1948–1942 (1995)

  36. Shi, Y., Eberhart, R.: A modified particle swarm optimizer. Evolutionary Computation. In: The 1998 IEEE International Conference on Proceedings 1998. IEEE World Congress on Computational Intelligence. IEEE (1998)

  37. http://www.kdd.org/kdd-cup/view/kdd-cup-2009/Data

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology, Tiruchirappalli, India

    J. Vijaya & E. Sivasankar

Authors
  1. J. Vijaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. Sivasankar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to J. Vijaya.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vijaya, J., Sivasankar, E. An efficient system for customer churn prediction through particle swarm optimization based feature selection model with simulated annealing. Cluster Comput 22 (Suppl 5), 10757–10768 (2019). https://doi.org/10.1007/s10586-017-1172-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-017-1172-1

Keywords

Search

Navigation