Skip to main content
Springer Nature Link
Log in

Goal-Oriented Classification Measure Based on the Game Theory Concepts

  • Conference paper
  • First Online:
Recent Challenges in Intelligent Information and Database Systems (ACIIDS 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1863))

Included in the following conference series:

Abstract

In this paper, we present the novel idea of the classification measure based on the combination of precision and recall. The weights of these measures are calculated based on the game-theoretic concept of equilibrium. The classical C4.5 algorithm calculates measures: precision and recall for binary decision classes.

In such a game, classification results are used to generate the best weights for the precision and recall classification measures. First, we solve the game and obtain the Nash equilibrium to obtain these weights. Next, we calculate the classification measure according to the measure weights estimated using the Nash equilibrium. Eventually, we compare the results with the more realistic example, where the importance of both decision classes is equal, and only the weights of classification measures can be adjusted. All experiments are performed on several binary classification datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees, p. 358 (1984)

    Google Scholar 

  2. Buckland, M., Gey, F.: The relationship between recall and precision. J. Am. Soc. Inf. Sci. 45(1), 12–19 (1994)

    Article  Google Scholar 

  3. Burduk, R.: Classification performance metric for imbalance data based on recall and selectivity normalized in class labels. arXiv preprint arXiv:2006.13319 (2020)

  4. Conitzer, V., Gilpin, A., Sandholm, T.: Mixed-integer programming methods for finding Nash equilibria. In: Proceedings of the 20th National Conference on Artificial Intelligence, vol. 2, pp. 495–501 (2005)

    Google Scholar 

  5. Daskalakis, C., Mehta, A., Papadimitriou, C.: Progress in approximate Nash equilibria. In: 8th ACM Conference on Electronic Commerce, pp. 355–358 (2007)

    Google Scholar 

  6. Gilli, M., Schumann, E.: Accuracy and precision in finance. Available at SSRN 2698114 (2015)

    Google Scholar 

  7. Gösgens, M., Zhiyanov, A., Tikhonov, A., Prokhorenkova, L.: Good classification measures and how to find them. In: Advances in Neural Information Processing Systems, vol. 34 (2021)

    Google Scholar 

  8. Grandini, M., Bagli, E., Visani, G.: Metrics for multi-class classification: an overview, pp. 1–17. arXiv preprint arXiv:2008.05756 (2020)

  9. Hand, D.J., Christen, P., Kirielle, N.: F*: an interpretable transformation of the F-measure. Mach. Learn. 110(3), 451–456 (2021). https://doi.org/10.1007/s10994-021-05964-1

    Article  MathSciNet  MATH  Google Scholar 

  10. Juszczuk, P.: A novel approximate method of computing extended Nash equilibria. Appl. Soft Comput. J. 76, 682–696 (2019)

    Article  Google Scholar 

  11. Kozak, J.: Decision Tree and Ensemble Learning Based on Ant Colony Optimization. SCI, vol. 781. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-93752-6

    Book  Google Scholar 

  12. Kozak, J., Kania, K., Juszczuk, P., Mitręga, M.: Swarm intelligence goal-oriented approach to data-driven innovation in customer churn management. Int. J. Inf. Manag. 60, 102357 (2021)

    Article  Google Scholar 

  13. Kozak, J., Probierz, B., Kania, K., Juszczuk, P.: Preference-driven classification measure. Entropy 24(4), 531 (2022)

    Article  MathSciNet  Google Scholar 

  14. Lemke, C.E., Howson, J.T.: Equilibrium points of bimatrix games. SIAM J. Appl. Math. 12, 413–423 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  15. Nudelman, E., Porter, R., Shoham, Y.: Simple search methods for finding a Nash equilibrium. In: AAAI-2004, pp. 664–669 (2004)

    Google Scholar 

  16. Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986). https://doi.org/10.1007/BF00116251

    Article  Google Scholar 

  17. Quinlan, J.R.: C4.5: Programs for Machine Learning. Elsevier, Amsterdam (2014)

    Google Scholar 

  18. Saito, T., Rehmsmeier, M.: The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE 10(3), 1–21 (2015). https://doi.org/10.1371/journal.pone.0118432

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Machine Learning, University of Economics in Katowice, 1 Maja, 40-287, Katowice, Poland

    Przemysław Juszczuk & Jan Kozak

Authors
  1. Przemysław Juszczuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jan Kozak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Przemysław Juszczuk .

Editor information

Editors and Affiliations

  1. Wrocław University of Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

  2. King Mongkut's Institute of Technology Ladkrabang, Bangkok, Thailand

    Siridech Boonsang

  3. Iwate Prefectural University, Iwate, Japan

    Hamido Fujita

  4. Wrocław University of Science and Technology, Wrocław, Poland

    Bogumiła Hnatkowska

  5. National University of Kaohsiung, Kaohsiung, Taiwan

    Tzung-Pei Hong

  6. King Mongkut's Institute of Technology, Ladkrabang, Thailand

    Kitsuchart Pasupa

  7. Malaysia Japan International Institute of Technology, Kuala Lumpur, Malaysia

    Ali Selamat

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Juszczuk, P., Kozak, J. (2023). Goal-Oriented Classification Measure Based on the Game Theory Concepts. In: Nguyen, N.T., et al. Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2023. Communications in Computer and Information Science, vol 1863. Springer, Cham. https://doi.org/10.1007/978-3-031-42430-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42430-4_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42429-8

  • Online ISBN: 978-3-031-42430-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation