Skip to main content
Springer Nature Link
Log in

Research on Data Mining Algorithm of Association Rules Based on Hadoop

  • Conference paper
  • First Online:
Computational Intelligence and Intelligent Systems (ISICA 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 873))

Included in the following conference series:

  • 694 Accesses

Abstract

Big data mining based on cloud computing is the hot topic of the industry research, this paper proposed an improved distributed Apriori algorithm. More importantly, In view of the poor performance of running Apriori algorithm in large data, the algorithm of association rule data mining based on Apriori algorithm is put forward, and the improved distributed Apriori algorithm based on Hadoop platform is proposed. The algorithm focuses on the application of association rules algorithm based on Hadoop in mass data mining. This paper describes the idea of improved Apriori algorithm on Hadoop platform, and presents the experimental test. The experimental results show that the improved algorithm of association rules based on Hadoop can effectively improve the Apriori algorithm for association rules of operation efficiency, and reduce the redundant association rules, and has the efficient advantage in dealing with massive data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Rai, N., Jain, S., Jain, A.: Mining interesting positive and negative association rule based on improved genetic algorithm. Int. J. Adv. Comput. Sci. Appl. 5(1), 160–165 (2014)

    Google Scholar 

  2. Gupta, M.K., Sikka, G.: Association rules extraction using multi-objective feature of genetic algorithm. In: Proceedings of the World Congress on Engineering and Computer Science, pp. 23–25 (2013)

    Google Scholar 

  3. Zhao, L., Jin, X., Sun, L., et al.: Association rule mining method based on niching genetic algorithm. Comput. Eng. 34(10), 163–165 (2013)

    Google Scholar 

  4. Lammel, R.: Google’s MapReduce programming model - revisited. Sci. Comput. Prog. (S0167-6423) 70(1), 1–30 (2012)

    MathSciNet  MATH  Google Scholar 

  5. Mccreadie, R.M.C., Macdonald, C., Ounis, I.: On single-pass indexing with MapReduce. In: Association Computing Machinery, New York, USA (2009)

    Google Scholar 

  6. He, B., Yang, K., Fang, R., Lu, M., Govindaraju, N.K., Luo, Q., Sander, P.V.: Relational joins on graphics processors. In: ACM SIGMOD 2014 (2014)

    Google Scholar 

  7. Mei, S., Kun, Z.: Big-data analytics: challenges, key technologi and prospects. ZTE Commun. 11(2), 11–17 (2013)

    Google Scholar 

  8. Yang, X., Liu, Z., Fu, Y.: MapReduce as a programming model for association rules algorithm on Hadoop. In: The 3rd International Conference on Information Sciences and Interaction Sciences (ICIS), pp. 99–102 (2010)

    Google Scholar 

  9. Dean, J., Ghemawat, S.: MapReduce: a flexible data processing tool. Commun. ACM 53(1), 72–77 (2013)

    Article  Google Scholar 

  10. Lin, J., Dyer, C.: Data-Intensive Text Processing with MapReduce (2010)

    Google Scholar 

  11. Yadav, C., Wang, S., Jkumar, M.: An approach to improve Apriori algorithm based on association rule mining. In: 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), pp. 1–9. IEEE, USA (2013)

    Google Scholar 

  12. Abadeh, M.S., Hamid, M., Jafar, H.: Design and analysis of genetic fuzzy systems for intrusion detection in computer networks. Expert Syst. Appl. 38, 7067–7075 (2014)

    Article  Google Scholar 

  13. Wu, K., Hao, J., Wang, C.: Application of fuzzy association rules in intrusion detection. In: International Conference on Internet Computing and Information Services, pp. 269–272 (2011)

    Google Scholar 

  14. Wu, Y., Qin, Y., Song, J.: Research overview of intrusion detection algorithms based on association rules. Comput. Eng. Des. 32(3), 834–838 (2013)

    Google Scholar 

Download references

Acknowledgements

The work is supported in part by Department of Education of Guangdong Province under Grant 2015KQNCX188.

Author information

Authors and Affiliations

  1. Department of Computer Science, Guangdong University of Science and Technology, Dongguan, China

    Linrun Qiu

Authors
  1. Linrun Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Linrun Qiu .

Editor information

Editors and Affiliations

  1. College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China

    Kangshun Li

  2. Jiangxi University of Science and Technology, Ganzhou, Jiangxi, China

    Wei Li

  3. Chemical and Petroleum Engineering, University of Calgary, Calgary, Alberta, Canada

    Zhangxing Chen

  4. School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Fukushima, Japan

    Yong Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qiu, L. (2018). Research on Data Mining Algorithm of Association Rules Based on Hadoop. In: Li, K., Li, W., Chen, Z., Liu, Y. (eds) Computational Intelligence and Intelligent Systems. ISICA 2017. Communications in Computer and Information Science, vol 873. Springer, Singapore. https://doi.org/10.1007/978-981-13-1648-7_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-1648-7_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-1647-0

  • Online ISBN: 978-981-13-1648-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics