Skip to main content
SpringerLink
Log in

Parallel Implementation of Ant-Based Clustering Algorithm Based on Hadoop

  • Conference paper
Advances in Swarm Intelligence (ICSI 2012)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7331))

Included in the following conference series:

Abstract

Hadoop is a distributed system infrastructure of cloud computing. Based on the characteristics of ant-based clustering algorithm, the paper implements the parallelization of this algorithm using MapReduce on Hadoop. The Map function calculates the average similarity of the object with its neighborhood objects. The Reduce function processes the objects with the Map outputs and updates related information of both ants and the objects to get ready for the next job. Results on the Hadoop clusters show that our method can significantly improve the computational efficiency with the premise of maintaining clustering accuracy.

This work is partially supported by the National Science Foundation of China (Nos. 61170111, 61003142 and 61152001) and the Fundamental Research Funds for the Central Universities (No. SWJTU11ZT08).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dean, J., Ghemawat, S.: MapReduce: Simplified data processing on large clusters. In: Operating Systems Design and Implementation, pp. 137–149 (2004)

    Google Scholar 

  2. Apache Hadoop. Hadoop, http://hadoop.apache.org

  3. Ghemawat, S., Gobioff, H., Leung, S.: The Google file system. In: Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, pp. 29–43. ACM, Bolton Landing (2003)

    Chapter  Google Scholar 

  4. Borthakur, D.: The Hadoop Distributed File System: Architecture and Design. The Apache Software Foundation, http://hadoop.apache.org

  5. Wei, J., Ravi, V.T., Agrawal, G.: Comparing map-reduce and FREERIDE for data-intensive applications. In: IEEE International Conference on Cluster Computing and Workshops. CLUSTER 2009, pp. 1–10 (2009)

    Google Scholar 

  6. Smith, A.E.: Swarm intelligence: from natural to artificial systems. IEEE Transactions on Evolutionary Computation 4, 192–193 (2000)

    Article  Google Scholar 

  7. Yang, Y., Kamel, M.: Clustering Ensemble Using Swarm Intelligence. In: IEEE Swarm Intelligence Symposium, pp. 65–71 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, P.R. China

    Yan Yang, Xianhua Ni, Hongjun Wang & Yiteng Zhao

  2. Key Lab of Cloud Computing and Intelligent Technology, Sichuan Province, Chengdu, 610031, P.R. China

    Yan Yang, Xianhua Ni & Hongjun Wang

Authors
  1. Yan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xianhua Ni
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hongjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yiteng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Key Laboratory of Machine Perception (MOE), Peking University, Department of Machine Intelligence, School of Electronics Engineering and Computer Science, Peking University, 100871, Beijing, China

    Ying Tan

  2. Department of Electrical and Electronic Engineering, Xi’an Jiaotong-Liverpool University, Suzhou, China

    Yuhui Shi

  3. Shenzhen City Key Laboratory of Embedded System Design, College of Computer Science and Software Engineering, Shenzhen University, 518060, Shenzhen, China

    Zhen Ji

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yang, Y., Ni, X., Wang, H., Zhao, Y. (2012). Parallel Implementation of Ant-Based Clustering Algorithm Based on Hadoop. In: Tan, Y., Shi, Y., Ji, Z. (eds) Advances in Swarm Intelligence. ICSI 2012. Lecture Notes in Computer Science, vol 7331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30976-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30976-2_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30975-5

  • Online ISBN: 978-3-642-30976-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation