Skip to main content
SpringerLink
Log in

Content Based Image Retrieval with Hadoop

  • Conference paper
  • First Online:
Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2016 (AISI 2016)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 533))

Abstract

Hadoop has become a widely used open source framework for large scale data processing. MapReduce is the core component of Hadoop. It is this programming paradigm that allows for massive scalability across hundreds or thousands of servers in a Hadoop cluster. It allows processing of extremely large video files or image files on data nodes. This can be used for implementing Content Based Image Retrieval (CBIR) algorithms on Hadoop to compare and match query images to the previously stored terabytes of an image descriptors databases. This work presents the implementation for one of the well-known CBIR algorithms called Scale Invariant Feature Transformation (SIFT) for image features extraction and matching using Hadoop platform. It gives focus on utilizing the parallelization capabilities of Hadoop MapReduce to enhance the CBIR performance and decrease data input\output operations through leveraging Partitioners and Combiners. Additionally, image processing and computer vision tools such as Hadoop Image Processing (HIPI) and Open Computer Vision (OpenCV) are integration is shown.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nausheen, K.M., Ram, M.S. Haarfilter: a machine learning tool for image processing in Hadoop. Int. J. Technol. Res. Eng. 3 (2015)

    Google Scholar 

  2. Barapatre, M.H., Nirgun, M.V., Jagtap, M.H., Ginde, M.S.: Image processing using mapreduce with performance analysis. Int. J. Emerg. Technol. Innovative Eng. I(4) (2015)

    Google Scholar 

  3. Yan, Y., Huang, L.: Large scale image processing research cloud. In: Cloud Computing, pp. 88–93 (2014)

    Google Scholar 

  4. Cheng, E.: Efficient feature extraction from a wide area motion imagery by MapReduce in Hadoop. In: SPIE Defense + Security. International Society for Optics and Photonics (2014)

    Google Scholar 

  5. Augustine, D.P.: Leveraging big data analytics and hadoop in developing India’s healthcare services. Int. J. Comput. Appl. 89(16), 44–50 (2014)

    Google Scholar 

  6. Gawde, A.U., Shah, M., Ukaye, I., Nanavati, M.: Object detection in hadoop using HIPI. Int. J. Adv. Res. Eng. Technol. (2013)

    Google Scholar 

  7. Bajcsy, P.: Terabyte-sized image computations on Hadoop cluster platforms. In: IEEE International Conference on Big Data, pp. 729–737. IEEE (2013)

    Google Scholar 

  8. Han, W., Kang, Y., Chen, Y., Zhang, X.: A MapReduce approach for SIFT feature extraction. In: International Conference on Cloud Computing and Big Data, pp. 465–469 (2013)

    Google Scholar 

  9. Moise, D., Shestakov, D., Thor, G., Amsaleg, L.: Indexing and searching 100 M images with Map-Reduce. In: ACM International Conference on Multimedia Retrieval, pp. 17–24 (2013)

    Google Scholar 

  10. Huitl, R., Schroth, G., Hilsenbeck, S., Schweiger, F., Steinbach, E.: TUMindoor: An extensive image and point cloud dataset for visual indoor localization and mapping. In: 19th IEEE International Conference on Image Processing (ICIP) Orlando, FL, pp. 1773–1776. IEEE (2012)

    Google Scholar 

  11. Schroth, G.: Mobile Visual Location Recognition. Ph.D. Thesis. Munich: Technische Universität München, July 2013

    Google Scholar 

  12. Panchal, P.M., Panchal, S.R., Shah, S.K.: A Comparison of SIFT and SURF. Int. J. Innovative Res. Comput. Commun. Eng. 1(2), 323–327 (2013). ISSN: 2320–9798

    Google Scholar 

  13. Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15561-1_56

    Chapter  Google Scholar 

  14. http://hadoop.apache.org

  15. White, T.: Hadoop: The Definitive Guide, 2nd edn. O’Reilly Media, Sebastopol (2011)

    Google Scholar 

  16. http://hipi.cs.virginia.edu/

  17. http://opencv.org/

  18. http://www.cloudera.com/

Download references

Author information

Authors and Affiliations

  1. Computer and Information Sciences, Ain Shams University, Cairo, Egypt

    Heba Gaber, Mohammed Marey, Safaa E. Amin & Mohamed F. Tolba

Authors
  1. Heba Gaber
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Marey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Safaa E. Amin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohamed F. Tolba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heba Gaber .

Editor information

Editors and Affiliations

  1. Faculty of Computers & Information, Cairo University, Giza, Egypt

    Aboul Ella Hassanien

  2. Dubai International Academic City, The British University, Dubai, United Arab Emirates

    Khaled Shaalan

  3. CS Dept. Faculty of Computers and Inform, Suez Canal University CS Dept. Faculty of Computers and Inform, Ismailia, Egypt

    Tarek Gaber

  4. Ahmed Orabi Square , Menouf, Egypt

    Ahmad Taher Azar

  5. Faculty of Computer & Information Scienc, Ain Shams University Faculty of Computer & Information Scienc, Cairo, Egypt

    M. F. Tolba

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gaber, H., Marey, M., Amin, S.E., Tolba, M.F. (2017). Content Based Image Retrieval with Hadoop. In: Hassanien, A., Shaalan, K., Gaber, T., Azar, A., Tolba, M. (eds) Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2016. AISI 2016. Advances in Intelligent Systems and Computing, vol 533. Springer, Cham. https://doi.org/10.1007/978-3-319-48308-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48308-5_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48307-8

  • Online ISBN: 978-3-319-48308-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation