Skip to main content
SpringerLink
Log in

Potentiality for Executing Hadoop Map Tasks on GPGPU via JNI

  • Conference paper
  • First Online:
Multimedia and Ubiquitous Engineering

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 240))

Abstract

Hadoop has good features for storing data, task distribution, and locality-aware scheduler. These features make Hadoop suitable to handle Big data. And GPGPU has the powerful computation performance comparable to supercomputer. Hadoop tasks running on GPGPU will enhance the throughput and performance dramatically. However the interaction way between Hadoop and GPGPU is required. In this paper, we use JNI to interact between them, and write the experimental Hadoop program with JNI. From the experimental results, we show the potentiality GPGPU-enabled Hadoop via JNI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tom W (2011) Hadoop: The definitive guide. O’relilly: 1–13

    Google Scholar 

  2. Dean J, Ghemawat J (2004) MapReduce: Simplified data processing on large cluster. In: ’04: Sixth symposium on operating system design and implements (OSDI ’04), SanFrancisco, pp 137–150

    Google Scholar 

  3. Jorda P, David C, Yolanda B, Jordi T, Eduard A, Malgorzata S (2010) Performance-Driven task co-scheduling for MapReduce environments. In: IEEE network operations and management symposium (NOMS), pp 373–380

    Google Scholar 

  4. Matei Z, Dhruba B, Joydeep SS, Khaled E, Scott S, Ion S (2010) Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In: Proceedings of the 5th European conference on computer systems (EuroSys’ 10), New York, pp 265–278

    Google Scholar 

  5. GPGPU http://en.wikipedia.org/wiki/GPGPU

  6. Cayrel PL, Gerhard H, Michael S (2011) GPU implementation of the Keccak Hash function family. IJSA 5:123–132

    Google Scholar 

  7. He B, Fang W, Govindaraiu N, Luo Q, Yang T (2008) Mars: a MapReduce framework on graphics processors. In: PACT ’08: Proceedings of the 17th international conference on Parallel architectures and compilation techniques, New York, pp 260–269

    Google Scholar 

  8. Mooley A, Murthy K, Singh H (2008) DisMaRC: A distributed map reduce framework on CUDA.TechRep, The University of Texas, Austin, pp 65–66

    Google Scholar 

Download references

Acknowledgments

This research was supported by a grant from the Academic Research Program of Chungju National University in 2010. And this research was partially supported by Technology Development Program for ‘Bio-Industry Technology Development’, Ministry for Food, Agriculture, Forestry and Fisheries, Republic of Korea.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Korea National University of Transportation, ChungJu-Si, 380-702, Chungbuk-Do, South Korea

    Bongen Gu, Dojin Choi & Yoonsik Kwak

Authors
  1. Bongen Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dojin Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoonsik Kwak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yoonsik Kwak .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Seoul University of Science & and Technology (SeoulTech), Seoul, Korea, Republic of (South Korea)

    James J. (Jong Hyuk) Park

  2. Dept of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong SAR

    Joseph Kee-Yin Ng

  3. Humanitas College, Kyung Hee University, Seoul, Korea, Republic of (South Korea)

    Hwa-Young Jeong

  4. School of Computer Science and Software Engineering, Monash University, Clayton, Victoria, Australia

    Borgy Waluyo

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht(Outside the USA)

About this paper

Cite this paper

Gu, B., Choi, D., Kwak, Y. (2013). Potentiality for Executing Hadoop Map Tasks on GPGPU via JNI. In: Park, J., Ng, JY., Jeong, HY., Waluyo, B. (eds) Multimedia and Ubiquitous Engineering. Lecture Notes in Electrical Engineering, vol 240. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-6738-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-94-007-6738-6_7

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-007-6737-9

  • Online ISBN: 978-94-007-6738-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation