skip to main content
10.1145/3378936.3378978acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicsimConference Proceedingsconference-collections
research-article

Massively Scalable Image Processing on the HPCC Systems Big Data Platform

Published: 07 March 2020 Publication History

Abstract

Today's fast-moving world sees an abundance of image data in everyday life. From messages to insurance claims to even judicial systems, image data plays a pivotal role in facilitating several critical Big Data applications. Some of these applications such as automatic license plate recognition (ALPR) use CCTV cameras to capture snapshots of traffic from real-time video, inadvertently resulting in the generation vast amounts of image data on a daily basis. This brings with it the herculean task of processing these images to extract the essential information as efficiently as possible. The conventional method of processing images in a sequential manner can be very time consuming on account of the vast multitude of images and the intensive computation involved in order to process these. Distributed image processing seeks to provide a solution to this problem by splitting the computations involved across multiple nodes. This paper presents a novel framework to implement distributed image processing via OpenCV on HPCC Systems distributed node architecture*, a set of high-performance computing clusters. The proposed approach when tested on the Indian License Plates Dataset was found to be 85 percent accurate. Additionally, a 30 percent decrease in computation time was observed when executed on a multi-node setup without any impact to accuracy.

References

[1]
A. M. Middleton and A. Chala (Lexis Nexis Risk Solutions) "HPCC Systems®: Introduction to HPCC (High-Performance Computing Cluster)", May 2011.
[2]
A. Sozykin and T. Epanchintsev "MIPr -- a Framework for Distributed ImageProcessing Using Hadoop", 9th International Conference on Application of Information and Communication Technologies (AICT) (October 2015)
[3]
Iqbal, M Soomro, Tariq "Big Data Analysis: Apache Storm Perspective" International Journal of Computer Trends and Technology(January 2015).
[4]
D.Hwang, Y.Kim and C.Jeong Department of Electrical Engineering, Korea University, Seoul, Republic of Korea, "Real time Perdestrian Detection Using Apache Storm in a Distributed Environment" (December 2015)
[5]
J Fung, Steve Mann "Using Graphics Devices in Reverse: GPU Bases Image Processing and Computer Vision" IEEE International Conference June 2008
[6]
D.M. Beazley, B. D. Ward, and I R. Cooke,"The inside story on Shared Libraries and Dynamic Loading"
[7]
Mark S. Nixon and Alberto S. Aguado. "Feature Extraction and Image Processing". Academic Press, 2008, p. 88.
[8]
Sharma, Gajendra.(2018). "Performance Analysis of Vehicle Number Plate Recognition System Using Template Matching Techniques" Journal of Information Technology & Software Engineering. 08. 10.4172/2165--7866.1000232. (January 2018)
[9]
Choubey Siddhartha, Sinha G.R., Patel Bagwati Charan, Choubey Abha and Thakur Kavita, "Avoidance of confusion between Similar looking Characters in Neuro-fuzzy based License Plate Recognition," International Journal of Machine Learning and Computing vol. 1, no. 4, pp.394--399, 2011.
[10]
Dey, Nilanjan & Dutta, Saurab & Dey, Goutami & Chakraborty, Sayan & Ray, Ruben & Roy, Payel. "Adaptive thresholding: A compara-tive study". 2014 International Conference on Control, Instrumenta-tion, Communication and Computational Technologies, ICCICCT (July 2014). 10.1109/ICCICCT.2014.6993140. (2014)
[11]
E. S. Gedraite and M. Hadad, "Investigation on the effect of a gaussian blur in image filtering and segmentation," ELMAR Proceedings, 2011.
[12]
Seo, Jonghoon & Chae, Seungho & Shim, Jinwook & Kim, Dongchul & Cheong, Cheolho & Han, Tack-Don. "Fast Contour-Tracing Al-gorithm Based on a Pixel-Following Method for Image Sensors". Sen-sors. 16. 353. 10.3390/s16030353.(May 2016)
[13]
Zidek, Kamil & Hošovský, Alexander. "Image thresholding and contour detection with dynamic background selection for inspection tasks in machine vision." International Journal of Circuits, Systems and Signal Processing. 8. 545--554.(2014)
[14]
J. Canny, "A Computational Approach to Edge Detection" IEEE Trans-actions on Pattern Analysis and Machine Intelligence, VOL. PAMI-8, NO. 6, Nov 1986
[15]
Issam Bouganssa, Mohamed Sbihi, and Mounia Zaim, "Laplace Edge Detection Algorithm for Road Signal Images and FPGA Implementation," International Journal of Machine Learning and Computing vol. 9, no. 1, pp. 57--61, 2019.

Cited By

View all
  • (2024)Scalable Analysis of English Dictionary Files on HPCC Systems Big Data Platform2024 9th International Conference on Big Data Analytics (ICBDA)10.1109/ICBDA61153.2024.10607199(328-333)Online publication date: 16-Mar-2024
  • (2023)A generic parallel optimization framework for solving hard problems in optical networksComputer Communications10.1016/j.comcom.2022.12.023199(177-185)Online publication date: Feb-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICSIM '20: Proceedings of the 3rd International Conference on Software Engineering and Information Management
January 2020
258 pages
ISBN:9781450376907
DOI:10.1145/3378936
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • University of Science and Technology of China: University of Science and Technology of China

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Automatic License Plate Recognition
  2. Big Data
  3. Distributed Computing
  4. HPCC Systems
  5. Image Processing
  6. Machine Learning
  7. OpenCV

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICSIM '20

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 22 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Scalable Analysis of English Dictionary Files on HPCC Systems Big Data Platform2024 9th International Conference on Big Data Analytics (ICBDA)10.1109/ICBDA61153.2024.10607199(328-333)Online publication date: 16-Mar-2024
  • (2023)A generic parallel optimization framework for solving hard problems in optical networksComputer Communications10.1016/j.comcom.2022.12.023199(177-185)Online publication date: Feb-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media