skip to main content
10.1145/3061639.3062308acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article

Real-Time Multi-Scale Pedestrian Detection for Driver Assistance Systems

Published: 18 June 2017 Publication History

Abstract

Pedestrian detection is one of the most challenging and vital tasks of driver assistance systems (DAS). Among several algorithms developed for human detection, histogram of oriented gradients (HOG) followed by support vector machine (SVM) has shown the most promising results. This paper presents a hardware accelerator for real-time pedestrian detection at different scales to fulfill the real-time requirements of DAS. It proposes an algorithmic modification to the conventional multi-scale object detection by means of HOG+SVM to increase the throughput and maintain the accuracy reasonably high. Our hardware accelerator detects pedestrians at the rate of 60 fps for HDTV (1080x1920) frame.

References

[1]
R. Benenson, M. Mathias, R. Timofte, and L. Van Gool. 2012. Pedestrian detection at 100 frames per second. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. 2903--2910.
[2]
Navneet Dalai. 2006. Finding People in Images and Videos. Ph.D. Dissertation. Grenoble Institute of Technology, France.
[3]
N. Dalai and B. Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 1. 886--893 vol. 1.
[4]
P. Dollar, R. Appel, S. Belongie, and P. Perona. 2014. Fast Feature Pyramids for Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 8 (Aug 2014), 1532--1545.
[5]
Piotr Dollar, Serge Belongie, and Pietro Perona. 2010. The Fastest Pedestrian Detector in the West. In Proceedings of the British Machine Vision Conference. BMVA Press, 68.1--68.11.
[6]
P. Dollar, C. Wojek, B. Schiele, and P. Perona. 2012. Pedestrian Detection: An Evaluation of the State of the Art. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 4 (April 2012), 743--761.
[7]
Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A Library for Large Linear Classification. J. Mach. Learn. Res. 9 (June 2008), 1871--1874.
[8]
Marc Green. 2000. "How Long Does It Take to Stop?" Methodological Analysis of Driver Perception-Brake Times. Transportation Human Factors 2, 3 (2000), 195--216.
[9]
M. Hahnle, F. Saxen, M. Hisung, U. Brunsmann, and K. Doll. 2013. FPGA-Based Real-Time Pedestrian Detection on High-Resolution Images. In 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops. 629--635.
[10]
M. Hemmati, M. Biglari-Abhari, S. Berber, and S. Niar. 2014. HOG Feature Extractor Hardware Accelerator for Real-Time Pedestrian Detection. In 2014 17th Euromicro Conference on Digital System Design. 543--550.
[11]
C. Kyrkou and T. Theocharides. 2012. A Parallel Hardware Architecture for Real-Time Object Detection with Support Vector Machines. IEEE Trans. Comput. 61, 6 (June 2012), 831--842.
[12]
S. Lee, H. Son, J. C. Choi, and K. Min. 2012. HOG feature extractor circuit for real-time human and vehicle detection. In TENCON 2012. 1--5.
[13]
Seung Eun Lee, Kyungwon Min, and Taeweon Suh. 2013. Accelerating Histograms of Oriented Gradients descriptor extraction for pedestrian recognition. Computers and Electrical Engineering 39, 4 (2013), 1043--1048.
[14]
G. Mishra, Y. L. Aung, M. Wu, S. K. Lam, and X Srikanthan. 2013. Real-Time Image Resizing Hardware Accelerator for Object Detection Algorithms. In 2013 International Symposium on Electronic System Design. 98--102.
[15]
K. Mizuno, Y. Terachi, K. Takagi, S. Izumi, H. Kawaguchi, and M. Yoshimoto. 2012. Architectural Study of HOG Feature Extraction Processor for Real-Time Object Detection. In 2012 IEEE Workshop on Signal Processing Systems. 197--202.
[16]
M. Pedersoli, J. Gonzalez, X. Hu, and X. Roca. 2014. Toward Real-Time Pedestrian Detection Based on a Deformable Template Model. IEEE Transactions on Intelligent Transportation Systems 15, 1 (Feb 2014), 355--364.
[17]
S. Sivaraman and M. M. Trivedi. 2013. Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis. IEEE Transactions on Intelligent Transportation Systems 14, 4 (2013), 1773--1795.
[18]
Vladimir Vapnik, Steven E. Golowich, and Alex Smola. 1996. Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing. In Advances in Neural Information Processing Systems 9. MIT Press, 281--287.
[19]
S. Wang, L. Duan, C. Zhang, L. Chen, G. Cheng, and J. Yu. 2016. Fast pedestrian detection based on object proposals and HOG. In 2016 International Joint Conference on Neural Networks (IJCNN). 3972--3977.

Cited By

View all
  • (2022)Adaptive Real-Time Object Detection for Autonomous Driving SystemsJournal of Imaging10.3390/jimaging80401068:4(106)Online publication date: 11-Apr-2022
  • (2020)A Multi-Task Hardwired Accelerator for Face Detection and AlignmentIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2019.295546330:11(4284-4298)Online publication date: Nov-2020
  • (2019)Adaptive Vehicle Detection for Real-time Autonomous Driving System2019 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE.2019.8714818(1034-1039)Online publication date: Mar-2019
  • Show More Cited By

Index Terms

  1. Real-Time Multi-Scale Pedestrian Detection for Driver Assistance Systems

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DAC '17: Proceedings of the 54th Annual Design Automation Conference 2017
    June 2017
    533 pages
    ISBN:9781450349277
    DOI:10.1145/3061639
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 June 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. FPGA
    2. HOG
    3. Pedestrian detection
    4. SVM
    5. hardware accelerator
    6. multi-scale
    7. real-time

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    DAC '17
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

    Upcoming Conference

    DAC '25
    62nd ACM/IEEE Design Automation Conference
    June 22 - 26, 2025
    San Francisco , CA , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Adaptive Real-Time Object Detection for Autonomous Driving SystemsJournal of Imaging10.3390/jimaging80401068:4(106)Online publication date: 11-Apr-2022
    • (2020)A Multi-Task Hardwired Accelerator for Face Detection and AlignmentIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2019.295546330:11(4284-4298)Online publication date: Nov-2020
    • (2019)Adaptive Vehicle Detection for Real-time Autonomous Driving System2019 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE.2019.8714818(1034-1039)Online publication date: Mar-2019
    • (2019)Vision Based Advanced Driver Assistance System Using Deep Learning2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT45670.2019.8944842(1-5)Online publication date: Jul-2019
    • (2019)Fast Multi-scale fHOG Feature Extraction Using Histogram DownsamplingRoboCup 2018: Robot World Cup XXII10.1007/978-3-030-27544-0_5(57-69)Online publication date: 4-Aug-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media