Skip to main content
SpringerLink
Log in

An End-to-End Deep Learning Based Gesture Recognizer for Vehicle Self Parking System

  • Conference paper
  • First Online:
Image Analysis and Recognition (ICIAR 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11663))

Included in the following conference series:

Abstract

Hand gesture recognition have become versatile in numerous applications. In particular, the automotive industry has benefited from their deployment, and human-machine interface designers are using them to improve driver safety and comfort. In this paper, we investigate expanding the product segment of one of America’s top three automakers through deep learning to provide an increased driver convenience and comfort with the application of dynamic hand gesture recognition for vehicle self parking. We adapt the architecture of the end-to-end solution to expand the state of the art video classifier from a single image as input (fed by monocular camera) to a multiview 360 feed, offered by a six cameras module. Finally, we optimize the proposed solution to work on a limited resource embedded platform that is used by automakers for vehicle-based features, without sacrificing the accuracy robustness and real time functionality of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.e-consystems.com/multiple-csi-cameras-for-nvidia-jetson-tx2.asp, accessed: 01/29/2019.

  2. 2.

    http://host.robots.ox.ac.uk/pascal/VOC/voc2007/, last accessed: 02/20/2019.

  3. 3.

    http://host.robots.ox.ac.uk/pascal/VOC/voc2012/, last accessed: 02/20/2019.

References

  1. Chen, X., Liu, X., Gales, M. J., Woodland, P. C.: Improving the training and evaluation efficiency of recurrent neural network language models. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5401–5405. IEEE (2015)

    Google Scholar 

  2. Donahue, J., et al.: Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2625–2634 (2015)

    Google Scholar 

  3. Gupta, O., Raviv, D., Raskar,R.: Deep video gesture recognition using illumination invariants. arXiv preprint arXiv:1603.06531 (2016)

  4. BMW Media Information. BMW at the consumer electronics show (ces) 2016 in las vegas. https://www.bimmerpost.com/goodiesforyou/autoshows/ces2016/bmw-ces-2016.pdf (2016)

  5. Global Market Insights. Automotive gesture recognition market to exceed 13 billions by 2024. https://www.gminsights.com/pressrelease/automotive-gesture-recognition-market (2019)

  6. Koesdwiady, A., Bedawi, S.M., Ou, C., Karray, F.: End-to-end deep learning for driver distraction recognition. In: Karray, F., Campilho, A., Cheriet, F. (eds.) ICIAR 2017. LNCS, vol. 10317, pp. 11–18. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59876-5_2

    Chapter  Google Scholar 

  7. Ohn-Bar, E., Trivedi, M.M.: Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations. IEEE Trans. Intell. Transp. Syst. 15(6), 2368–2377 (2014)

    Article  Google Scholar 

  8. Strezoski, G., Stojanovski, D., Dimitrovski, I., Madjarov, G.: Hand gesture recognition using deep convolutional neural networks. In: Stojanov, G., Kulakov, A. (eds.) International Conference on ICT Innovations. Advances in Intelligent Systems and Computing, pp. 49–58. Springer, Cham (2016)

    Google Scholar 

  9. TwentyBN. The 20bn-jester dataset v1. https://20bn.com/datasets/jester (2018)

  10. Di, W., et al.: Deep dynamic neural networks for multimodal gesture segmentation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 38(8), 1583–1597 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Centre for Pattern Analysis and Machine Intelligence (CPAMI), University of Waterloo, Waterloo, ON, Canada

    Hassene Ben Amara & Fakhri Karray

Authors
  1. Hassene Ben Amara
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fakhri Karray
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hassene Ben Amara .

Editor information

Editors and Affiliations

  1. University of Waterloo, Waterloo, ON, Canada

    Fakhri Karray

  2. University of Porto, Porto, Portugal

    Aurélio Campilho

  3. University of Waterloo, Waterloo, ON, Canada

    Alfred Yu

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Amara, H.B., Karray, F. (2019). An End-to-End Deep Learning Based Gesture Recognizer for Vehicle Self Parking System. In: Karray, F., Campilho, A., Yu, A. (eds) Image Analysis and Recognition. ICIAR 2019. Lecture Notes in Computer Science(), vol 11663. Springer, Cham. https://doi.org/10.1007/978-3-030-27272-2_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-27272-2_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-27271-5

  • Online ISBN: 978-3-030-27272-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation