Skip to main content
SpringerLink
Log in

Recognition of driving postures by combined features and random subspace ensemble of multilayer perceptron classifiers

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

An Erratum to this article was published on 25 August 2012

Abstract

Human-centric driver assistance systems with integrated sensing, processing and networking aim to find solutions for traffic accidents and other relevant issues. The key technology for developing such a system is the capability of automatically understanding and characterizing driver behaviors. This paper proposes a novel driving posture recognition approach, which consists of an efficient combined feature extraction and a random subspace ensemble of multilayer perceptron classifiers. A Southeast University Driving Posture Database (SEU-DP Database) has been created for training and testing the proposed approach. The data set contains driver images of (1) grasping the steering wheel, (2) operating the shift lever, (3) eating a cake and (4) talking on a cellular phone. Combining spatial scale features and histogram-based features, holdout and cross-validation experiments on driving posture classification are conducted, comparatively. The experimental results indicate that the proposed combined feature extraction approach with random subspace ensemble of multilayer perceptron classifiers outperforms the two individual feature extraction approaches. The experiments also suggest that talking on a cellular phone is the most difficult posture in classification among the four predefined postures. Using the proposed approach, the classification accuracy on talking on a cellular phone is over 89 % in both holdout and cross-validation experiments. These results show the effectiveness of the proposed combined feature extraction approach and random subspace ensemble of multilayer perceptron classifiers in automatically understanding and characterizing driver behaviors toward human-centric driver assistance systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Nadeau CL, Maag U, Bellavance F et al (2003) Wireless telephones and the risk of road crashes. Accid Anal Prev 35:649–660

    Article  Google Scholar 

  2. Oliver N, Pentland AP (2002) Graphical models for driver behavior recognition in a smartcar. In: IEEE intelligent vehicles symposium, pp 7–12

  3. Liu XY, Zhu D, Fujimura K (2003) Real-time pose classification for driver monitoring. In: IEEE intelligent transportation systems, pp 174–178

  4. Eren H, Celik U, Poyraz M (2007) Stereo vision and statistical based behavior prediction of driver. In: IEEE intelligent vehicles symposium, pp 657–662

  5. Sekizawa S, Inagaki S, Suzuki T et al (2007) Modeling and recognition of driving behavior based on stochastic switched ARX model. IEEE Trans Intell Transp Syst 8(4):593–606

    Article  Google Scholar 

  6. Watta P, Lakshmanan S, Hou YL (2007) Nonparametric approaches for estimating driver pose. IEEE Trans Veh Technol 56(4):2028–2041

    Article  Google Scholar 

  7. Kato T, Fujii T, Tanimoto M (2004) Detection of driver’s posture in the car by using far infrared camera. In: IEEE intelligent vehicles symposium, pp 339–344

  8. Cheng SY, Park S, Trivedi MM (2007) Multi-spectral and multi-perspective video arrays for driver body tracking and activity analysis. Comput Vis Image Underst 106(2–3):245–257

    Article  Google Scholar 

  9. Demirdjian D, Varri C (2009) Driver poses estimation with 3D time-of-flight sensor. In: IEEE CIVVS, pp 16–22

  10. Cheng SY, Trivedi MM (2006) Turn-intent analysis using body pose for intelligent driver assistance. IEEE Perv Comput 5(4):28–37

    Article  Google Scholar 

  11. Yang CM, Wu CC, Chou CM et al (2009) Vehicle driver’s ECG and sitting posture monitoring system. In: 9th conference on information technology and application in biotechnology, pp 1–4

  12. Cheng SY, Trivedi MM (2010) Vision-based infotainment user determination by hand recognition for driver assistance. IEEE Trans Intell Transp Syst 11(3):759–764

    Article  Google Scholar 

  13. Yoon HS, Soh J, Bae YJ et al (2001) Hand gesture recognition using combined features of location, angle and velocity. Pattern Recogn 34(7):1491–1501

    Article  MATH  Google Scholar 

  14. Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324

    Article  Google Scholar 

  15. Han J, Awad G, Sutherland A (2009) Automatic skin segmentation and tracking in sign language recognition. IET Comput Vis 3(1):24–35

    Article  Google Scholar 

  16. Suk HI, Sin BK, Lee SW (2010) Hand gesture recognition based on dynamic Bayesian network framework. Pattern Recogn 43(9):3059–3072

    Article  MATH  Google Scholar 

  17. Huang DY, Hu WC, Chang SH (2011) Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination. Expert Syst Appl 38(5):6031–6042

    Article  Google Scholar 

  18. Harini V, Stefan A, Nathaniel B, et al (2005) Driver activity monitoring through supervised and unsupervised learning. In: IEEE conference on intelligent transportation systems, pp 895–900

  19. Veeraraghavan H, Bird N, Atev S et al (2007) Classifiers for driver activity monitoring. Transp Res Part C 15(1):51–67

    Article  Google Scholar 

  20. Heusch G, Cardinaux F, Marcel S (2005) Lighting normalization algorithms for face verification. Tech Rep IDIAP, pp 7–8

  21. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, San Diego, CA, pp 886–893

  22. Zhang BL (2010) Off-line signature verification and identification by pyramid histogram of oriented gradients. Int J Intell Comput Cybern 3(4):611–630

    Article  MathSciNet  Google Scholar 

  23. Heath M, Sarkar S, Sanocki T et al (1998) Comparison of edge detectors: a methodology and initial study. Comput Vis Image Underst 69(1):38–54

    Article  Google Scholar 

  24. Hansen L, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12:993–1001

    Article  Google Scholar 

  25. Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New Jersey

    Book  MATH  Google Scholar 

  26. Breiman L (1996) Bagging predictors. Mach Learn 24:123–140

    MathSciNet  MATH  Google Scholar 

  27. Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119–139

    Article  MathSciNet  MATH  Google Scholar 

  28. Boland MV, Murphy RF (2001) A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics 17:1213–1223

    Article  Google Scholar 

  29. Boland MV, Markey M, Murphy RF (1998) Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. Cytometry 33:366–375

    Article  Google Scholar 

  30. Huang K, Murphy RF (2004) Boosting accuracy of automated classification of fluorescence microscope images for location proteomics. BMC Bioinformatics 5:78

    Article  Google Scholar 

  31. Haykin S (2000) An introduction to neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle River

    Google Scholar 

  32. Skurichina M, Robert P, Duin W (2002) Bagging, boosting and the random subspace method for linear classifiers. Pattern Anal Appl 5:121–135

    Article  MATH  Google Scholar 

  33. Ho TK (1998) The random subspace method for constructing decision forest. IEEE Trans Pattern Anal Mach Intell 20:832–844

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Transportation, Southeast University, Nanjing, 210096, People’s Republic of China

    Chihang H. Zhao

  2. Department of Computer Science and Software Engineering, Xi’an Jiaotong-Liverpool University, Suzhou, 215123, People’s Republic of China

    Bailing L. Zhang

  3. Queensland Research Laboratory, National ICT Australia, Brisbane, QLD, 4111, Australia

    Xiaozheng Z. Zhang, Sanqiang Q. Zhao & Hanxi X. Li

Authors
  1. Chihang H. Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bailing L. Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaozheng Z. Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sanqiang Q. Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hanxi X. Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chihang H. Zhao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhao, C.H., Zhang, B.L., Zhang, X.Z. et al. Recognition of driving postures by combined features and random subspace ensemble of multilayer perceptron classifiers. Neural Comput & Applic 22 (Suppl 1), 175–184 (2013). https://doi.org/10.1007/s00521-012-1057-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-012-1057-4

Keywords

Search

Navigation