Skip to main content
SpringerLink
Log in
Book cover

International Conference on Engineering Applications of Neural Networks

EANN 2021: Proceedings of the 22nd Engineering Applications of Neural Networks Conference pp 213–219Cite as

fNIRS–Based BCI Using Deep Neural Network with an Application to Deduce the Driving Mode Based on the Driver’s Mental State

  • Conference paper
  • First Online:

  • 792 Accesses

Part of the book series: Proceedings of the International Neural Networks Society ((INNS,volume 3))

Abstract

Despite the recent advances in the development of autonomous vehicles, it is still important to be able to ascertain if a driver is fit to drive at any given time in case the auto–pilot mode fails. This study evaluates a method for deducing the current driving mode of the vehicle (manual driving versus auto–pilot mode) from the recognised mental state of the driver using a brain–computer interface (BCI) that comprises a functional near–infrared spectroscopy (fNIRS)–based device for measuring the activity in the prefrontal cortex of the driver’s brain and a deep neural network for classifying the fNIRS signals. With an average classification accuracy of over 70%, this study shows the potential of using the fNIRS–based BCI for monitoring the mental states of the driver.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. National Highway Traffic Safety Administration: Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey. US Department of Transportation, Washington DC (2015)

    Google Scholar 

  2. Claybrook, J., Kildare, S.: Autonomous vehicles: no driver...no regulation? Science 361(6397), 36–37 (2018)

    Article  Google Scholar 

  3. Hoedemaker, M., Brookhuis, K.A.: Behavioral adaptation to driving with and adaptive cruise control (ACC). Transp. Res. Part F 1, 95–106 (1998)

    Article  Google Scholar 

  4. Pan, Y., Borragán, G., Peigneux, P.: Applications of functional near-infrared spectroscopy in fatigue, sleep deprivation, and social cognition. Brain Topogr. 32, 998–1012 (2019)

    Article  Google Scholar 

  5. Unni, A., et al.: Brain activity measured with fNIRS for the prediction of cognitive workload. In: Proceedings of IEEE International Conference on Cognitive Infocommunications, pp. 349–354 (2015)

    Google Scholar 

  6. Khan, J., Hong, K.: Passive BCI based on drowsiness detection: an fNIRS study. Biomed. Opt. Express 6(10), 4063–4078 (2015)

    Article  Google Scholar 

  7. Liu, T., Pelowski, M., Pang, C., Zhou, Y., Cai, J.: Near-infrared spectroscopy as a tool for driving research. Ergonomics 59(3), 368–379 (2016)

    Article  Google Scholar 

  8. Foy, H.J., Runham, P., Chapman, P.: Prefrontal cortex activation and young driver behaviour: a fNIRS study. PLoS ONE 11(5), e0156512 (2016)

    Google Scholar 

  9. Sibi, S., Baiters, S., Mok, B., Steiner, M., Ju, W.: Assessing driver cortical activity under varying levels of automation with functional near infrared spectroscopy. In: Proceedings of IEEE Intelligent Vehicles Symposium, pp. 1509–1516 (2017)

    Google Scholar 

  10. Son, L.A., Aoki, H., Murase, F., Ishida, K.: A novel method for classifying driver mental workload under naturalistic conditions with information from near-infrared spectroscopy. Front. Hum. Neurosci. 12, 431 (2018). https://doi.org/10.3389/fnhum.2018.00431

  11. Yamamoto, K., Takahashi, H., Sugimachi, T., Nakano, K., Suda, Y.: The study of driver’s brain activity and behaviour on DS test using fNIRS. IFAC-PapersOnLine 51(34), 244–249 (2019)

    Article  Google Scholar 

  12. Zhu, L., et al.: Analysis of braking intention based on fNIRS in driving simulation experiments. IET Intell. Transp. Syst. 13(7), 1181–1189 (2019)

    Article  Google Scholar 

  13. http://neu-brains.site/brain-activity-measurement

  14. http://www.forum8.co.jp/english/uc-win/road-drive-e.htm

  15. Huve, G., Takahashi, K., Hashimoto, M.: fNIRS-based brain-computer interface using deep neural networks for classifying the mental state of drivers. In: Proceedings of the 27th International Conference on Artificial Neural Networks, pp. 353–362 (2018)

    Google Scholar 

  16. Combrisson, E., Jerbi, K.: Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy. J. Neurosci. Methods 250, 126–136 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Doshisha University, Kyoto, Japan

    Kazuhiko Takahashi, Reo Yokono & Masafumi Hashimoto

  2. Graduate School of Doshisha University, Kyoto, Japan

    Chang Chu & Gauvain Huve

Authors
  1. Kazuhiko Takahashi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Reo Yokono
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chang Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gauvain Huve
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Masafumi Hashimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kazuhiko Takahashi .

Editor information

Editors and Affiliations

  1. School of Engineering, Department of Civil Engineering, Democritus University of Thrace, Xanthi, Greece

    Lazaros Iliadis

  2. Faculty of Applied Sciences, University of Sunderland, Sunderland, UK

    John Macintyre

  3. School of Computing and Digital Technologies, Teesside University, Middlesbrough, UK

    Chrisina Jayne

  4. University of the West of England, Bristol, UK

    Elias Pimenidis

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Takahashi, K., Yokono, R., Chu, C., Huve, G., Hashimoto, M. (2021). fNIRS–Based BCI Using Deep Neural Network with an Application to Deduce the Driving Mode Based on the Driver’s Mental State. In: Iliadis, L., Macintyre, J., Jayne, C., Pimenidis, E. (eds) Proceedings of the 22nd Engineering Applications of Neural Networks Conference. EANN 2021. Proceedings of the International Neural Networks Society, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-030-80568-5_18

Download citation

Publish with us

Policies and ethics

Search

Navigation