Skip to main content

A Hybrid Brain-Computer Interface for Smart Car Control

  • Conference paper
  • First Online:
Human Brain and Artificial Intelligence (HBAI 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1692))

Included in the following conference series:

Abstract

Brain-computer interface (BCI) systems are often used to convert signals from brain activities into control commands through external devices. There are few studies on controlling a car by multimodality due to its difficulty in the current research. This paper proposes a hybrid BCI control system based on electroencephalography (EEG), electrooculography (EOG), and gyroscope signals to address this challenge. The user can control the start, stop, turn left, turn right, acceleration and deceleration of the smart car by this system. The user controls the start and stop by double blinking, acceleration and deceleration by concentrating and distracting, turning left and right by the head rotation. To evaluate the performance of this BCI system, we invited twelve subjects to conduct two online experiments to control the car on a runway to test the above functions. The experimental results showed that the hybrid BCI system achieved an average accuracy of 97.65%, an average information translate rate (ITR) of 43.50 bit/min, and an average false positive rate (FPR) of 0.70 event/min, thus demonstrating the effectiveness of our proposed system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, Z., Zhang, S., Pan, J.: Advances in hybrid brain-computer interfaces: Principles, design, and applications. Computational Intelligence and Neuroscience 2019, 1–9 (2019). https://doi.org/10.1155/2019/3807670

    Article  Google Scholar 

  2. Wang, F., Li, X., Pan, J.: A human-machine interface based on an EOG and a gyroscope for humanoid robot control and its application to home services. Journal of Healthcare Engineering 2022, 1–14 (2022). https://doi.org/10.1155/2022/1650387

    Article  Google Scholar 

  3. Cai, X., Pan, J.: Toward a brain-computer interface- and internet of things-based smart ward collaborative system using hybrid signals. Journal of Healthcare Engineering 2022, 1–13 (2022). https://doi.org/10.1155/2022/6894392

    Article  Google Scholar 

  4. Pfurtscheller, G., da Silva, F.L.: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology 110(11), 1842–1857 (1999). https://doi.org/10.1016/s1388-2457(99)00141-8

    Article  Google Scholar 

  5. Farwell, L., Donchin, E.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology 70(6), 510–523 (1988). https://doi.org/10.1016/0013-4694(88)90149-6

    Article  Google Scholar 

  6. Zhang, Y., Zhou, G., Jin, J., Wang, X., Cichocki, A.: Frequency recog- nition in SSVEP-based BCI using multiset canonical correlation analysis. International Journal of Neural Systems 24(04), 1450013 (2014). https://doi.org/10.1142/s0129065714500130

    Article  Google Scholar 

  7. Guo, F., Hong, B., Gao, X., Gao, S.: A brain–computer interface using motion-onset visual evoked potential. Journal of Neural Engineering 5(4), 477–485 (2008). https://doi.org/10.1088/1741-2560/5/4/011

    Article  Google Scholar 

  8. Li, Y., Pan, J., Wang, F., Yu, Z.: A hybrid BCI system combining p300 and SSVEP and its application to wheelchair control. IEEE Transactions on Biomedical Engineering 60(11), 3156–3166 (2013). https://doi.org/10.1109/tbme.2013.2270283

    Article  Google Scholar 

  9. Ma, T., Li, H., Deng, L., Yang, H., Lv, X., Li, P., Li, F., Zhang, R., Liu, T., Yao, D., Xu, P.: The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential. Journal of Neural Engineering 14(2), 026015 (2017). https://doi.org/10.1088/1741-2552/aa5d5f

    Article  Google Scholar 

  10. Long, S., Zhou, Z., Yu, Y., Liu, Y., Zhang, N.: Research on vehicle control technology of brain-computer interface based on SSVEP. In: Su, R. (ed.) 2019 International Conference on Image and Video Processing, and Artificial Intelligence. SPIE (nov 2019). DOI: 10.1117/12.2549159

    Google Scholar 

  11. Wang, H., Li, T., Bezerianos, A., Huang, H., He, Y., Chen, P.: The control of a virtual automatic car based on multiple patterns of motor imagery BCI. Medical & Biological Engineering & Computing 57(1), 299–309 (2018). https://doi.org/10.1007/s11517-018-1883-3

    Article  Google Scholar 

  12. Huang, Q., He, S., Wang, Q., Gu, Z., Peng, N., Li, K., Zhang, Y., Shao, M., Li, Y.: An EOG-based human–machine interface for wheelchair control. IEEE Transactions on Biomedical Engineering 65(9), 2023–2032 (2018). https://doi.org/10.1109/tbme.2017.2732479

    Article  Google Scholar 

  13. Olesen, S.D.T., Das, R., Olsson, M.D., Khan, M.A., Puthusserypady, S.: Hybrid EEG-EOG-based BCI system for vehicle control. In: 2021 9th International Winter Conference on Brain-Computer Interface (BCI). IEEE (feb 2021). DOI: 10.1109/bci51272.2021.9385300

    Google Scholar 

  14. Milanizadeh, S., Safaie, J.: EOG-based HCI system for quadcopter navigation. IEEE Transactions on Instrumentation and Measurement 69(11), 8992–8999 (2020). https://doi.org/10.1109/tim.2020.3001411

    Article  Google Scholar 

  15. Liu, N.H., Chiang, C.Y., Chu, H.C.: Recognizing the degree of human attention using EEG signals from mobile sensors. Sensors 13(8), 10273–10286 (2013). https://doi.org/10.3390/s130810273

    Article  Google Scholar 

  16. Ma, J., Zhang, Y., Cichocki, A., Matsuno, F.: A novel EOG/EEG hybrid human-machine interface adopting eye movements and ERPs: Application to robot control. IEEE Transactions on Biomedical Engineering 62(3), 876–889 (2015). https://doi.org/10.1109/tbme.2014.2369483

    Article  Google Scholar 

  17. Liu, C., Xie, S., Xie, X., Duan, X., Wang, W., Obermayer, K.: Design of a video feedback SSVEP-BCI system for car control based on improved MUSIC method. In: 2018 6th International Conference on Brain-Computer Interface (BCI). IEEE (jan 2018). DOI: 10.1109/iww-bci.2018.8311499

    Google Scholar 

  18. Zhou, Z., Gong, A., Qian, Q., Su, L., Zhao, L., Fu, Y.: A novel strategy for driving car brain–computer interfaces: Discrimination of EEG-based visual-motor imagery. Translational Neuroscience 12(1), 482–493 (2021). https://doi.org/10.1515/tnsci-2020-0199

    Article  Google Scholar 

  19. Farmaki, C., Krana, M., Pediaditis, M., Spanakis, E., Sakkalis, V.: Single-channel SSVEP-based BCI for robotic car navigation in real world conditions. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE). IEEE (oct 2019). DOI: 10.1109/bibe.2019.00120

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chao Qu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ban, N., Qu, C., Feng, D., Pan, J. (2023). A Hybrid Brain-Computer Interface for Smart Car Control. In: Ying, X. (eds) Human Brain and Artificial Intelligence. HBAI 2022. Communications in Computer and Information Science, vol 1692. Springer, Singapore. https://doi.org/10.1007/978-981-19-8222-4_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-8222-4_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-8221-7

  • Online ISBN: 978-981-19-8222-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics