Attention-Based Multiscale Spatial-Temporal Convolutional Network for Motor Imagery EEG Decoding | IEEE Journals & Magazine | IEEE Xplore

Attention-Based Multiscale Spatial-Temporal Convolutional Network for Motor Imagery EEG Decoding


Abstract:

Motor imagery (MI) electroencephalography (EEG) has been used in consumer products supported by brain-computer interfaces (BCI), with existing electronics covering a wide...Show More

Abstract:

Motor imagery (MI) electroencephalography (EEG) has been used in consumer products supported by brain-computer interfaces (BCI), with existing electronics covering a wide range of domains from artificial intelligence (AI) to the Internet of Things (IoT). However, the limitation in decoding MI-EEG signals has restricted the further development of the related Consumer Electronics (CE) industry. To address this problem, this paper proposes an attention-based multiscale spatial-temporal convolutional network (AMSTCNet). First, a multi-branch structure is designed to extract high-dimensional spatial-temporal representations at different scales. Second, Squeeze-Excite-Compress (SEC) blocks are proposed to highlight feature responses within a single scale and weighted to fuse these features to reduce information redundancy. Finally, the attention-based temporal convolutional network is used to obtain deep temporal information of the signal to dynamically fuse features at different scales. In addition, the AMSTCNet model is an end-to-end decoder using raw EEG signals as input. We evaluated the decoding performance of the AMSTCNet model using the BCI IV 2a dataset and the High Gamma dataset, and achieved recognition accuracies of 87.55% and 96.35%, respectively. Compared with existing methods, our method achieves satisfactory decoding performance and can greatly facilitate the application of BCI technology in CE.
Published in: IEEE Transactions on Consumer Electronics ( Volume: 70, Issue: 1, February 2024)
Page(s): 2423 - 2434
Date of Publication: 07 November 2023

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.