Skip to main content
Springer Nature Link
Log in

Folded ensemble deep learning based text generation on the brain signal

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The text generation technique employs the transformation of the word document from the source to the targeted document based on the sequence to sequence generation. Video captioning, language identification, image captioning, recognition of speech, machine translation, and several other natural language generations are the application areas of the text generation techniques. The Electroencephalographic (EEG) signals record brain activity and are considered the source of information for using the brain-computer interface. Several kinds of research were developed for text generation. The most challenging task is more accurate text generation by considering the large contextual information and the significant features for generating the text. Hence, in this research, text generation using Folded deep learning is proposed for generating the text through text prediction and suggestion through the non-invasive technique. The EEG signal recorded from the patients is utilized for the prediction of the first letter using the proposed Folded Ensemble Deep convolutional neural network (DeepCNN), in which the hybrid ensemble activation function along with the folded concept in validating the training data to obtain the network stability and to solve the class imbalance issue. Then, the next letter suggestion is employed using the proposed Folded Ensemble Bidirectional long short-term memory (BiLSTM) approach based on the eye-blink criteria for generating the sequence-to-sequence text generation. The enhanced performance is evaluated using accuracy, precision, and recall and acquired the maximal values of 97.22%, 98.00%, and 98.00%, respectively. The proposed method can be utilized for real-time processing applications due to its non-invasive nature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

Not Applicable.

References

  1. Saha S, Mamun KA, Ahmed K, Mostafa R, Naik GR, Khandoker A, Darvishi S, and Baumert M (2019) Progress in brain computer interfaces: challenges and trends. arXiv preprint arXiv:1901.03442.

  2. Padfield N, Zabalza J, Zhao H, Masero V, Ren J (2019) EEG-based brain-computer interfaces using motor-imagery: Techniques and challenges. Sensors 19(6):1423

    Article  Google Scholar 

  3. Lin CT, Huang CS, Yang WY, Singh AK, Chuang CH, and Wang YK (2018) Real-time EEG signal enhancement using canonical correlation analysis and gaussian mixture clustering. J Healthc Eng 2018:1–12

  4. Reyes AF, Camacho EC, Armando M, and Calderón JM (2021) LSTM based brain-machine interface tool for text generation through eyes blinking detection. In 2021 IEEE 18th Annual Consumer Communications & Networking Conference (CCNC) (pp 1–6). IEEE

  5. Islam MS, Mousumi SSS, Abujar S, Hossain SA (2019) Sequence-to-sequence Bangla sentence generation with LSTM recurrent neural networks. Procedia Comput Sci 152:51–58

    Article  Google Scholar 

  6. Burgos NA, Kiš K, Bakarac P, Kvasnica M, and Licitra G (2022) Exploring a Bilingual Next Word Predictor for a Federated Learning Mobile Application (pp 1–11)

  7. Sirriani J, Sezgin E, Claman D, and Linwood SL (2022) Medical text prediction and suggestion using generative pre-trained transformer models with dental medical notes. medRxiv (pp 1–10)

  8. Keneshloo Y, Shi T, Ramakrishnan N, Reddy CK (2019) Deep reinforcement learning for sequence-to-sequence models. IEEE Trans Neural Net Learn Syst 31(7):2469–2489

    Google Scholar 

  9. Li Y, Wang S, and Nguyen T (2021) A Context-based Automated Approach for Method Name Consistency Checking and Suggestion. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) (pp 574–586). IEEE

  10. Deng X, Zhang B, Yu N, Liu K, Sun K (2021) Advanced TSGL-EEGNet for motor imagery EEG-based brain-computer interfaces. IEEE Access 9:25118–25130

    Article  Google Scholar 

  11. Zhu Y, Li Y, Lu J, Li P (2021) EEGNet with Ensemble learning to improve the cross-session classification of SSVEP based BCI from Ear-EEG. IEEE Access 9:15295–15303

    Article  Google Scholar 

  12. Huang W, Xue Y, Hu L, Liuli H (2020) S-EEGNet: electroencephalogram signal classification based on a separable convolution neural network with bilinear interpolation. IEEE Access 8:131636–131646

    Article  Google Scholar 

  13. The KARA ONE Database: Phonological Categories in imagined and articulated speech, http://www.cs.toronto.edu/~complingweb/data/karaOne/karaOne.html. Accessed Jul 2022

  14. Shakshi RJ (2016) Brain wave classification and feature extraction of EEG signal by using FFT on lab view. Int Res J Eng Technol 3:1208–1212

    Google Scholar 

  15. Li C, Zhou W, Liu G, Zhang Y, Geng M, Liu Z, Wang S, Shang W (2021) Seizure onset detection using empirical mode decomposition and common spatial pattern. IEEE Trans Neural Syst Rehabil Eng 29:458–467

    Article  Google Scholar 

  16. Aydemir E, Tuncer T, Dogan S (2020) A Tunable-Q wavelet transform and quadruple symmetric pattern based EEG signal classification method. Med Hypotheses 134:109519

    Article  Google Scholar 

  17. Albaqami H, Hassan GM, Subasi A, Datta A (2021) Automatic detection of abnormal EEG signals using wavelet feature extraction and gradient boosting decision tree. Biomed Signal Process Control 70:102957

    Article  Google Scholar 

  18. Gao Y, Gao B, Chen Q, Liu J, Zhang Y (2020) Deep convolutional neural network-based epileptic electroencephalogram (EEG) signal classification. Front Neurol 11:375

    Article  Google Scholar 

  19. Rhanoui M, Mikram M, Yousfi S, Barzali S (2019) A CNN-BiLSTM model for document-level sentiment analysis. Mach Learn Knowl Extraction 1(3):832–847

    Article  Google Scholar 

  20. Shah K, Patel H, Sanghvi D, Shah M (2020) A comparative analysis of logistic regression, random forest and KNN models for the text classification. Augmented Human Res 5(1):1–16

    Article  Google Scholar 

  21. Mesleh A (2008) Support vector machines based Arabic language text classification system: feature selection comparative study. In Advances in Computer and Information Sciences and Engineering (pp. 11–16). Springer, Dordrecht.

Download references

Funding

This research did not receive any specific funding.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Shri Ramdeobaba College of Engineering and Management, Gittikhadan, Nagpur, Maharashtra, 440013, India

    Vasundhara S. Rathod

  2. Department of Computer Science and Engineering, Visvesvaraya National Institute of Technology, Ambazari, Nagpur, Maharashtra, 440010, India

    Ashish Tiwari

  3. Indian Institute of Information Technology Nagpur, Waranga, Nagpur, Maharashtra, 441108, India

    Omprakash G. Kakde

Authors
  1. Vasundhara S. Rathod
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashish Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Omprakash G. Kakde
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vasundhara S. Rathod.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rathod, V.S., Tiwari, A. & Kakde, O.G. Folded ensemble deep learning based text generation on the brain signal. Multimed Tools Appl 83, 69019–69047 (2024). https://doi.org/10.1007/s11042-024-18124-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18124-z

Keywords