Skip to main content

A Federated Learning Approach for Text Classification Using NLP

  • Conference paper
  • First Online:
Image and Video Technology (PSIVT 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13763))

Included in the following conference series:

  • 394 Accesses

Abstract

Text classification is important in many aspects of natural language processing (NLP), such as word semantic categorization, emotion analysis, question answering, and conversation management. Law, health, and marketing are just a few of the professions that have made use of it throughout the last century. We focused on emotion analysis in this research, which includes categories like happiness, sadness, and more. We investigated the precision of three alternative models for assessing the emotional tone of written text. Deep learning models like GRU (Gated Recurrent Unit) and CNN (Convolutional Neural Network) are used in conjunction with the Bi-LSTM (Bidirectional LSTM) model. These three major deep learning architectures have been extensively studied for classification applications. Finally, the model with the greatest accuracy on the dataset was trained using federated learning (FL). Using the FL approach, more data has to be collected, eliminating data gaps and ensuring data security. The focus of this research is to increase the model’s accuracy by collaborating with FL approaches while maintaining data confidentiality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Muthukumar, N.: Few-shot learning text classification in federated environments. In: 2021 Smart Technologies, Communication and Robotics (STCR), pp. 1–3 (2021). https://doi.org/10.1109/STCR51658.2021.9588833

  2. Liu, D., Miller, T.: Federated pretraining and fine tuning of BERT using clinical notes from multiple silos (2020). https://arxiv.org/abs/2002.08562

  3. Leroy, D., Coucke, A., Lavril, T., Gisselbrecht, T., Dureau, J.: Federated learning for keyword spotting (2018). https://arxiv.org/abs/1810.05512

  4. Basaldella, M., Antolli, E., Serra, G., Tasso, C.: Bidirectional LSTM recurrent neural network for keyphrase extraction. In: Serra, G., Tasso, C. (eds.) IRCDL 2018. CCIS, vol. 806, pp. 180–187. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73165-0_18

    Chapter  Google Scholar 

  5. Ge, S., Wu, F., Wu, C., Qi, T., Huang, Y., Xie, X.: FedNER: privacy-preserving medical named entity recognition with federated learning (2020). https://arxiv.org/abs/2003.09288

  6. Emotions in text. https://www.kaggle.com/datasets/ishantjuyal/emotions-in-text

  7. Zulqarnain, M., Ghazali, R., Ghouse, M.G., Mushtaq, M.F.: Efficient processing of GRU based on word embedding for text classification. JOIV: Int. J. Inform. Vis. 3(4), 377–383 (2019)

    Article  Google Scholar 

  8. Hasib, K.M., Towhid, N.A., Alam, M.G.R.: Online review based sentiment classification on Bangladesh airline service using supervised learning. In: 2021 5th International Conference on Electrical Engineering and Information Communication Technology (ICEEICT) (2021). https://doi.org/10.1109/iceeict53905.2021.9667818

  9. Xu, G., Meng, Y., Qiu, X., Yu, Z., Wu, X.: Sentiment analysis of comment texts based on BiLSTM. IEEE Access 7, 51522–51532 (2019)

    Article  Google Scholar 

  10. Adib, Q.A.R., Mehedi, M.H.K., Sakib, M.S., Patwary, K.K., Hossain, M.S., Rasel, A.A.: A deep hybrid learning approach to detect Bangla fake news. In: 2021 5th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), pp. 442–447 (2021). https://doi.org/10.1109/ISMSIT52890.2021.9604712

  11. Bhagat, C., Mane, D.: Survey on text categorization using sentiment analysis. J. Sci. Technol. Res. 8, 1189–1195 (2019)

    Google Scholar 

  12. Beutel, D.J., et al.: Flower: a friendly federated learning research framework (2020). https://arxiv.org/abs/2007.14390

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mynul Islam .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Islam, M., Iqbal, S., Rahman, S., Sur, S.I.K., Mehedi, M.H.K., Rasel, A.A. (2023). A Federated Learning Approach for Text Classification Using NLP. In: Wang, H., et al. Image and Video Technology. PSIVT 2022. Lecture Notes in Computer Science, vol 13763. Springer, Cham. https://doi.org/10.1007/978-3-031-26431-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-26431-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-26430-6

  • Online ISBN: 978-3-031-26431-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics