Abstract
With the increasing amount of textual data generated online, an automatic system for text classification is imperative. However, classification models face the challenge of limited and imbalanced data, resulting in poor performance on minority classes. This paper presents a data augmentation technique for imbalanced text classification called Imbalanced Data Augmentation (IDA). The proposed technique consists of three main components: word selection, synonym substitution, and stop word insertion. We evaluate IDA’s performance using an imbalanced dataset of user-generated feedback on Algerian higher education sourced from tweets. Our proposed technique significantly improves the detection of the minority class by achieving the highest F1-score compared to the other evaluated data augmentation methods. Overall, IDA is a useful tool for enhancing the performance of text classifiers on imbalanced datasets by preventing overfitting, improving model generalization, addressing class imbalances, and reducing the cost of collecting and labeling data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Basiri, M.E., Nemati, S., Abdar, M., Cambria, E., Acharya, U.R.: ABCDM: an attention-based bidirectional CNN-RNN deep model for sentiment analysis. Futur. Gener. Comput. Syst. 115, 279–294 (2021)
Bayer, M., Kaufhold, M.A., Buchhold, B., Keller, M., Dallmeyer, J., Reuter, C.: Data augmentation in natural language processing: a novel text generation approach for long and short text classifiers. Int. J. Mach. Learn. Cybern., 1–16 (2022)
Fellbaum, C.: Wordnet. the encyclopedia of applied linguistics (2012)
Jo, B.C., Heo, T.S., Park, Y., Yoo, Y., Cho, W.I., Kim, K.: Dagam: data augmentation with generation and modification. arXiv preprint arXiv:2204.02633 (2022)
Karimi, A., Rossi, L., Prati, A.: Aeda: an easier data augmentation technique for text classification. arXiv preprint arXiv:2108.13230 (2021)
Kumar, V., Choudhary, A., Cho, E.: Data augmentation using pre-trained transformer models. arXiv preprint arXiv:2003.02245 (2020)
Li, B., Hou, Y., Che, W.: Data augmentation approaches in natural language processing: A survey. AI Open 3, 71–90 (2022)
Liu, P., Wang, X., Xiang, C., Meng, W.: A survey of text data augmentation. In: 2020 International Conference on Computer Communication and Network Security (CCNS), pp. 191–195. IEEE (2020)
Queiroz Abonizio, H., Barbon Junior, S.: Pre-trained data augmentation for text classification. In: Cerri, R., Prati, R.C. (eds.) BRACIS 2020. LNCS (LNAI), vol. 12319, pp. 551–565. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-61377-8_38
Sabty, C., Omar, I., Wasfalla, F., Islam, M., Abdennadher, S.: Data augmentation techniques on Arabic data for named entity recognition. Procedia Comput. Sci. 189, 292–299 (2021)
Siagh, A., Laallam, F.Z., Kazar, O.: Building a multilingual corpus of tweets relating to algerian higher education. In: International Conference on Intelligent Systems and Pattern Recognition, pp. 132–138. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-08277-1_11
Tang, H., Kamei, S., Morimoto, Y.: Data augmentation methods for enhancing robustness in text classification tasks. Algorithms 16(1), 59 (2023)
Wei, J., Zou, K.: Eda: Easy data augmentation techniques for boosting performance on text classification tasks. arXiv preprint arXiv:1901.11196 (2019)
Wu, J.L., Huang, S.: Application of generative adversarial networks and shapley algorithm based on easy data augmentation for imbalanced text data. Appl. Sci. 12(21), 10964 (2022)
Wu, X., Lv, S., Zang, L., Han, J., Hu, S.: Conditional BERT contextual augmentation. In: Rodrigues, J.M.F., et al. (eds.) ICCS 2019. LNCS, vol. 11539, pp. 84–95. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22747-0_7
Yoo, K.M., Park, D., Kang, J., Lee, S.W., Park, W.: Gpt3mix: leveraging large-scale language models for text augmentation. arXiv preprint arXiv:2104.08826 (2021)
Yu, Y.J., Yoon, S.J., Jun, S.Y., Kim, J.W.: Tabas: text augmentation based on attention score for text classification model. ICT Express 8(4), 549–554 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Siagh, A., Laallam, F.Z., Kazar, O., Salem, H., Benglia, M.E. (2024). IDA: An Imbalanced Data Augmentation for Text Classification. In: Bennour, A., Bouridane, A., Chaari, L. (eds) Intelligent Systems and Pattern Recognition. ISPR 2023. Communications in Computer and Information Science, vol 1940. Springer, Cham. https://doi.org/10.1007/978-3-031-46335-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-46335-8_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46334-1
Online ISBN: 978-3-031-46335-8
eBook Packages: Computer ScienceComputer Science (R0)