Abstract
Designing effective automated techniques for proper identification and categorisation of hostile speech is essential, especially for low resource Indian languages without established datasets. A majority of Indians use Hindi for their interactions on social media. Multiple dialects of Hindi spoken by the users in different parts of the country further exacerbate the challenge of identifying hostile speech as they imply diverse patterns of expression of hostility. In this work, we experimented with a wide range of neural network models for hostility identification in Hindi - pre-trained word embeddings, stacked word embeddings, and fine-tuned XLM-RoBERTa model. We also analyzed the effectiveness of back translation as a data augmentation technique to assist in fine-tuning of XLM-RoBERTa model for hostility identification. The experiments are carried out on the dataset provided by Constraint 2021 shared task. Our team’s (Siva_Alfred on leader board) best neural network model achieves F1-weighted score of 0.90 for coarse-grained hostility detection and 0.54 F1-weighted score for fine-grained hostility identification.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
References
Majumder, P., Patel, D., Modha, S., Mandl, T.: Overview of the HASOC track at FIRE 2019: hate speech and offensive content identification in Indo-European languages, December 2019
Mathur, P., Shah, R., Sawhney, R., Mahata, D.: Detecting offensive tweets in Hindi-English code-switched language. In: Proceedings of the Sixth International Workshop on Natural Language Processing for Social Media, Melbourne, Australia, July 2018, pp. 18–26. Association for Computational Linguistics (2018)
Kumar, R., Lahiri, B., Ojha, A.K.: Aggressive and offensive language identification in Hindi, Bangla, and English: a comparative study. SN Comput. Sci. 2(1), 1–20 (2021). https://doi.org/10.1007/s42979-020-00414-6. Article No. 26
Chaudhary, A.: A visual survey of data augmentation in NLP (2020). https://amitness.com/2020/05/data-augmentation-for-nlp
Bhardwaj, M., Akhtar, M.S., Ekbal, A., Das, A., Chakraborty, T.: Hostility detection dataset in Hindi. arXiv preprint arXiv:2011.03588 (2020)
Patwa, P., et al.:. Overview of constraint 2021 shared tasks: detecting English COVID-19 fake news and Hindi hostile posts. In: Chakraborty, T., Shu, K., Bernard, R., Liu, H., Akhtar, M.S. (eds.) CONSTRAINT 2021. CCIS, vol. 1402, pp. 42–53. Springer, Cham (2021)
Howard, J., Ruder, S.: Universal language model fine-tuning for text classification. arXiv preprint arXiv:1801.06146 (2018)
Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Akbik, A., Blythe, D., Vollgraf, R.: Contextual string embeddings for sequence labeling. In: Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, New Mexico, USA, August 2018, pp. 1638–1649. Association for Computational Linguistics (2018)
Conneau, A., et al.: Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116 (2019)
Saha, P., Mathew, B., Goyal, P., Mukherjee., A.: HateMonitors: language agnostic abuse detection in social media. arXiv preprint arXiv:1909.12642 (2019)
Risch, J., Krestel, R.: Aggression identification using deep learning and data augmentation. In: Proceedings of the First Workshop on Trolling, Aggression and Cyberbullying (TRAC-2018), pp. 150–158 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Sai, S., Jacob, A.W., Kalra, S., Sharma, Y. (2021). Stacked Embeddings and Multiple Fine-Tuned XLM-RoBERTa Models for Enhanced Hostility Identification. In: Chakraborty, T., Shu, K., Bernard, H.R., Liu, H., Akhtar, M.S. (eds) Combating Online Hostile Posts in Regional Languages during Emergency Situation. CONSTRAINT 2021. Communications in Computer and Information Science, vol 1402. Springer, Cham. https://doi.org/10.1007/978-3-030-73696-5_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-73696-5_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73695-8
Online ISBN: 978-3-030-73696-5
eBook Packages: Computer ScienceComputer Science (R0)