skip to main content
10.1145/3532213.3532260acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccaiConference Proceedingsconference-collections
research-article

A Text Classification Model Based on GCN and BiGRU Fusion

Published: 13 July 2022 Publication History

Abstract

A text classification model with the fusion of graph convolutional neural network (GCN) and bi-directional gated recurrent unit (BiGRU) is designed to address the lack of ability of simple neural networks to capture the contextual semantics of text, extract spatial feature information of text and nonlinear complex semantic relations. First, the text is preprocessed and text vectorization is performed by Word2Vec; then, the graph convolutional neural network and bi-directional gated recurrent unit are fused to form a hybrid model so that it can extract complex semantic relations and spatial feature information of the text; finally, the classification is performed by a softmax classifier. Experiments are conducted on a publicly available dataset, and the results demonstrate that the model can effectively improve the performance of text classification.

References

[1]
Sijia D U, Haining Y U. Survey of text classification methods based on deep learning [J]. Chinese Journal of Netword and Information Security, 6(4): 1.
[2]
LeCun Y, Bengio Y, Hinton G. Deep learning [J]. nature, 2015, 521(7553): 436-444.
[3]
Kumar A, Rastogi R. Attentional recurrent neural networks for sentence classification [M]//Innovations in Infrastructure. Springer, Singapore, 2019: 549-559.
[4]
Niu C, Zhan G, Li Z. Chinese Weibo sentiment analysis based on deep neural network [J]. Comput. Syst. Appl, 27: 205-210.
[5]
Luong M T, Pham H, Manning C D. Effective approaches to attention-based neural machine translation [J]. arXiv preprint arXiv:1508.04025, 2015.
[6]
Liu G, Guo J. Bidirectional LSTM with attention mechanism and convolutional layer for text classification [J]. Neurocomputing, 2019, 337: 325-338.
[7]
Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks [J]. arXiv preprint arXiv:1609.02907, 2016.
[8]
Yao L, Mao C, Luo Y. Graph convolutional networks for text classification[C]//Proceedings of the AAAI conference on artificial intelligence. 2019, 33(01): 7370-7377.
[9]
Fu Y L, Lu T L, Ma Z L. CNN malicious code detection technology based on One-Hot [J]. Computer Applications and Software, 2020, 37(1): 304-308,333.
[10]
Joulin A, Grave E, Bojanowski P, Bag of tricks for efficient text classification [J]. arXiv preprint arXiv:1607.01759, 2016.
[11]
Mikolov T, Chen K, Corrado G, Efficient estimation of word representations in vector space [J]. arXiv preprint arXiv:1301.3781, 2013.
[12]
Chung J, Gulcehre C, Cho K H, Empirical evaluation of gated recurrent neural networks on sequence modeling [J]. arXiv preprint arXiv:1412.3555, 2014.
[13]
Gori M, Monfardini G, Scarselli F. A new model for learning in graph domains[C]//Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. IEEE, 2005, 2: 729-734.
[14]
Scarselli F, Gori M, Tsoi A C, The graph neural network model [J]. IEEE transactions on neural networks, 2008, 20(1): 61-80.
[15]
Bruna J, Zaremba W, Szlam A, Spectral networks and locally connected networks on graphs [J]. arXiv preprint arXiv:1312.6203, 2013.
[16]
Liu P, Qiu X, Huang X. Recurrent neural network for text classification with multi-task learning [J]. arXiv preprint arXiv:1605.05101, 2016.
[17]
Chung J, Gulcehre C, Cho K H, Empirical evaluation of gated recurrent neural networks on sequence modeling [J]. arXiv preprint arXiv:1412.3555, 2014.
[18]
Wang W, Sun Y, Qi Q, Text sentiment classification model based on BiGRU-Attention neural network [J/OL] [J]. Application Research of Computers, 2019, 10: 09-27.

Cited By

View all
  • (2024)Chinese Text Classification Method Based on Graph Embedding Residual Bidirectional Long Short-Term Neural Network2024 IEEE First International Conference on Data Intelligence and Innovative Application (DIIA)10.1109/DIIA62678.2024.10871341(1-7)Online publication date: 23-Nov-2024
  • (2024)An effective multi-modal adaptive contextual feature information fusion method for Chinese long text classificationArtificial Intelligence Review10.1007/s10462-024-10835-x57:9Online publication date: 6-Aug-2024
  • (2023)Classification of Research Papers on Radio Frequency Electromagnetic Field (RF-EMF) Using Graph Neural Networks (GNN)Applied Sciences10.3390/app1307461413:7(4614)Online publication date: 5-Apr-2023
  • Show More Cited By
  1. A Text Classification Model Based on GCN and BiGRU Fusion

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCAI '22: Proceedings of the 8th International Conference on Computing and Artificial Intelligence
    March 2022
    809 pages
    ISBN:9781450396110
    DOI:10.1145/3532213
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 July 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICCAI '22

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Chinese Text Classification Method Based on Graph Embedding Residual Bidirectional Long Short-Term Neural Network2024 IEEE First International Conference on Data Intelligence and Innovative Application (DIIA)10.1109/DIIA62678.2024.10871341(1-7)Online publication date: 23-Nov-2024
    • (2024)An effective multi-modal adaptive contextual feature information fusion method for Chinese long text classificationArtificial Intelligence Review10.1007/s10462-024-10835-x57:9Online publication date: 6-Aug-2024
    • (2023)Classification of Research Papers on Radio Frequency Electromagnetic Field (RF-EMF) Using Graph Neural Networks (GNN)Applied Sciences10.3390/app1307461413:7(4614)Online publication date: 5-Apr-2023
    • (2023)Text Classification Based on PWACNN and Context-BiLSTM Methods2023 International Conference on Intelligent Management and Software Engineering (IMSE)10.1109/IMSE61332.2023.00010(18-24)Online publication date: 8-Sep-2023
    • (2023)Transformer and Graph Convolutional Network for Text ClassificationInternational Journal of Computational Intelligence Systems10.1007/s44196-023-00337-z16:1Online publication date: 4-Oct-2023
    • (2022)An Approach Based on Semantic Relationship Embeddings for Text ClassificationMathematics10.3390/math1021416110:21(4161)Online publication date: 7-Nov-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media