Application Research of Attention Mechanism in Machine Reading Comprehension
Authors: 
Di Wu, Ning Ma, Fucheng WanAuthors Info & Claims
Di Wu, Ning Ma, Fucheng WanAuthors Info & ClaimsPages 314 - 318
Abstract
In recent years, machine reading comprehension has become one of the latest and most popular topics in natural language processing, attention mechanism has been widely used as an important method for extracting relevant information from articles in machine reading comprehension. This paper aims to summarize the development process of the attention mechanism and its application in machine reading comprehension. On the basis of the introduction of the derivation process of the attention mechanism, the network framework and the weight calculation method of the input data, it further introduces three kinds of attention-based Mechanisms for machine reading comprehension models. Finally, the future development trend of the attention mechanism in the field of machine reading comprehension is analyzed. The attention mechanism can help the model to extract important information and make the model make more accurate judgments. In the future, it will be more widely used in various tasks of machine reading comprehension.
References
[1]
Xu Lili, Li Ru, Li Yuexiang, Sentence filling answer selection method for machine reading comprehension. Computer Engineering, 2018, 44(7):6.
[2]
Shen Xiangxiang, Hou Xinwen, Yin Chuanhuan. Research on State Attention Mechanism in Deep Reinforcement Learning. Journal of Intelligent Systems, 2020, 15(2): 317-322.
[3]
Ren Huan, Wang Xuguang. A Review of Attention Mechanisms. Computer Applications, 2021, 41(S01):6.
[4]
Wang Qi. Research on Neural Machine Translation Based on Attention Convolution. Soochow University, 2019.
[5]
Ji Zhongxian. Research on machine reading comprehension method based on attention mechanism. Harbin Institute of Technology, 2019.
[6]
Yang Zhiming, Shi Yingcheng, Wang Yong, A Reading Comprehension Model Based on BiDAF Multi-Document Reordering. Journal of Chinese Information, 2018, 32(11):11.
[7]
Ji Jing. Research on Machine Reading Comprehension Integrating Multiple Semantic Alignment Representations. Nanjing Normal University, 2018.
[8]
Liang Xiaobo, Ren Feiliang, Liu Yongkang, N-Reader: A Machine Reading Comprehension Model Based on Double Self-attention. 2022(10).
[9]
Gu Jianwei, Zeng Cheng, Zou Encen, Machine reading comprehension based on the combination of bidirectional attention flow and self-attention. Journal of Nanjing University: Natural Science Edition, 2019, 55(1):8.
[10]
Shi Lei, Wang Yi, Cheng Ying, etc. A review of attention mechanism research in natural language processing. Data Analysis and Knowledge Discovery, 2020, 4(5):1-14.
[11]
Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., & Polosukhin, I. (2017). Attention is All you Need. ArXiv, abs/1706.03762.
[12]
Liu Weijie. Research on Machine Reading Comprehension Technology Based on Attention Mechanism. Beijing University of Posts and Telecommunications, 2019.
- Application Research of Attention Mechanism in Machine Reading Comprehension
Recommendations
A New Fusion Method on Machine Reading Comprehension
BDE '20: Proceedings of the 2020 2nd International Conference on Big Data EngineeringMachine reading comprehension, as one of the core tasks of natural language processing, has been a research focus in this field. This paper is mainly aimed at Dureader, a Chinese-oriented multi-document reading comprehension task dataset, and an end-to-...
Machine Reading Comprehension Based on SpanBERT and Dynamic Convolutional Attention
AISS '22: Proceedings of the 4th International Conference on Advanced Information Science and SystemMachine reading comprehension is a challenging task in the field of natural language processing. In this paper, we propose a new neural network structure, fused SpanBERT and Dynamic convolutional Attention Network (SDANet), for span-extracted question ...
Construction of Reading Guidance Mechanism on E-book Reader Applications for Improving Learners' English Comprehension Capabilities
ICALT '12: Proceedings of the 2012 IEEE 12th International Conference on Advanced Learning TechnologiesE-book readers have the inherent advantage of affording learners both mobility and convenience. They can be considered ideal pedagogical tools for supporting learners reading activities. In this study, the reading strategies SQ3R (Survey, Question, Read,...
Comments
Information & Contributors
Information
Published In
April 2022
1065 pages
ISBN:9781450395786
DOI:10.1145/3544109
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 July 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Fundamental Research Funds for the Central Universities
- Natural Science Fund of GanSu Province
Conference
IPEC2022
IPEC2022: 2022 3rd Asia-Pacific Conference on Image Processing, Electronics and Computers
April 14 - 16, 2022
Dalian, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 31Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format