Abstract
As a key sub-task in the field of speculation and negation extraction, Speculation and Negation Scope Resolution (SpNeSR) focuses on extracting speculative and negative texts within sentences, i.e., distinguishing between factual and non-factual information, which means it is an important and fundamental task in Natural Language Processing (NLP) community. Previous work utilized various methods for SpNeSR that are quite domain-specific, and failed to build a unified framework with good generalization. In addition, they were limited by the sizes of datasets and ignored producing more samples for training, since SpNeSR is a data-hungry task. With consideration of the above problems, we not only propose a unified Machine Reading Comprehension (MRC) formulation for SpNeSR, but also design a Data Augmentation (DA) method fit for scopes. Experimental results on several English and Chinese corpora manifest that both MRC and DA mechanism are effective, and our MRC model with DA is superior to several state-of-the-arts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apostolova, E., Tomuro, N., Demner-Fushman, D.: Automatic extraction of lexico-syntactic patterns for detection of negation and speculation scopes. In: ACL 2011, pp. 283–287 (2011)
Chen, H., Xia, R., Yu, J.: Reinforced counterfactual data augmentation for dual sentiment classification. In: EMNLP 2021, pp. 269–278 (2021)
Chen, S., Aguilar, G., Neves, L., Solorio, T.: Data augmentation for cross-domain named entity recognition. In: EMNLP 2021, pp. 5346–5356 (2021)
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: NAACL, pp. 4171–4186 (2019)
Du, X., Cardie, C.: Event extraction by answering (almost) natural questions. In: EMNLP 2020, pp. 671–683 (2020)
Fancellu, F., Lopez, A., Webber, B.L.: Neural networks for negation scope detection. In: ACL 2016 (2016)
Farkas, R., Vincze, V., Móra, G., Csirik, J., Szarvas, G.: The CoNLL-2010 shared task: Learning to detect hedges and their scope in natural language text. In: CoNLL 2010, pp. 1–12 (2010)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of CVPR 2016, pp. 770–778 (2016)
Hsu, T., Chen, C., Huang, H., Chen, H.: Semantics-preserved data augmentation for aspect-based sentiment analysis. In: EMNLP 2021, pp. 4417–4422 (2021)
Konstantinova, N., de Sousa, S.C.M., Díaz, N.P.C., López, M.J.M., Taboada, M., Mitkov, R.: A review corpus annotated for negation, speculation and their scope. In: LREC 2012, pp. 3190–3195 (2012)
Li, H., Lu, W.: Learning with structured representations for negation scope extraction. In: ACL 2018, pp. 533–539 (2018)
Li, X., Feng, J., Meng, Y., Han, Q., Wu, F., Li, J.: A unified MRC framework for named entity recognition. In: ACL 2020, pp. 5849–5859 (2020)
Li, X., et al.: Entity-relation extraction as multi-turn question answering. In: ACL 2019, pp. 1340–1350 (2019)
Liu, J., Chen, Y., Liu, K., Bi, W., Liu, X.: Event extraction as machine reading comprehension. In: EMNLP 2020, pp. 1641–1651 (2020)
Liu, J., Chen, Y., Xu, J.: Machine reading comprehension as data augmentation: a case study on implicit event argument extraction. In: EMNLP, pp. 2716–2725 (2021)
Mao, Y., Shen, Y., Yu, C., Cai, L.: A joint training dual-mrc framework for aspect based sentiment analysis. In: AAAI 2021, pp. 13543–13551 (2021)
Morante, R., Blanco, E.: *SEM 2012 shared task: Resolving the scope and focus of negation. In: *SEM 2012, pp. 265–274 (2012)
Øvrelid, L., Velldal, E., Oepen, S.: Syntactic scope resolution in uncertainty analysis. In: COLING 2010. pp. 1379–1387 (2010)
Özgür, A., Radev, D.R.: Detecting speculations and their scopes in scientific text. In: EMNLP 2009, pp. 1398–1407 (2009)
Qian, Z., Li, P., Zhou, G., Zhu, Q.: Speculation and negation scope detection via bidirectional lstm neural networks. J. Software 29(8) (2018)
Qian, Z., Li, P., Zhu, Q., Zhou, G., Luo, Z., Luo, W.: Speculation and negation scope detection via convolutional neural networks. In: EMNLP, pp. 815–825 (2016)
Vincze, V., Szarvas, G., Farkas, R., Móra, G., Csirik, J.: The bioscope corpus: biomedical texts annotated for uncertainty, negation and their scopes. BMC Bioinform. 9(S-11) (2008)
Wei, J.W., Zou, K.: EDA: easy data augmentation techniques for boosting performance on text classification tasks. In: EMNLP 2019, pp. 6381–6387 (2019)
Yu, A.W., et al.: Qanet: combining local convolution with global self-attention for reading comprehension. In: ICLR 2018 (2018)
Zhao, Y., Bethard, S.: How does Bert’s attention change when you fine-tune? an analysis methodology and a case study in negation scope. In: ACL 2020, pp. 4729–4747 (2020)
Zhu, Q., Li, J., Wang, H., Zhou, G.: A unified framework for scope learning via simplified shallow semantic parsing. In: EMNLP 2010. pp. 714–724 (2010)
Zou, B., Zhou, G., Zhu, Q.: Tree kernel-based negation and speculation scope detection with structured syntactic parse features. In: EMNLP, pp. 968–976 (2013)
Zou, B., Zhu, Q., Zhou, G.: Negation and speculation identification in Chinese language. In: ACL 2015, pp. 656–665 (2015)
Acknowledgements
Authors would like to thank the three anonymous reviewers for their comments. This work was supported by national Natural Science Foundation of China (NSFC) via Grant Nos. 62006167, 62276177 and 61836007.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Qian, Z., Sun, T., Zou, T., Li, P., Zhu, Q., Zhou, G. (2023). Speculation and Negation Scope Resolution via Machine Reading Comprehension Formulation with Data Augmentation. In: Wang, X., et al. Database Systems for Advanced Applications. DASFAA 2023. Lecture Notes in Computer Science, vol 13945. Springer, Cham. https://doi.org/10.1007/978-3-031-30675-4_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-30675-4_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30674-7
Online ISBN: 978-3-031-30675-4
eBook Packages: Computer ScienceComputer Science (R0)