Abstract
The question answer (QA) system for a reading comprehension task tries to answer the question by retrieving the needed phrase from the given content. Precise answering is the key role of a QA system. An ambiguity is developed when we need to answer a negative question with a positive reply. The negation words change the polarity of the sentence, and hence, the scope of negation words is notable. This has paved the way for studying the role of ‘negation’ in the natural language processing (NLP) task. The handling of these words is considered a major part of our proposed methodology. In this paper, we propose an algorithm to retrieve and replace the negation words present in the content and query. A comparative study is done for performing word embedding over these words using various state-of-the-art methods. In earlier works when handling the negation the semantics of the sentences are changed. Hence, in this paper we try to maintain the semantics through our proposed methodology. The updated content is embedded into the bi-directional long short-term memory (Bi-LSTM) and thus makes the retrieving of an answer for a question answer system easier. The proposed work has been carried over the Stanford Negation, and the SQuAD dataset with a higher precision value of 96.2% has been achieved in retrieving the answers that are given in the dataset.
Similar content being viewed by others
References
Otter DW, Medina JR, Kalita JK (2018) A survey of the usages of deep learning in natural language processing. arXiv preprint arXiv:1807.10854
Chen L (2019) Attention-based deep learning system for negation and assertion detection in clinical notes. Int J Artif Intell Appl IJAIA 10(1)
Nkambou R, Mizoguchi R, Bourdeau J (eds) (2010) Advances in intelligent tutoring systems, vol 308. Springer, Berlin
Moghe N, Arora S, Banerjee S, Khapra MM (2018) Towards exploiting background knowledge for building conversation systems. arXiv preprint arXiv:1809.08205
Lin X D, Peng H, Liu B (2006) Support vector machines for text categorization in Chinese question classification. In: Proceedings of the 2006 IEEEWICACM International Conference on Web Intelligence, pp 334–337. IEEE Computer Society
Saha A, Aralikatte R, Khapra MM, Sankaranarayanan K (2018) Duorc: towards complex language understanding with paraphrased reading comprehension. arXiv preprint arXiv:1804.07927
Skovgaard-Olsen N, Collins P, Krzyżanowska K, Hahn U, Klauer KC (2019) Cancellation, negation, and rejection. Cognit Psychol 108:42–71
Blanco E, Moldovan D (2011) Some issues on detecting negation from text. In: Twenty-Fourth International FLAIRS Conference
Veningston K, Shanmugalakshmi R, Nirmala V (2015) Semantic association ranking schemes for information retrieval applications using term association graph representation. Sadhana 40(6):1793–1819
Wu S, Miller T, Masanz J, Coarr M, Halgrim S, Carrell D, Clark C (2014) Negation’s not solved: generalizability versus optimizability in clinical natural language processing. PloS One 9(11):e112774
Wiegand M, Balahur A, Roth B, Klakow D, Montoyo A (2010) A survey on the role of negation in sentiment analysis. In: Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (pp 60–68)
Wu AS, Do BH, Kim J, Rubin DL (2011) Evaluation of negation and uncertainty detection and its impact on precision and recall in search. J Digit Imaging 24(2):234–242
https://nlp.stanford.edu/projects/contradiction/ RTE2_dev_negated_contradiction.xml
https://rajpurkar.github.io/SQuAD-explorer/explore /1.1/dev/
Bhatia P, Celikkaya B, Khalilia M (2019) Joint Entity Extraction and Assertion Detection for Clinical Text. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp 954–959
Fancellu F, Lopez A, Webber B (2016) Neural networks for negation scope detection. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 495–504
Chapman W W, Chu D, Dowling J N (2007) ConText: an algorithm for identifying contextual features from clinical text. In: Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing, pp 81–88. Association for Computational Linguistics
Rumeng L, Jagannatha AN, Hong Y (2017) A hybrid Neural Network Model for Joint Prediction of Presence and Period Assertions of Medical Events in Clinical Notes. In: AMIA Annual Symposium Proceedings, vol 2017, p 1149. American Medical Informatics Association
Sharif W, Samsudin NA, Deris MM, Naseem R (2016) Effect of negation in sentiment analysis. In: 2016 Sixth International Conference on Innovative Computing Technology (INTECH), pp 718–723. IEEE
Kaity M, Balakrishnan V (2020) An integrated semi-automated framework for domain-based polarity words extraction from an unannotated non-English corpus. J Supercomput 1–28
Huddleston R, Pullum G (2005) The Cambridge grammar of the English language. Zeitschrift für Anglistik und Amerikanistik 53(2):193–194
Rose CP, Roque A, Bhembe D, Vanlehn K (2003) A hybrid text classification approach for analysis of student essays. In: Proceedings of the HLT-NAACL 03 Workshop on Building Educational Applications Using Natural Language Processing-Volume 2, pp 68–75. Association for Computational Linguistics
Horn L (1989) A natural history of negation
Lin C, Bethard S, Dligach D, Sadeque F, Savova G, Miller TA (2020) Does BERT need domain adaptation for clinical negation detection? J Am Med Inform Assoc 27(4):584–591
Celi LA, Chen C, Gruhl D, Shivade C, Wu JTY (2020) Introduction to Clinical Natural Language Processing with Python. In: Leveraging Data Science for Global Health, pp 229–250. Springer, Cham
\(Solarte-Pab\acute{o}n\) O, Menasalvas E, \(Rodriguez-Gonz\acute{a}lez\) A (2020) Spa-neg: an Approach for Negation Detection in Clinical Text Written in Spanish. In: International Work-Conference on Bioinformatics and Biomedical Engineering, pp 323–337. Springer, Cham
Funkner A, Balabaeva K, Kovalchuk S (2020) Negation Detection for Clinical Text Mining in Russian. arXiv preprint arXiv:2004.04980
Van Munster E (1988) The treatment of Scope and Negation in Rosetta. In: Proceedings of the 12th Conference on Computational Linguistics-Volume 2, pp 442–447. Association for Computational Linguistics
Gruet-Skrabalova H (2016) Yes or no, or how to answer a negative question. Linguistica 56(1):127–142
Seshadri K, Mercy S, Manohar S (2018) A distributed parallel algorithm for inferring hierarchical groups from large-scale text corpuses. Concurr Comput Pract Exper 30(11):e4404
Salton G, Wong A, Yang C S (1975) A Vector Space Model for Automatic Indexing “Communications of the ACM Vol. 18
Almeida F, Xexeo G (2019) Word embeddings: a survey. arXiv preprint arXiv:1901.09069
Salton G, McGill MJ (1986) Introduction to modern information retrieval
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Camacho-Collados J, Pilehvar MT (2018) From word to sense embeddings: a survey on vector representations of meaning. J Artif Intell Res 63:743–788
Pennington J, Socher R, Manning C (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1532–1543
Azhar-ul-Haq RA () Review: ranking documents using ranking algorithms & techniques
Pawar A, Mago V (2018) Calculating the similarity between words and sentences using a lexical database and corpus statistics. arXiv preprint arXiv:1802.05667
Li Y, McLean D, Bandar ZA, Crockett K (2006) Sentence similarity based on semantic nets and corpus statistics. IEEE Trans Knowl Data Eng 8:1138–1150
Ichida AY, Meneguzzi F, Ruiz D D (2018) Measuring semantic similarity between sentences using a siamese neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp 1–7. IEEE
Mueller J, Thyagarajan A (2016) Siamese recurrent architectures for learning sentence similarity. In: Thirtieth AAAI Conference on Artificial Intelligence
Neamah N, Saad S (2017) Question answering system supporting vector machine method for Hadith domain. J Theor Appl Inf Technol 95(7)
Xiang Y, Chen Q, Wang X, Qin Y (2017) Answer selection in community question answering via attentive neural networks. IEEE Signal Process Lett 24(4):505–509
Panahi A, Saeedi S, Arodz T (2019) word2ket: space-efficient word embeddings inspired by quantum entanglement. arXiv preprint arXiv:1911.04975
Seo M, Kembhavi A, Farhadi A, Hajishirzi H (2016) Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603
Hermann K M, Kocisky T, Grefenstette E, Espeholt L, Kay W, Suleyman M, Blunsom P (2015) Teaching machines to read and comprehend. In: Advances in neural information processing systems, pp 1693–1701
Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473
Mei J, Xiao C, Szepesvari C, Schuurmans D (2020) On the Global Convergence Rates of Softmax Policy Gradient Methods. arXiv preprint arXiv:2005.06392
De Marneffe MC, Rafferty AN, Manning CD (2008) Finding contradictions in text. In: Proceedings of ACL-08: HLT, 1039–1047
Rajpurkar P, Zhang J, Lopyrev K, Liang P (2016) Squad: 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250
Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 168–177. ACM
Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-Volume 10, pp 79–86. Association for Computational Linguistics
Popescu AM, Etzioni O (2007) Extracting product features and opinions from reviews. In: Natural Language Processing and Text Mining, pp 9–28. Springer, London
Farooq U, Mansoor H, Nongaillard A, Ouzrout Y, Qadir MA (2017) Negation handling in sentiment analysis at sentence level. JCP 12(5):470–478
Narayanan R, Liu B, Choudhary A (2009) Sentiment analysis of conditional sentences. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1-Volume 1, pp 180–189. Association for Computational Linguistics
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lilian, J.F., Sundarakantham, K. & Shalinie, S.M. Anti-negation method for handling negation words in question answering system. J Supercomput 77, 4244–4266 (2021). https://doi.org/10.1007/s11227-020-03437-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-020-03437-1