skip to main content
research-article
Free access

Knowledgeable machine learning for natural language processing

Published: 25 October 2021 Publication History

Abstract

No abstract available.

References

[1]
Avron, B. and Feigenbaum, E.A. The Handbook of Artificial Intelligence, 1981.
[2]
Chen, G., Sun, M. and Liu, Y. Towards a universal continuous knowledge base. 2020; arXiv:2012.13568.
[3]
Chomsky, N. Syntactic Structures, De Gruyter, 1957.
[4]
Devlin, J., Chang, M-W, Lee, K. and Toutanova, K. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL'2019, 4171--4186.
[5]
Ding, M., Zhou, C., Chen, Q., Yang, H. and Tang, J. Cognitive graph for multi-hop reading comprehension at scale. In Proceedings of ACL'2019, 2694--2703.
[6]
Ding, M., Zhou, C., Yang, H. and Tang, J. CogLTX: Applying BERT to long texts. In Proceedings of NeurIPS'2020, 12792--12804.
[7]
Gu, Y., Yan, J., Zhu, H., Liu, Z., Xie, R., Sun, M., Lin, F. and Lin, L. Language modeling with sparse product of sememe experts. In Proceedings of EMNLP'2018, 4642--4651.
[8]
Han, X., Liu, Z. and Sun, M. Neural knowledge acquisition via mutual attention between knowledge graph and text. In Proceedings of AAAI'2018, 4832--4839.
[9]
Huang, L., Sun, C., Qiu, X. and Huang, X-J. GlossBERT: BERT for word sense disambiguation with gloss knowledge. In Proceedings of EMNLP-IJCNLP'2019, 3500--3505.
[10]
Liu, K., Zhao, J., He, S. and Zhang, Y. Question answering over knowledge bases. IEEE Intelligent Systems 30, 5 (2015), 26--35.
[11]
Liu, Z., Xiong, C., Sun, M. and Liu, Z. Entity-Duet Neural Ranking: Understanding the role of knowledge graph semantics in neural information retrieval. In Proceedings of ACL'2018, 2395--2405.
[12]
Qiu, D., Zhang, Y., Feng, X., Liao, X., Jiang, W., Lyu, Y., Liu, K. and Zhao, J. Machine reading comprehension using structural knowledge graph-aware network. In Proceedings of EMNLP-IJCNLP'2019, 5898--5903.
[13]
Radford, A., Narasimhan, K., Salimans, T. and Sutskever, I. Improving language understanding by generative pre-training. OpenAI Blog, 2018.
[14]
Sun, T., Shao, Y., Qiu, X., Guo, Q., Hu, Y., Huang, X-J and Zhang, Z. CoLAKE: Contextualized language and knowledge embedding. In Proceedings of COLING'2020, 3660--3670.
[15]
Wang, L., Zhang, Y., and Liu, T. A deep learning approach for question answering over knowledge base. Natural Language Understanding and Intelligent Applications, Springer, 2016, 885--892
[16]
Wang, X., Gao, T., Zhu, Z., Zhang, Z., Liu, Z., Li, J. and Tang, J. KEPLER: A unified model for knowledge embedding and pre-trained language representation. TACL 9, 2021, 176--194.
[17]
Xin, J., Lin, Y., Liu, Z. and Sun, M. Improving neural fine-grained entity typing with knowledge attention. In Proceedings of AAAI'2018, 5997--6004.
[18]
Xiong, C., Power, R. and Callan, J. Explicit semantic ranking for academic search via knowledge graph embedding. In Proceedings of WWW'2017, 1271--1279.
[19]
Zeng, W. et al. PanGu-alpha: Large-scale autoregressive pretrained Chinese language models with auto-parallel computation. 2021; arXiv:2104.12369.
[20]
Zhang, Z., Han, X., Liu, Z., Xin Jiang, X., Sun, M. and Liu, Q. ERNIE: Enhanced language representation with informative entities. In Proceedings of 2019 ACL, 1441--1451.
[21]
Zhang, Z. et al. CPM: A large-scale generative Chinese pre-trained language model. 2020; arXiv:2012.00413.

Cited By

View all
  • (2024)Growth and Branching of Natural Language ProcessingA Narrative History of Artificial Intelligence10.1007/978-981-97-0771-3_6(225-265)Online publication date: 3-May-2024
  • (2023)Knowledge Representation Learning and Knowledge-Guided NLPRepresentation Learning for Natural Language Processing10.1007/978-981-99-1600-9_9(273-349)Online publication date: 24-Aug-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM
Communications of the ACM  Volume 64, Issue 11
November 2021
130 pages
ISSN:0001-0782
EISSN:1557-7317
DOI:10.1145/3494050
  • Editor:
  • Andrew A. Chien
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2021
Published in CACM Volume 64, Issue 11

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Popular
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)164
  • Downloads (Last 6 weeks)11
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Growth and Branching of Natural Language ProcessingA Narrative History of Artificial Intelligence10.1007/978-981-97-0771-3_6(225-265)Online publication date: 3-May-2024
  • (2023)Knowledge Representation Learning and Knowledge-Guided NLPRepresentation Learning for Natural Language Processing10.1007/978-981-99-1600-9_9(273-349)Online publication date: 24-Aug-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media