Abstract
We discuss technology capable to learn language without supervision. While the entire goal may be too ambitious and not achievable to full extent, we explore how far we can advance grammar learning. We present the current approach employed in the open source OpenCog Artificial Intelligence Platform, describe the cognitive pipeline being constructed and present some intermediate results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dupoux, E.: Cognitive science in the era of artificial intelligence: a roadmap for reverse-engineering the infant language-learner. arXiv:1607.08723 [cs.CL] (2018)
Goertzel, B., Pennachin, C., Geisweiller, G.: Engineering General Intelligence, Part 2: The CogPrime Architecture for Integrative. Embodied AGI, Atlantis Press, New York (2014)
Vepstas L., Goertzel B.: Learning language from a large (unannotated) corpus. arXiv:1401.3372 [cs.CL], 14 January 2014
Sleator D., Temperley D.: Parsing English with a link grammar. In: Third International Workshop on Parsing Technologies (1993)
Kolonin A.: Automatic text classification and property extraction. In: 2015 SIBIRCON/SibMedInfo Conference Proceedings, pp. 27–31 (2015). ISBN 987-1-4673-9109-2
Barbara, P.: Workshop on Information and Representation Report. In: Workshop on Information and Representation (Washington, DC, March 30-April 1, 1985). Collected Works - Conference Proceedings (021), 151 p. (1985)
Friedman, J.: Sheaves on graphs, their homological invariants, and a proof of the Hanna Neumann conjecture. arXiv:1105.0129v2 [math.CO] (2011)
Yuret, D.: Discovery of linguistic relations using lexical attraction. arXiv:cmp-lg/9805009 [cs.CL] (1998)
Mikolov T., Sutskever I., Chen K., Corrado G., Dean J.: Distributed representations of words and phrases and their compositionality. arXiv:1310.4546v1 [cs.CL] (2013)
Cha M., Gwon Y., Kung H.: Language modeling by clustering with word embeddings for text readability assessment. arXiv:1709.01888v1 [cs.CL] (2017)
Franco-Penya, H. et al.: An analysis of the application of simplified silhouette to the evaluation of k-means clustering validity. In: 13th International Conference on Machine Learning and Data Mining MLDM 2017, New York, USA (2017)
Church, K., Hank, P.: Word association norms, mutual information, and lexicography. Comput. Linguist. Arch. 16(1), 22–29 (1990)
Wall M., Rechtsteiner A., Rocha L.: Singular value decomposition and principal component analysis, arXiv:physics/0208101 (2002)
Sculley D.: Web-scale k-means clustering. In: WWW 2010 Proceedings of the 19th International Conference on World Wide Web, pp. 1177–1178, Raleigh, North Carolina, USA (2010)
Starczewski, A., Krzyżak, A.: Performance evaluation of the Silhouette index. In: International Conference on Artificial Intelligence and Soft Computing, ICAISC 2015: Artificial Intelligence and Soft Computing, pp. 49–58 (2015)
Delpech J.: Unsupervised word sense disambiguation in dynamic semantic spaces arXiv:1802.02605 [cs.CL] (2018)
Bartunov, S., Kondrashkin, D., Osokin, A., Vetrov, D.: Breaking sticks and ambiguities with adaptive skip-gram. In: Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, pp. 130–138 (2016)
Hart, D., Goertzel, B.: OpenCog: a software framework for integrative artificial general intelligence. In: Proceedings of the 2008 Conference on Artificial General Intelligence 2008, pp. 468–472. IOS Press Amsterdam (2008). ISBN: 978-1-58603-833-5
World Wide Web Consortium: Turtle Terse RDF Triple Language (2012)
Gillespie-Lynch, K., Savage-Rumbaugh, S., Lyn, H.: Language learning in non-human primates. In: Brooks, P.J., Kempe, V. (eds.) Encyclopedia of Language Development. SAGE Publications (2014). https://doi.org/10.13140/2.1.3105.3122
Patterson, F., Patterson, C., Brentari, D.: Language in child, chimp, and gorilla. Am. Psychol. 42(3), 270–272 (1987). https://doi.org/10.1037/0003-066x.42.3.270.b
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Glushchenko, A. et al. (2018). Unsupervised Language Learning in OpenCog. In: Iklé, M., Franz, A., Rzepka, R., Goertzel, B. (eds) Artificial General Intelligence. AGI 2018. Lecture Notes in Computer Science(), vol 10999. Springer, Cham. https://doi.org/10.1007/978-3-319-97676-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-97676-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97675-4
Online ISBN: 978-3-319-97676-1
eBook Packages: Computer ScienceComputer Science (R0)