Abstract
This research devoted to the low-resource Veps and Karelian languages. Algorithms for assigning part of speech tags to words and grammatical properties to words are presented in the article. These algorithms use our morphological dictionaries, where the lemma, part of speech and a set of grammatical features (gramset) are known for each word form. The algorithms are based on the analogy hypothesis that words with the same suffixes are likely to have the same inflectional models, the same part of speech and gramset. The accuracy of these algorithms were evaluated and compared. 66 thousand Karelian and 313 thousand Vepsian words were used to verify the accuracy of these algorithms. The special functions were designed to assess the quality of results of the developed algorithms. 86.8% of Karelian words and 92.4% of Vepsian words were assigned a correct part of speech by the developed algorithm. 90.7% of Karelian words and 95.3% of Vepsian words were assigned a correct gramset by our algorithm. Morphological and semantic tagging of texts, which are closely related and inseparable in our corpus processes, are described in the paper.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Belonogov, G.G., Kalinin, Y.P., Khoroshilov, A.A.: Computer Linguistics and Advanced Information Technologies: Theory and Practice of Building Systems for Automatic Processing of Text Information. Russian World, Moscow (2004). (in Russian)
Hämäläinen, M.: UralicNLP: an NLP library for Uralic languages. J. Open Source Softw. 4(37), 1345 (2019). https://doi.org/10.21105/joss.01345
Moshagen, S., Rueter, J., Pirinen, T., Trosterud, T., Tyers, F.M.: Open-source infrastructures for collaborative work on under-resourced languages. In: Collaboration and Computing for Under-Resourced Languages in the Linked Open Data Era, ReykjavĂk, Iceland, pp. 71–77 (2014)
Pirinen, T.A., Trosterud, T., Tyers, F.M., Vincze, V., Simon, E., Rueter, J.: Foreword to the special issue on Uralic languages. Northern Eur. J. Lang. Technol. 4(1), 1–9 (2016). https://doi.org/10.3384/nejlt.2000-1533.1641
Acknowledgement
The study was carried out under the state order of the Institute of Applied Mathematical Research and the Institute of Language, Literature and History of Karelian Research Centre of the Russian Academy of Sciences.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Krizhanovsky, A., Krizhanovskaya, N., Novak, I. (2021). Part of Speech and Gramset Tagging Algorithms for Unknown Words Based on Morphological Dictionaries of the Veps and Karelian Languages. In: Sychev, A., Makhortov, S., Thalheim, B. (eds) Data Analytics and Management in Data Intensive Domains. DAMDID/RCDL 2020. Communications in Computer and Information Science, vol 1427. Springer, Cham. https://doi.org/10.1007/978-3-030-81200-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-81200-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-81199-0
Online ISBN: 978-3-030-81200-3
eBook Packages: Computer ScienceComputer Science (R0)