Skip to main content
SpringerLink
Log in

MegaLitePT: A Corpus of Literature in Portuguese for NLP

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13654 ))

Included in the following conference series:

  • 803 Accesses

Abstract

We present the section of the MegaLite corpus based on literary texts in Portuguese. This new section has been developed and adapted to be used for Computational Creativity tasks, such as Natural Language Processing, Automatic Text Generation (ATG), and other similar purposes. We highlight characteristics of the Portuguese section, such as the numbers of documents, authors, sentences and tokens and also how it is structured and formatted. We show how the ATG algorithms, which we have previously developed, behave when trained on this corpus, by using a human evaluation protocol where a mixture of automatically generated and natural texts is classified, using four criteria: grammaticality, coherence, identification of context, and an adapted Turing test.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This corpus is available on the official website of the University of Stuttgart https://www.ims.uni-stuttgart.de/en/research/resources/corpora/riqua/.

  2. 2.

    A detailed description of Freeling POS tags can be found at https://freeling-user-manual.readthedocs.io/en/latest/tagsets/tagset-pt/.

  3. 3.

    Verbs, adjectives, and nouns.

References

  1. Cabrera-Diego, L.A., Torres-Moreno, J.M.: SummTriver: a new trivergent model to evaluate summaries automatically without human references. Data Knowl. Eng. 113, 184–197 (2018). https://doi.org/10.1016/j.datak.2017.09.001

    Article  Google Scholar 

  2. Chen, Y., Skiena, S.: Building sentiment lexicons for all major languages. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Short Papers), vol. 2, pp. 383–389. Association for Computational Linguistics, Baltimore (2014). https://doi.org/10.3115/v1/P14-2063

  3. Deemter, K.V., Theune, M., Krahmer, E.: Real versus template-based natural language generation: a false opposition? Comput. Linguist. 31(1), 15–24 (2005). https://doi.org/10.1162/0891201053630291

  4. Drozd, A., Gladkova, A., Matsuoka, S.: Word embeddings, analogies, and machine learning: beyond King - Man + Woman = Queen. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 3519–3530. The COLING 2016 Organizing Committee, Osaka (2016). aclanthology.org/C16-1332

  5. Manning, C., Schutze, H.: Foundations of Statistical Natural Language Processing. MIT Press (1999)

    Google Scholar 

  6. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv:1301.3781 [cs], September 2013. arXiv: 1301.3781

  7. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Burges, C.J.C., Buttou, L., Welling, M., Ghahrramani, Z., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 26, pp. 3111–3119. Curran Associates Inc., Lake Tahoe, October 2013. proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html. arXiv: 1310.4546

  8. Moreno-Jiménez, L.-G., Torres-Moreno, J.-M., Wedemann, R.S.: Literary natural language generation with psychological traits. In: Métais, E., Meziane, F., Horacek, H., Cimiano, P. (eds.) NLDB 2020. LNCS, vol. 12089, pp. 193–204. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-51310-8_18

    Chapter  Google Scholar 

  9. Moreno Jiménez, L.G., Torres Moreno, J.M.: LiSSS: a new corpus of literary Spanish sentences for emotions detection. Computación y Sistemas 24(3), 1139–1147 (Sep 2020). https://doi.org/10.13053/cys-24-3-3474

  10. Moreno-Jiménez, L.G., Torres-Moreno, J.M.: Megalite: a new Spanish literature corpus for NLP tasks. In: Computer Science & Information Technology (CS & IT), pp. 131–147. AIRCC Publishing Corporation, January 2021. https://doi.org/10.5121/csit.2021.110109

  11. Moreno-Jiménez, L.-G., Torres-Moreno, J.-M.: MegaLite-2: an extended bilingual comparative literary corpus. In: Arai, K. (ed.) Intelligent Computing. LNNS, vol. 283, pp. 1014–1029. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-80119-9_67

    Chapter  Google Scholar 

  12. Moreno-Jiménez, L.G., Torres-Moreno, J.M.S., Wedemann, R., SanJuan, E.: Generación automática de frases literarias. Linguamática 12(1), 15–30 (2020). https://doi.org/10.21814/lm.12.1.308

  13. Moreno-Jiménez, L.G., Torres-Moreno, J.M., Wedemann, R.: A preliminary study for literary rhyme generation based on neuronal representation, semantics and shallow parsing. In: Anais do XIII Simpósio Brasileiro de Tecnologia da Informação e da Linguagem Humana, pp. 190–198. SBC, Porto Alegre (2021). https://doi.org/10.5753/stil.2021.17798. sol.sbc.org.br/index.php/stil/article/view/17798

  14. Moreno-Jiménez, L.G., Torres-Moreno, J.M., Wedemann, R.S.: Generación de frases literarias: un experimento preliminar. Procesamiento del Lenguaje Natural 65, 29–36 (2020). https://doi.org/10.26342/2020-65-3

  15. Navas-Loro, M., Rodríguez-Doncel, V., Santana-Perez, I., Sánchez, A.: Spanish corpus for sentiment analysis towards brands. In: Karpov, A., Potapova, R., Mporas, I. (eds.) SPECOM 2017. LNCS (LNAI), vol. 10458, pp. 680–689. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66429-3_68

    Chapter  Google Scholar 

  16. Padró, L., Stanilovsky, E.: FreeLing 3.0: towards wider multilinguality. In: FreeLing 3.0: Towards Wider Multilinguality (2012). upcommons.upc.edu/handle/2117/15986. Accepted 8 June 2012

  17. Papay, S., Padó, S.: RiQuA: a corpus of rich quotation annotation for English literary text. In: Proceedings of the 12th Language Resources and Evaluation Conference, pp. 835–841. European Language Resources Association, Marseille, May 2020

    Google Scholar 

  18. Řehůřek, R., Sojka, P.: Software framework for topic modelling with large corpora. In: Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, pp. 45–50. ELRA, Valletta, May 2010. https://doi.org/10.13140/2.1.2393.1847

  19. Stymne, S., Östman, C.: SLäNDa: an annotated corpus of narrative and dialogue in Swedish literary fiction. In: Proceedings of the 12th Language Resources and Evaluation Conference, pp. 826–834. European Language Resources Association, Marseille, May 2020

    Google Scholar 

  20. Torres-Moreno, J.M.: Megalite (2022). hdl.handle.net/11403/megalite. ORTOLANG (Open Resources and TOols for LANGuage). www.ortolang.fr

Download references

Author information

Authors and Affiliations

  1. PPG-Ciências Computacionais, Universidade do Estado do Rio de Janeiro, Rua São Francisco Xavier, 524, 20550-900, Rio de Janeiro, Brazil

    Igor Morgado & Roseli Wedemann

  2. Laboratoire Informatique d’Avignon, Université d’Avignon, (Avignon) France, 339 Chemin des Meinajariès, 84911, Avignon, cédex 9, France

    Luis-Gil Moreno-Jiménez & Juan-Manuel Torres-Moreno

Authors
  1. Igor Morgado
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luis-Gil Moreno-Jiménez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juan-Manuel Torres-Moreno
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Roseli Wedemann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Igor Morgado .

Editor information

Editors and Affiliations

  1. Federal University of Rio Grande do Norte, Natal, Brazil

    João Carlos Xavier-Junior

  2. Federal University of Bahia, Salvador, Brazil

    Ricardo Araújo Rios

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Morgado, I., Moreno-Jiménez, LG., Torres-Moreno, JM., Wedemann, R. (2022). MegaLitePT: A Corpus of Literature in Portuguese for NLP. In: Xavier-Junior, J.C., Rios, R.A. (eds) Intelligent Systems. BRACIS 2022. Lecture Notes in Computer Science(), vol 13654 . Springer, Cham. https://doi.org/10.1007/978-3-031-21689-3_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-21689-3_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-21688-6

  • Online ISBN: 978-3-031-21689-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation