Skip to main content
Springer Nature Link
Log in

Portuguese Native Language Identification

  • Conference paper
  • First Online:
Computational Processing of the Portuguese Language (PROPOR 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11122))

Abstract

This study presents the first Native Language Identification (NLI) study for L2 Portuguese. We used a sub-set of the NLI-PT dataset, containing texts written by speakers of five different native languages: Chinese, English, German, Italian, and Spanish. We explore the linguistic annotations available in NLI-PT to extract a range of (morpho-)syntactic features and apply NLI classification methods to predict the native language of the authors. The best results were obtained using an ensemble combination of the features, achieving \(54.1\%\) accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://sites.google.com/site/nlisharedtask2013/home.

  2. 2.

    https://sites.google.com/site/nlisharedtask/home.

  3. 3.

    The issues exist as the corpus was not designed specifically for NLI.

  4. 4.

    More details about this approach can be found in [21].

  5. 5.

    Like previous work, this also includes stop words.

  6. 6.

    http://web.science.mq.edu.au/~smalmasi/data/pt-fw.txt.

  7. 7.

    They are also known as Phrase Structure Rules or Production Rules.

References

  1. Malmasi, S.: Native language identification: explorations and applications. Ph.D. thesis (2016)

    Google Scholar 

  2. Malmasi, S., Dras, M.: Multilingual native language identification. In: Natural Language Engineering (2015)

    Google Scholar 

  3. Malmasi, S., Dras, M.: Chinese native language identification. In: Proceedings of EACL. Association for Computational Linguistics, Gothenburg (2014)

    Google Scholar 

  4. Malmasi, S., Dras, M., Temnikova, I.: Norwegian native language identification. In: Proceedings of RANLP, Hissar, Bulgaria, pp. 404–412, September 2015

    Google Scholar 

  5. Malmasi, S., Dras, M.: Arabic native language identification. In: Proceedings of the Arabic Natural Language Processing Workshop (2014)

    Google Scholar 

  6. Block, D., Cameron, D.: Globalization and Language Teaching. Routledge, Abingdon (2002)

    Book  Google Scholar 

  7. Martins, R.T., Hasegawa, R., Nunes, M.G.V., Montilha, G., De Oliveira, O.N.: Linguistic issues in the development of ReGra: a grammar checker for Brazilian Portuguese. Nat. Lang. Eng. 4(4), 287–307 (1998)

    Article  Google Scholar 

  8. Elliot, S.: IntelliMetric: From here to validity. In: A Cross-Disciplinary Perspective, Automated Essay Scoring, pp. 71–86 (2003)

    Google Scholar 

  9. Baptista, J., Costa, N., Guerra, J., Zampieri, M., Cabral, M., Mamede, N.: P-AWL: academic word list for Portuguese. In: Pardo, T.A.S., Branco, A., Klautau, A., Vieira, R., de Lima, V.L.S. (eds.) PROPOR 2010. LNCS (LNAI), vol. 6001, pp. 120–123. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12320-7_15

    Chapter  Google Scholar 

  10. Mendes, A., Antunes, S., Janssen, M., Gonçalves, A.: The COPLE2 corpus: a learner corpus for Portuguese. In: Proceedings of LREC (2016)

    Google Scholar 

  11. Wong, S.M.J., Dras, M.: Contrastive analysis and native language identification. In: Proceedings of ALTA, Sydney, Australia, pp. 53–61, December 2009

    Google Scholar 

  12. Wong, S.M.J., Dras, M.: Exploiting parse structures for native language identification. In: Proceedings of EMNLP (2011)

    Google Scholar 

  13. Swanson, B., Charniak, E.: Native language detection with tree substitution grammars. In: Proceedings of ACL, Jeju Island, Korea, pp. 193–197, July 2012

    Google Scholar 

  14. Tetreault, J., Blanchard, D., Cahill, A., Chodorow, M.: Native tongues, lost and found: resources and empirical evaluations in native language identification. In: Proceedings of COLING, Mumbai, India, pp. 2585–2602 (2012)

    Google Scholar 

  15. Gebre, B.G., Zampieri, M., Wittenburg, P., Heskes, T.: Improving native language identification with TF-IDF weighting. In: Proceedings of BEA (2013)

    Google Scholar 

  16. Malmasi, S., Dras, M.: Language transfer hypotheses with linear SVM weights. In: Proceedings of EMNLP, pp. 1385–1390 (2014)

    Google Scholar 

  17. Malmasi, S., Dras, M., Johnson, M., Du, L., Wolska, M.: Unsupervised text segmentation based on native language characteristics. In: Proceedings of ACL (2017)

    Google Scholar 

  18. Malmasi, S., Tetreault, J., Dras, M.: Oracle and human baselines for native language identification. In: Proceedings of BEA (2015)

    Google Scholar 

  19. Jarvis, S., Bestgen, Y., Pepper, S.: Maximizing classification accuracy in native language identification. In: Proceedings of BEA (2013)

    Google Scholar 

  20. Malmasi, S., et al.: A report on the 2017 native language identification shared task. In: Proceedings of BEA (2017)

    Google Scholar 

  21. Malmasi, S., Dras, M.: Native Language Identification using Stacked Generalization. arXiv preprint arXiv:1703.06541 (2017)

  22. Malmasi, S., Dras, M.: Native language identification with classifier stacking and ensembles. Computational Linguistics (2018)

    Google Scholar 

  23. Wong, S.M.J., Dras, M., Johnson, M.: Exploring adaptor grammars for native language identification. In: Proceedings of EMNLP (2012)

    Google Scholar 

  24. Tsur, O., Rappoport, A.: Using classifier features for studying the effect of native language on the choice of written second language words. In: Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition (2007)

    Google Scholar 

  25. Malmasi, S., Wong, S.M.J., Dras, M.: NLI shared task 2013: MQ submission. In: Proceedings of BEA (2013)

    Google Scholar 

  26. Swanson, B., Charniak, E.: Data driven language transfer hypotheses. EACL 2014, 169 (2014)

    Google Scholar 

  27. Granger, S., Dagneaux, E., Meunier, F., Paquot, M.: International Corpus of Learner English (Version 2). Presses Universitaires de Louvain, Louvian-la-Neuve (2009)

    Google Scholar 

  28. Brooke, J., Hirst, G.: Measuring interlanguage: native language identification with L1-influence metrics. In: Proceedings of LREC (2012)

    Google Scholar 

  29. Blanchard, D., Tetreault, J., Higgins, D., Cahill, A., Chodorow, M.: TOEFL11: a corpus of non-native English. Educational Testing Service, Technical report (2013)

    Article  Google Scholar 

  30. Malmasi, S., Dras, M.: Finnish native language identification. In: Proceedings of ALTA, Melbourne, Australia, pp. 139–144 (2014)

    Google Scholar 

  31. Wang, M., Malmasi, S., Huang, M.: The Jinan Chinese learner corpus. In: Proceedings of BEA (2015)

    Google Scholar 

  32. Tenfjord, K., Meurer, P., Hofland, K.: The ASK corpus: a language learner corpus of Norwegian as a second language. In: Proceedings of LREC (2006)

    Google Scholar 

  33. del Río, I., Zampieri, M., Malmasi, S.: A Portuguese native language identification dataset. In: Proceedings of BEA (2018)

    Google Scholar 

  34. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    MATH  Google Scholar 

  35. Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. IJCAI 14, 1137–1145 (1995)

    Google Scholar 

  36. Malmasi, S., Cahill, A.: Measuring feature diversity in native language identification. In: Proceedings of BEA (2015)

    Google Scholar 

  37. Malmasi, S., Dras, M., Zampieri, M.: LTG at SemEval-2016 Task 11: complex word identification with classifier ensembles. In: Proceedings of SemEval (2016)

    Google Scholar 

  38. Malmasi, S., Zampieri, M., Dras, M.: Predicting post severity in mental health forums. In: Proceedings of CLPsych (2016)

    Google Scholar 

Download references

Acknowledgements

We would like to thank the anonymous reviewers for the suggestions and constructive feedback provided.

Author information

Authors and Affiliations

  1. Harvard Medical School, Boston, USA

    Shervin Malmasi

  2. University of Lisbon, Lisbon, Portugal

    Iria del Río

  3. University of Wolverhampton, Wolverhampton, UK

    Marcos Zampieri

Authors
  1. Shervin Malmasi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iria del Río
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marcos Zampieri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shervin Malmasi .

Editor information

Editors and Affiliations

  1. Institute of Informatics, Federal University of Rio Grande do Sul, Porto Alegre, Brazil

    Aline Villavicencio

  2. Instituto de Informática - UFRGS, Porto Alegre, Brazil

    Viviane Moreira

  3. INESC-ID, Lisbon, Portugal

    Alberto Abad

  4. UFSCAR, Sao Carlos, Brazil

    Helena Caseli

  5. Centro Singular de Investigación en Tecnoloxías, Universidade de Santiago de Compostela, Santiago de Compostela, La Coruña, Spain

    Pablo Gamallo

  6. Université de Toulon, Parc Scientifique Technologique Luminy, Marseille, France

    Carlos Ramisch

  7. Centro de Informática e Sistemas, Universidade de Coimbra, Coimbra, Portugal

    Hugo Gonçalo Oliveira

  8. Federal University of Technology, Dois Vizinhos, Paraná, Brazil

    Gustavo Henrique Paetzold

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Malmasi, S., del Río, I., Zampieri, M. (2018). Portuguese Native Language Identification. In: Villavicencio, A., et al. Computational Processing of the Portuguese Language. PROPOR 2018. Lecture Notes in Computer Science(), vol 11122. Springer, Cham. https://doi.org/10.1007/978-3-319-99722-3_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99722-3_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99721-6

  • Online ISBN: 978-3-319-99722-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics