Skip to main content
SpringerLink
Log in

The LRE Map: what does it tell us about the last decade of our field?

  • Project Notes
  • Published:
Language Resources and Evaluation Aims and scope Submit manuscript

A Correction to this article was published on 16 February 2021

This article has been updated

Abstract

The LRE Map of Language Resources was introduced at LREC 2010. Its intended purpose was: “to shed light on the vast amount of resources that represent the background of the research presented at LREC”. It also aimed at a change of culture in the field, actively engaging each researcher both in the documentation task about resources and in sharing resources. When we started to use it regularly also in other conferences, it became clear that it was an innovative instrument able to provide a picture of the field and its evolution as reflected by the creation and use of Language Resources. After 9 years we revisit the Map, considerably extending the data analysed in an LREC 2018 paper. The LRE Map data analysed here have been provided by the authors of 21 conferences during the phase of submission of papers, and contain information about 9405 resources. We analyse the LRE Map data from many different viewpoints and the paper reports on the global picture, along the many Map dimensions, on different trends emerging from a diachronic perspective and finally on some comparisons between five editions of the two major conferences present in the Map: LREC and COLING.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Change history

Notes

  1. The LRE Map can be found at https://lremap.elra.info and at http://www.resourcebook.eu.

  2. This is the list of all the conferences: LREC 10-12-14-16-18, COLING 10-12-14-16-18, EMNLP 10, INTERSPEECH 11-13, O-COCOSDA 11-18, IJCNLP 11, RANLP 11, ACLHLT 11, LTC 11, NAACL 13, ACL 16.

  3. In 2019 and 2020, the Map has been regularly used also by ACL and INTERSPEECH, in addition to LREC and COLING, but the data are not analysed here.

  4. cf. FAIR: Principles https://www.go-fair.org/fair-principles/ Data Maturity Model https://www.rd-alliance.org/group/fair-data-maturity-model-wg/outcomes/fair-data-maturity-model-specification-and-guidelines.

  5. See the LRE Map Description in CLARIN-IT. http://hdl.handle.net/20.500.11752/ILC-71 for a very first step in this direction.

References

  • Arranz, V., Choukri, K., Mapelli, V., & Mazo, H. (2014). ELRA’s consolidated services for the HLT community. In N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14) (pp. 1511–1516). Reykjavik: European Language Resources Association (ELRA).

  • Calzolari, N. (2010). Introduction of the LREC 2010 conference chair. In N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, & D. Apias (Eds) Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10) (pp. I–IV). Valletta: European Language Resources Association (ELRA).

  • Calzolari, N., Soria, C., Del Gratta, R., Goggi, S., Quochi, V., Russo, I., Choukri, K., Mariani, J., & Piperidis, S. (2010). The LREC Map of language resources and technologies. In N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner & D. Tapias (Eds) Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10) (pp. 949–956). Valletta: European Language Resources Association (ELRA).

  • Calzolari, N., Del Gratta, R., Francopoulo, G., Mariani, J., Rubino, F., Russo, I., & Soria, C. (2012). The LRE Map. Harmonising community descriptions of resources. In N. Calzolari, K. Choukri, T. Declerck, M. U. Doğan, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis S (Eds) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12) (pp. 1084–1089). Istanbul: European Language Resources Association (ELRA).

  • Choukri, K., Arranz, V., Hamon, O., & Park, J. (2012). Using the International Standard Language Resource Number: Practical and technical aspects. In N. Calzolari, K. Choukri, T. Declerck, M. U. Doğan, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12). Istanbul: European Language Resources Association (ELRA).

  • Cieri, C., Choukri, K., Calzolari, N., Langendoen, D. T., Leveling, J., Palmer, M., Ide, N., & Pustejovsky, J. (2010). A road map for interoperable language resource metadata. In N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner & D. Tapias (Eds) Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10) (pp. 2506–2509). Valletta: European Language Resources Association (ELRA).

  • Del Gratta, R., Pardelli, G., & Goggi, S. (2014). The LRE Map disclosed. In N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14) (pp. 3534–3541). Reykjavik: European Language Resources Association (ELRA).

  • Del Gratta, R., Frontini, F., Monachini, M., Pardelli, G., Russo, I., Bartolini, R., Khan, F., Soria, C., & Calzolari, N. (2016). LREC as a graph: People and resources in a network. In N. Calzolari, K. Choukri, T. Declerck, S. Goggi, M. Grobelnik, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016) (pp. 2529–2532). Portorož: European Language Resources Association (ELRA).

  • Francopoulo, G., Mariani, J., & Paroubek, P. (2016). Predictive modeling: Guessing the NLP terms of tomorrow. In N. Calzolari, K. Choukri, T. Declerck, S. Soggi, M. Grobelnik, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016) (pp. 336–343). Portorož: European Language Resources Association (ELRA).

  • Gavrilidou, M., Labropoulou, P., Desipri, E., Piperidis, S., Papageorgiou, H., Monachini, M., Frontini, F., Declerck, T., Francopoulo, G., Arranz, V., & Mapelli, V. (2012). The META-SHARE metadata schema for the description of language resources. In N. Calzolari, K. Choukri, T. Declerck, M. U. Doğan, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12) (pp. 1090–1097). Istanbul: European Language Resources Association (ELRA).

  • Mapelli, V., Arranz, V., Carré, M., Mazo, H., Mostefa, D., & Choukri, K. (2012). ELRA in the heart of a cooperative HLT world. In N. Calzolari, K. Choukri, T. Declerck, M. U. Doğan, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12) (pp. 55–59). Istanbul: European Language Resources Association (ELRA).

  • Mariani, J., Paroubek, P., Francopoulo, G., & Hamon, O. (2014). Rediscovering 15 years of discoveries in language resources and evaluation: The LREC anthology analysis. In N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J. Mariani, A. Moreno, J. Odijk & S. Piperidis (Eds) Proceedings of the Ninth International Conference on Ianguage Resources and Evaluation (LREC’14) (pp. 4632–4669). Reykjavik: European Language Resources Association (ELRA).

  • Mariani, J., Paroubek, P., Francopoulo, G., & Hamon, O. (2016). Rediscovering 15 + 2 years of discoveries in language resources and evaluation. Language Resources and Evaluation, 50(2), 165–220. https://doi.org/10.1007/s10579-016-9352-9.

    Article  Google Scholar 

  • Soria, C., Calzolari, N., Monachini, M., Quochi, V., Bel, N., Choukri, K., et al. (2014). The Language Resources Strategic Agenda: The FLaReNet synthesis of community recommendations. Language Resources and Evaluation, 48(4), 753–775. https://doi.org/10.1007/s10579-014-9279-y.

    Article  Google Scholar 

  • Wikipedia Contributors. (2020). LRE Map—Wikipedia, the free encyclopedia. Retrieved August 25, 2020, fromhttps://en.wikipedia.org/w/index.php?title=LRE_Map&oldid=936877480.

  • Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., et al. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data,. https://doi.org/10.1038/sdata.2016.18.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all the LRE Map contributors for introducing information on the Language Resources used in their papers and making it available to all the community.

Author information

Authors and Affiliations

  1. Istituto di Linguistica Computazionale “A. Zampolli”, CNR, Via Moruzzi 1, 56124, Pisa, Italy

    Riccardo Del Gratta, Sara Goggi, Gabriella Pardelli & Nicoletta Calzolari

Authors
  1. Riccardo Del Gratta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sara Goggi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gabriella Pardelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nicoletta Calzolari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Riccardo Del Gratta.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: In the original publication of the article the “Abstract” section was published with an error.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Del Gratta, R., Goggi, S., Pardelli, G. et al. The LRE Map: what does it tell us about the last decade of our field?. Lang Resources & Evaluation 55, 259–283 (2021). https://doi.org/10.1007/s10579-020-09520-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10579-020-09520-6

Keywords

Search

Navigation