Cited By
View all- López-García GJerez JRibelles NAlba EVeredas F(2023)Explainable clinical coding with in-domain adapted transformersJournal of Biomedical Informatics10.1016/j.jbi.2023.104323139:COnline publication date: 1-Mar-2023
Report on CLEF 2020
Authors: 
Avi Arampatzis, 
Linda Cappellato, 
Carsten Eickhoff, 
Nicola Ferro, 
Hideo Joho, 
Evangelos Kanoulas, Christina Lioma, Aurélie Névéol, Theodora Tsikrika, Stefanos VrochidisAuthors Info & Claims
Avi Arampatzis, Linda Cappellato, Carsten Eickhoff, Nicola Ferro, Hideo Joho, Evangelos Kanoulas, Christina Lioma, Aurélie Névéol, Theodora Tsikrika, Stefanos VrochidisAuthors Info & ClaimsArticle No.: 11, Pages 1 - 10
Abstract
This is a report on the tenth edition of the Conference and Labs of the Evaluation Forum (CLEF 2020), (virtually) held from September 22--25, 2020, in Thessaloniki, Greece.
CLEF was a four day event combining a Conference and an Evaluation Forum. The Conference featured keynotes by Ellen Voorhees and Yiannis Kompasiaris, and presentation of peer reviewed research papers covering a wide range of topics in addition to many posters. The Evaluation Forum consisted to twelve Labs: ARQMath, BioASQ, CheckThat!, ChEMU, CLEF eHealth, eRisk, HIPE, ImageCLEF, LifeCLEF, LiLAS, PAN, and Touché, addressing a wide range of tasks, media, languages, and ways to go beyond standard test collections.
References
[1]
A. Arampatzis, E. Kanoulas, T. Tsikrika, S. Vrochidis, H. Joho, C. Lioma, K. Eickhoff, A. Névéol, L. Cappellato, and N. Ferro, editors. Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Eleventh International Conference of the CLEF Association (CLEF 2020), 2020. Lecture Notes in Computer Science (LNCS) 12260, Springer, Heidelberg, Germany.
[2]
A. Barrón-Cedeño, T. Elsayed, P. Nakov, G. Da San Martino, M. Hasanain, R. Suwaileh, F. Haouari, N. Babulkov, B. Hamdan, A. Nikolov, S. Shaar, and Z. Sheikh Ali. Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media. In Arampatzis et al. [2020], pages 215--236.
[3]
J. Bevendorff, B. Ghanem, A. Giachanou, M. Kestemont, E. Manjavacas, I. Markov, M. Mayerl, M. Potthast, F. M. Rangel Pardo, P. Rosso, G. Specht, E. Stamatatos, B. Stein, M. Wiegmann, and E. Zangerle. Overview of PAN 2020: Authorship Verification, Celebrity Profiling, Profiling Fake News Spreaders on Twitter, and Style Change Detection. In Arampatzis et al. [2020], pages 372--383.
[4]
A. Bondarenko, M. Fröbe, M. Beloucif, L. Gienapp, Y. Ajjour, A. Panchenko, C. Biemann, B. Stein, H. Wachsmuth, M. Potthast, and M. Hagen. Overview of Touchoé 2020: Argument Retrieval - Extended Abstract. In Arampatzis et al. [2020], pages 384--395.
[5]
L. Cappellato, C. Eickhoff, N. Ferro, and A. Névéol, editors. CLEF 2020 Working Notes, 2020. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, http://ceur-ws.org/Vol-2696/.
[6]
M. Ehrmann, M. Romanello, A. Flückiger, and S. Clematide. Overview of CLEF HIPE 2020: Named Entity Recognition and Linking on Historical Newspapers. In Arampatzis et al. [2020], pages 288--310.
[7]
N. Ferro. What Happened in CLEF... For a While? In F. Crestani, M. Braschler, J. Savoy, A. Rauber, H. Müller, D. E. Losada, G. Heinatz Bürki, L. Cappellato, and N. Ferro, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Tenth International Conference of the CLEF Association (CLEF 2019), pages 3--45. Lecture Notes in Computer Science (LNCS) 11696, Springer, Heidelberg, Germany, 2019.
[8]
N. Ferro and C. Peters, editors. Information Retrieval Evaluation in a Changing World - Lessons Learned from 20 Years of CLEF, volume 41 of The Information Retrieval Series, 2019. Springer International Publishing, Germany.
[9]
N. Ferro and G. Silvello. 3.5K runs, 5K topics, 3M assessments and 70M measures: What trends in 10 years of Adhoc-ish CLEF? Information Processing & Management, 53(1):175--202, January 2017.
[10]
L. Goeuriot, H. Suominen, L. Kelly, A. Miranda-Escalada, M. Krallinger, Z. Liu, G. Pasi, G. Gonzalez Saez, M. Viviani, and C. Xu. Overview of the CLEF eHealth Evaluation Lab 2020. In Arampatzis et al. [2020], pages 255--271.
[11]
J. He, D. Q. Nguyen, S. A. Akhondi, C. Druckenbrodt, C. Thorne, R. Hoessel, Z. Afzal, Z. Zhai, B. Fang, H. Yoshikawa, A. Albahem, L. Cavedon, T. Cohn, T. Baldwin, and K. Verspoor. Overview of ChEMU 2020: Named Entity Recognition and Event Extraction of Chemical Reactions from Patents. In Arampatzis et al. [2020], pages 237--254.
[12]
B. Ionescu, H. Müller, R. Péteri, A. Ben Abacha, V. V. Datla, S. A. Hasan, D. Demner-Fushman, S. Kozlovski, V. Liauchuk, Y. Dicente Cid, V. Kovalev, O. Pelka, C. M. Friedrich, A. García Seco de Herrera, V.-T. Ninh, T.-K. Le, L. Zhou, L. Piras, M. Riegler, P. Halvorsen, M.-T. Tran, M. Lux, C. Gurrin, D.-T. Dang-Nguyen, J. Chamberlain, A. Clark, A. Campello, D. Fichou, R. Berari, P. Brie, M. Dogariu, L.-D. Stefan, and M. G. Constantin. Overview of the ImageCLEF 2020: Multimedia Retrieval in Medical, Lifelogging, Nature, and Internet Applications. In Arampatzis et al. [2020], pages 311--341.
[13]
A. Joly, H. Goëau, S. Kahl, B. Deneu, M. Servajean, E. Cole, L. Picek, R. L. Ruiz De Castañeda, I. Bolon, A. Durso, T. Lorieul, C. Botella, H. Glotin, J. Champ, I. Eggel, W.-P. Vellinga, P. Bonnet, and H. Müller. Overview of LifeCLEF 2020: A System-Oriented Evaluation of Automated Species Identification and Species Distribution Prediction. In Arampatzis et al. [2020], pages 342--363.
[14]
B. Larsen. The Scholarly Impact of CLEF 2010--2017. In Ferro and Peters [2019], pages 547--554.
[15]
D. E. Losada, F. Crestani, and J. Parapar. Overview of eRisk 2020: Early Risk Prediction on the Internet. In Arampatzis et al. [2020], pages 272--287.
[16]
A. Nentidis, A. Krithara, K. Bougiatiotis, M. Krallinger, C. Rodríguez Penagos, M. Villegas, and G. Paliouras. Overview of BioASQ 2020: The Eighth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering. In Arampatzis et al. [2020], pages 194--214.
[17]
P. Schaer, J. Schaible, and L. Jael García Castro. Overview of LiLAS 2020 - Living Labs for Academic Search. In Arampatzis et al. [2020], pages 364--371.
[18]
T. Tsikrika, A. Garcia Seco de Herrera, and H. Müller. Assessing the Scholarly Impact of Image-CLEF. In P. Forner, J. Gonzalo, J. Kekäläinen, M. Lalmas, and M. de Rijke, editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross-Language Evaluation Forum (CLEF 2011), pages 95--106. Lecture Notes in Computer Science (LNCS) 6941, Springer, Heidelberg, Germany, 2011.
[19]
T. Tsikrika, B. Larsen, H. Müller, S. Endrullis, and E. Rahm. The Scholarly Impact of CLEF (2000--2009). In P. Forner, H. Müller, R. Paredes, P. Rosso, and B. Stein, editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceedings of the Fourth International Conference of the CLEF Initiative (CLEF 2013), pages 1--12. Lecture Notes in Computer Science (LNCS) 8138, Springer, Heidelberg, Germany, 2013.
[20]
R. Zanibbi, D. W. Oard, A. Agarwal, and B. Mansouri. Overview of ARQMath 2020: CLEF Lab on Answer Retrieval for Questions on Math. In Arampatzis et al. [2020], pages 169--193.
- Report on CLEF 2020
Recommendations
Report on CLEF 2017: Experimental IR Meets Multilinguality, Multimodality, and Interaction
This is a report on the eighth edition of the Conference and Labs of the Evaluation Forum (CLEF 2017), held in early September 2017, in Dublin, Ireland. CLEF was a four day event combining a Conference and an Evaluation Forum. The Conference featured ...
Report on the 13th Conference and Labs of the Evaluation Forum (CLEF 2022): Experimental IR Meets Multilinguality, Multimodality, and Interaction
This is a report on the thirteenth edition of the Conference and Labs of the Evaluation Forum (CLEF 2022), held on September 5--8, 2022, in Bologna, Italy. CLEF was a four-day hybrid event combining a conference and an evaluation forum. The conference ...
Report on CLEF 2015: Experimental IR Meets Multilinguality, Multimodality, and Interaction
This is a report on the sixth edition of the Conference and Labs of the Evaluation Forum (CLEF 2015), held in early September 2015, in Toulouse, France. CLEF was a four day event combining a Conference and an Evaluation Forum. The focus of the ...
Comments
Information & Contributors
Information
Published In
Copyright © 2021 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 August 2021
Published in SIGIR Volume 54, Issue 2
Check for updates
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 28Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
Cited By
View all- López-García GJerez JRibelles NAlba EVeredas F(2023)Explainable clinical coding with in-domain adapted transformersJournal of Biomedical Informatics10.1016/j.jbi.2023.104323139:COnline publication date: 1-Mar-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in