Skip to main content
SpringerLink
Log in
Book cover

International Conference on Agents and Artificial Intelligence

ICAART 2017: Agents and Artificial Intelligence pp 205–221Cite as

Advanced User Interfaces for Semantic Annotation of Complex Relations in Text

  • Conference paper
  • First Online:

  • 395 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10839))

Abstract

This paper deals with computer-assisted semantic annotation of text. It particularly focuses on the annotation of complex relations and linking of entities with highly ambiguous names. These tasks cannot be reliably accomplished by fully automatic methods today. Our research explores user interface features that can help the manual annotation process. We extend our original experiments published in [5] by a detailed analysis of advantages brought by the semantic filtering feature of our 4A annotation system. We also expand our user study on the annotation of highly ambiguous entities showing speed-ups brought by a presentation mode for entity candidates employing advanced disambiguation contexts.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.alchemyapi.com.

  2. 2.

    http://cogitoapi.com.

  3. 3.

    http://s4.ontotext.com.

  4. 4.

    http://knot.fit.vutbr.cz/annotations/comparison.html.

  5. 5.

    http://web-ngram.research.microsoft.com/erd2014/.

  6. 6.

    http://alt.qcri.org/semeval2015/task10/.

  7. 7.

    http://nlp.cs.rpi.edu/kbp/2015/index.html.

  8. 8.

    http://blog.commoncrawl.org.

  9. 9.

    http://blog.commoncrawl.org/2014/12/.

  10. 10.

    https://code.google.com/p/wiki-links/.

  11. 11.

    http://knot.fit.vutbr.cz/annotations/.

  12. 12.

    http://rdface.aksw.org/.

  13. 13.

    https://gate.ac.uk/teamware.

  14. 14.

    https://gate.ac.uk/wiki/crowdsourcing.html.

  15. 15.

    https://gate.ac.uk/family/developer.html.

References

  1. Bontcheva, K., Cunningham, H., Roberts, I., Roberts, A., Tablan, V., Aswani, N., Gorrell, G.: GATE Teamware: a web-based, collaborative text annotation framework. Lang. Resour. Eval. 47(4), 1007–1029 (2013). https://doi.org/10.1007/s10579-013-9215-6

    Article  Google Scholar 

  2. Bontcheva, K., Roberts, I., Derczynski, L., Rout, D.: The GATE crowdsourcing plugin: crowdsourcing annotated corpora made easy. In: Proceedings of Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pp. 97–100. Association for Computational Linguistics (2014)

    Google Scholar 

  3. Ciccarese, P., Ocana, M., Clark, T.: Open semantic annotation of scientific publications using DOMEO. J. Biomed. Semant. 3(Suppl. 1) (2012). http://www.jbiomedsem.com/content/3/S1/S1

  4. Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V., Aswani, N., Roberts, I., Gorrell, G., Funk, A., Roberts, A., Damljanovic, D., Heitz, T., Greenwood, M.A., Saggion, H., Petrak, J., Li, Y., Peters, W.: Text Processing with GATE (Version 6). GATE (2011). http://tinyurl.com/gatebook

  5. Dytrych, J., Smrz, P.: Interaction patterns in computer-assisted semantic annotation of text - an empirical evaluation. In: Proceedings of the 8th International Conference on Agents and Artificial Intelligence. SCITEPRESS, Rome, Italy (2016)

    Google Scholar 

  6. Grassi, M., Morbidoni, C., Nucci, M., Fonda, S., Donato, F.D.: Pundit: creating, exploring and consuming semantic annotations. In: Proceedings of the 3rd International Workshop on Semantic Digital Archives, Valletta, Malta (2013)

    Google Scholar 

  7. Handschuh, S., Staab, S., Ciravegna, F.: S-CREAM — semi-automatic CREAtion of metadata. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, pp. 358–372. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45810-7_32

    Chapter  Google Scholar 

  8. Heese, R., Luczak-Rsch, M., Paschke, A., Oldakowski, R., Streibel, O.: One click annotation. In: Proceedings of the 6th Workshop on Scripting and Development for the Semantic Web, collocated with ESWC. Ruzica Piskac, Redaktion Sun SITE, Informatik V, RWTH Aachen, Ahornstr. 55, 52056 Aachen, Germany (2010)

    Google Scholar 

  9. Khalili, A., Auer, S., Hladky, D.: The RDFa Content Editor - From WYSIWYG to WYSIWYM. In: Proceedings of COMPSAC 2012 - Trustworthy Software Systems for the Digital Society (2012). http://svn.aksw.org/papers/2012/COMPSAC_RDFaCE/public.pdf

  10. Maynard, D.: Benchmarking textual annotation tools for the semantic web. In: 6th International Conference on Language Resources and Evaluation. European Language Resources Association (ELRA), Marrakech, Morocco (2008). https://gate.ac.uk/sale/lrec2008/benchmarking.pdf

  11. Maynard, D., Dasiopoulou, S., Costache, S., Eckert, K., Stuckenschmidt, H., Dzbor, M., Handschuh, S.: Knowledge web project: Deliverable D1.2.2.1.3 - Benchmarking of annotation tools (2007). http://knowledgeweb.semanticweb.org/semanticportal/deliverables/D1.2.2.1.3.pdf

  12. Moro, A., Navigli, R.: SemEval-2015 Task 13: Multilingual all-words sense disambiguation and entity linking. In: Proceedings of the 9th International Workshop on Semantic Evaluation, Denver, Colorado, pp. 288–297, June 2015. http://www.aclweb.org/anthology/S15-2049

  13. Piccinno, F., Ferragina, P.: From TagME to WAT: a new entity annotator. In: Proceedings of the First International Workshop on Entity Recognition & Disambiguation, pp. 55–62. ACM (2014)

    Google Scholar 

  14. Reeve, L., Han, H.: Survey of semantic annotation platforms. In: Proceedings of the 2005 ACM Symposium on Applied Computing, SAC 2005, pp. 1634–1638. ACM, New York (2005). https://doi.org/10.1145/1066677.1067049

  15. Röder, M., Usbeck, R., Ngomo, A.-C.N.: Developing a sustainable platform for entity annotation benchmarks. In: Gandon, F., Guéret, C., Villata, S., Breslin, J., Faron-Zucker, C., Zimmermann, A. (eds.) ESWC 2015. LNCS, vol. 9341, pp. 190–196. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25639-9_36. http://svn.aksw.org/papers/2015/ESWC GERBIL semdev/public.pdf

    Chapter  Google Scholar 

  16. Smrz, P., Dytrych, J.: Towards new scholarly communication: A case study of the 4A framework. In: SePublica. CEUR Workshop Proceedings, vol. 721. Ruzica Piskac, Redaktion Sun SITE, Informatik V, RWTH Aachen, Ahornstr. 55, 52056 Aachen, Germany (2011)

    Google Scholar 

  17. Smrz, P., Dytrych, J.: Advanced features of collaborative semantic annotators - the 4A system. In: Proceedings of the 28th International FLAIRS Conference. AAAI Press, Hollywood, Florida, USA (2015)

    Google Scholar 

  18. Stenetorp, P., Pyysalo, S., Topić, G., Ohta, T., Ananiadou, S., Tsujii, J.: BRAT: a web-based tool for NLP-assisted text annotation. In: Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL 12, pp. 102–107 (2012). Association for Computational Linguistics, Stroudsburg, PA, USA. http://dl.acm.org/citation.cfm?id=2380921.2380942

  19. Surdeanu, M., Heng, J.: Overview of the English slot filling track at the TAC2014 knowledge base population evaluation. In: Proceedings of the TAC-KBP 2014 Workshop (2014)

    Google Scholar 

  20. Wang, A., Hoang, C., Kan, M.Y.: Perspectives on crowdsourcing annotations for natural language processing. Lang. Resour. Eval. 47(1), 9–31 (2013). https://doi.org/10.1007/s10579-012-9176-1

    Article  Google Scholar 

  21. Yee, K.P.: Critlink: Advanced hyperlinks enable public annotation on the web (2002). http://zesty.ca/pubs/cscw-2002-crit.pdf, http://zesty.ca/pubs/cscw-2002-crit.pdf

Download references

Acknowledgements

This work was supported by the H2020 project MixedEmotions, grant agreement No. 644632, and by The Ministry of Education, Youth and Sports of the Czech Republic from the National Programme of Sustainability (NPU II); project IT4Innovations Excellence in Science – LQ1602.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Centre of Excellence IT4Innovations, Brno University of Technology, Bozetechova 2, 61266, Brno, Czech Republic

    Jaroslav Dytrych & Pavel Smrz

Authors
  1. Jaroslav Dytrych
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pavel Smrz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Jaroslav Dytrych or Pavel Smrz .

Editor information

Editors and Affiliations

  1. Leiden University, Leiden, The Netherlands

    Jaap van den Herik

  2. University of Porto, Porto, Portugal

    Ana Paula Rocha

  3. INSTICC, Polytechnic Institute of Setúbal, Setubal, Portugal

    Joaquim Filipe

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dytrych, J., Smrz, P. (2018). Advanced User Interfaces for Semantic Annotation of Complex Relations in Text. In: van den Herik, J., Rocha, A., Filipe, J. (eds) Agents and Artificial Intelligence. ICAART 2017. Lecture Notes in Computer Science(), vol 10839. Springer, Cham. https://doi.org/10.1007/978-3-319-93581-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93581-2_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93580-5

  • Online ISBN: 978-3-319-93581-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation