Skip to main content
SpringerLink
Log in

The LEMO annotation framework: weaving multimedia annotations with the web

  • Regular Paper
  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

Cultural institutions and museums have realized that annotations contribute valuable metadata for search and retrieval, which in turn can increase the visibility of the digital items they expose via their digital library systems. By exploiting annotations created by others, visitors can discover content they would not have found otherwise, which implies that annotations must be accessible and processable for humans and machines. Currently, however, there exists no widely adopted annotation standard that goes beyond specific media types. Most institutions build their own in-house annotation solution and employ proprietary annotation models, which are not interoperable with those of other systems. As a result, annotation data are usually stored in closed data silos and visible and processable only within the scope of a certain annotation system. As the main contribution of this paper, we present the LEMO Annotation Framework. It (1) provides a uniform annotation model for multimedia contents and various types of annotations, (2) can address fragments of various content-types in a uniform, interoperable manner and (3) pulls annotations out of closed data silos and makes them available as interoperable, dereferencable Web resources. With the LEMO Annotation Framework annotations become part of the Web and can be processed, linked, and referenced by other services. This in turn leads to even higher visibility and increases the potential value of annotations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Adobe Inc.: Adobe acrobat professional. http://www.adobe.com/products/acrobatpro/

  2. Agosti, M., Benfante, L., Orio, N.: Ipsa: A digital archive of herbals to support scientific research. In: Proceedings of the International Conference on Asian Digital Libraries (ICADL), pp. 253–264 (2003)

  3. Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A.M., Thiel, U.: DiLAS: a digital library annotation service. In: Proceedings of Annotation for Collaboration—A Workshop on Annotation Models, Tools and Practices (2005)

  4. Agosti M., Ferro N.: Annotations: Enriching a digital library. In: Koch, T., Sølvberg, I.(eds) ECDL, Lecture Notes in Computer Science, vol. 2769, pp. 88–100. Springer, Berlin (2003)

    Google Scholar 

  5. Agosti M., Ferro N.: Annotations as context for searching documents. In: Crestani, F., Ruthven, I.(eds) CoLIS, Lecture Notes in Computer Science, vol. 3507, pp. 155–170. Springer, Berlin (2005)

    Google Scholar 

  6. Agosti M., Ferro N.: Search strategies for finding annotations and annotated documents: The fast service. In: Larsen, H.L., Pasi, G., Arroyo, D.O., Andreasen, T., Christiansen, H.(eds) FQAS, Lecture Notes in Computer Science, vol. 4027, pp. 270–281. Springer, Berlin (2006)

    Google Scholar 

  7. Agosti, M., Ferro, N.: A formal model of annotations of digital content. ACM Trans. Inf. Syst. 26(1) (2007)

  8. Agosti M., Ferro N., Frommholz I., Thiel U.: Annotations in digital libraries and collaboratories—facets, models and usage. In: Heery, R., Lyon, L.(eds) ECDL, Lecture Notes in Computer Science, vol. 3232, pp. 244–255. Springer, Berlin (2004)

    Google Scholar 

  9. Baker, T., Dekkers, M., Heery, R., Patel, M., Salokhe, G.: What terms does your metadata use? Application profiles as machine-understandable narratives. J. Digit. Inform. 2(2) (2001). http://jodi.ecs.soton.ac.uk/Articles/v02/i02/Baker/

  10. Berners-Lee, T.: Linked data (2006). http://www.w3.org/DesignIssues/LinkedData.html

  11. Bottoni, P., Levialdi, S., Labella, A., Panizzi, E., Trinchese, R., Gigli, L.: Madcow: a visual interface for annotating web pages. In: AVI ’06: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 314–317. ACM Press, New York (2006)

  12. Brocks, H., Stein, A., Thiel, U., Frommholz, I., Dirsch- Weigand, A.: How to incorporate collaborative discourse in cultural digital libraries. In: Proceedings of the ECAI 2002 Workshop on Semantic Authoring, Annotation & Knowledge Markup (SAAKM02), Lyon, France (2002)

  13. Brush, A.J.B., Bargeron, D., Gupta, A., Cadiz, J.J.: Robust annotation positioning in digital documents. In: CHI, pp. 285–292 (2001)

  14. Bush V.: As we may think. Atl. Mon. 176(1), 101–108 (1945)

    Google Scholar 

  15. Candela, L., Castelli, D., Ferro, N., Ioannidis, Y., Koutrika, G., Meghini, C., Pagano, P., Ross, S., Soergel, D., Agosti, M., Dobreva, M., Katifori, V., Schuldt, H.: The DELOS digital library reference model—foundations for digital libraries, version 0.98. Tech. rep., DELOS—A Network of Excellence on Digital Libraries (2007). http://www.delos.info/files/pdf/ReferenceModel/DELOS_DLReferenceModel_0.98.pdf

  16. DCMI: Dublin Core Metadata Element Set, Version 1.1. Dublin Core Metadata Initiative (2006). http://dublincore.org/documents/dces/

  17. Denoue, L., Vignollet, L.: An annotation tool for web browsers and its applications to information retrieval (2000)

  18. Frisse, M.E.: Searching for information in a hypertext medical handbook. In: Hypertext’87 Proceedings, November 13–15, 1987, Chapel Hill, North Carolina, USA, pp. 57–66. ACM, New York (1987)

  19. Frommholz, I., Fuhr, N.: Probabilistic, object-oriented logics for annotation-based retrieval in digital libraries. In: JCDL ’06: Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 55–64. ACM, New York, NY, USA (2006)

  20. Frommholz, I., Fuhr, N.: Probabilistic, object-oriented logics for annotation-based retrieval in digital libraries. In: Marchionini, G., Nelson, M.L., Marshall, C.C. (eds.) JCDL, pp. 55–64. ACM, New York (2006)

  21. Geurts, J., van Ossenbruggen, J., Hardman, L.: Requirements for practical multimedia annotation. In: Workshop on Multimedia and the Semantic Web, pp. 4–11. Heraklion, Crete (2005). http://www.cwi.nl/~media/publications/MMSemweb2005.pdf

  22. Gonçalves M.A., Fox E.A., Watson L.T., Kipp N.A.: Streams, structures, spaces, scenarios, societies (5s): a formal model for digital libraries. ACM Trans. Inf. Syst. 22(2), 270–312 (2004)

    Article  Google Scholar 

  23. Google Inc.: Google notebook. http://www.google.com/notebook/

  24. Grahl Software Design: Pdf annotator. http://www.ograhl.com/en/pdfannotator/

  25. Heery, R., Patel, M.: Application profiles: mixing and matching metadata schemas (2000). http://www.ariadne.ac.uk/issue25/app-profiles/

  26. Hunter, J., Schroeter, R., Guerin, J., Henderson, M.: Vannotea. http://www.itee.uq.edu.au/~eresearch/projects/vannotea/index.html

  27. ISO/IEC: Introducing MPEG-21 Part 17—An Overview. International Organization for Standardization—MPEG Working Group (ISO/IEC JTC 1/SC 29/WG 11/N7221) (2005). http://www.chiariglione.org/mpeg/technologies/mp21-fid/index.htm.htm

  28. ISO/IEC: Multimedia framework (MPEG-21)—Part 17: Fragment Identification of MPEG Resources. (International Organization for Standardization, Geneva 2006)

  29. Jacobs, I., Walsh, N.: Architecture of the World Wide Web, Volume One (2004). http://www.w3.org/TR/webarch/

  30. Jochum, W.: Requirements of fragment identification. In: International Conferences on New Media Technology and Semantic Systems, pp. 172–179. Springer, Berlin (2007)

  31. Jochum W., Kaiser M., Schellner K., Wirl F.: Living memory annotation tool—image annotations for digital libraries. In: Kovács, L., Fuhr, N., Meghini, C.(eds) ECDL, Lecture Notes in Computer Science, vol. 4675, pp. 549–550. Springer, Berlin (2007)

    Google Scholar 

  32. Kahan, J., Koivunen, M.R.: Annotea: an open RDF infrastructure for shared Web annotations. In: WWW ’01: Proceedings of the 10th International Conference on World Wide Web, pp. 623–632. ACM Press, New York (2001)

  33. Kautz, H., Selman, B., Shah, M.: Referral web: combining social networks and collaborative filtering. Commun. ACM 40(3), 63–65 (1997). http://doi.acm.org/10.1145/245108.245123

  34. Koivunen, M.R.: Semantic authoring by tagging with annotea social bookmarks and topics. In: The 5th International Semantic Web Conference (ISWC2006)—1st Semantic Authoring and Annotation Workshop (SAAW2006), Athens (2006)

  35. Kruk S.R., Decker S., Decker L.Z.S., Zieborak L.: Jeromedl—adding semantic web technologies to digital libraries. In: Andersen, K.V., Debenham, J.K., Wagner, R.(eds) DEXA, Lecture Notes in Computer Science, vol. 3588, pp. 716–725. Springer, Berlin (2005)

    Google Scholar 

  36. Lagoze C., Payette S., Shin E., Payette C.W.S., Shin E., Wilper C.: Fedora: an architecture for complex objects and their relationships. Int. J. Digit. Libr. 6(2), 124–138 (2006)

    Article  Google Scholar 

  37. Library of Congress: Library of Congress Subject Headings (LCSH) (2007). http://www.loc.gov/aba/cataloging/subject/

  38. Marshall, C.C.: Annotation: from paper books to the digital library. In: DL ’97: Proceedings of the Second ACM International Conference on Digital Libraries, pp. 131–140. ACM Press, New York (1997)

  39. Marshall, C.C.: Toward an ecology of hypertext annotation. In: UK Conference on Hypertext, pp. 40–49 (1998)

  40. Marshall, C.C.: The future of annotation in a digital (paper) world. In: Twidale, H. (eds.) Successes and Failures of Digital Libraries, pp. 97–117. Urbana-Champaign, University of Illinois (2000). http://www.csdl.tamu.edu/~marshall/uiucpaper-complete.pdf

  41. Marshall, C.C., Brush, B.A.J.: Exploring the relationship between personal and public annotations. In: JCDL ’04: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 349–357. ACM Press, New York (2004)

  42. Maryland Information and Network Dynamics Lab Semantc Web Agents Project (MINDSWAP): Photostuff project homepage. http://www.mindswap.org/2003/PhotoStuff/

  43. Mojiti Inc.: Mojiti. http://mojiti.com

  44. Nichols D.M., Pemberton D., Dalhoumi S., Larouk O., Belisle C., Twidale M.: Debora: Developing an interface to support collaboration in a digital library. In: Borbinha, J.L., Baker, T.(eds) ECDL, Lecture Notes in Computer Science, vol. 1923, pp. 239–248. Springer, Berlin (2000)

    Google Scholar 

  45. OCLC Online Computer Library Center: Dewey Decimal Classification (DDC) (2007). http://www.oclc.org/dewey/

  46. Ovsiannikov I.A., Arbib M.A., McNeill T.H.: Annotation technology. Int. J. Hum.-Comput. Stud. 50(4), 329–362 (1999)

    Article  Google Scholar 

  47. Payette, S., Lagoze, C.: Flexible and extensible digital object and repository architecture (fedora). In: ECDL ’98: Proceedings of the Second European Conference on Research and Advanced Technology for Digital Libraries, pp. 41–59. Springer, London (1998)

  48. Petridis, K., Anastasopoulos, D., Saathoff, C., Timmermann, N., Kompatsiaris, Y., Staab, S.: M-ontomat-annotizer: Image annotation linking ontologies and multimedia low-level features. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds.) KES (3), Lecture Notes in Computer Science, vol. 4253, pp. 633–640. Springer, Berlin (2006)

  49. Pfeiffer, S., Parker, C., Pang, A.: Specifying time intervals in uri queries and fragments of time-based web resources. Network Working Group, Internet-Draft (2005). http://www.annodex.net/TR/URI_fragments.html

  50. Phelps, T., Wilensky, R.: Robust intra-document locations (2000). http://www9.org/w9cdrom/312/312.html

  51. Phelps, T.A., Wilensky, R.: Multivalent annotations. In: European Conference on Digital Libraries, pp. 287–303 (1997)

  52. Salembier, P., Smith, J.: Mpeg-7 multimedia description schemes. In: IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, pp. 748–759 (2001)

  53. Schilit, B.N., Golovchinsky, G., Price, M.N.: Beyond paper: Supporting active reading with free form digital ink annotations. In: CHI, pp. 249–256 (1998)

  54. Schroeter, R., Hunter, J., Newman, A.: Annotating relationships between multiple mixed-media digital objects by extending annotea. In: Franconi, E., Kifer, M., May, W. (eds.) ESWC, vol. 4519. Springer, Berlin (2007)

  55. The Bricks Community: BRICKS—Building Resources for Integrated Cultural Knowledge Services (2007). http://www.brickscommunity.org

  56. The FotoNotes Project: Fotonotes. http://www.fotonotes.net/

  57. Troncy, R., Harman, L., van Ossenbruggen, J., Hausenblas, M.: Identifying spatial and temporal media fragments on the web. In: W3C Video on the Web Workshop (2007). http://www.w3.org/2007/08/video/papers

  58. Viddler Inc.: Viddler. http://www.viddler.com

  59. Wilde, E., Baschnagel, M.: Fragment identifiers for plain text files. In: HYPERTEXT ’05: Proceedings of the sixteenth ACM conference on Hypertext and hypermedia, pp. 211–213. ACM Press, New York (2005)

  60. Witten, I.H., Boddie, S.J., Bainbridge, D., McNab, R.J.: Greenstone: a comprehensive open-source digital library software system. In: DL ’00: Proceedings of the fifth ACM conference on Digital libraries, pp. 113–121. ACM Press, New York (2000). doi:10.1145/336597.336650

  61. Wu, X., Zhang, L., Yu, Y.: Exploring social annotations for the semantic web. In: WWW ’06: Proceedings of the 15th International Conference on World Wide Web, pp. 417–426. ACM Press, New York (2006)

  62. Yahoo Inc.: Flickr. http://www.flickr.com

  63. Zoomify Inc.: Zoomify annotation system. http://www.zoomify.com/enterprise.htm#productDetails

Download references

Author information

Authors and Affiliations

  1. Department of Distributed and Multimedia Systems, University of Vienna, Vienna, Austria

    Bernhard Haslhofer & Wolfgang Jochum

  2. Digital Memory Engineering, Austrian Research Centers GmbH, ARC, Seibersdorf, Austria

    Ross King & Christian Sadilek

  3. Vienna, Austria

    Karin Schellner

Authors
  1. Bernhard Haslhofer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wolfgang Jochum
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ross King
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christian Sadilek
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Karin Schellner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bernhard Haslhofer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Haslhofer, B., Jochum, W., King, R. et al. The LEMO annotation framework: weaving multimedia annotations with the web. Int J Digit Libr 10, 15–32 (2009). https://doi.org/10.1007/s00799-009-0050-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-009-0050-8

Keywords

Search

Navigation