Abstract
In this paper, we are interested in XML multimedia document retrieval, whose aim is to find relevant multimedia components (i.e. XML fragments containing another media than text) that focus on the user needs. The work described here is carried out with images, but can be extended to any other media. We propose an XML multimedia fragment retrieval approach based on two steps. In a first step, we search for relevant images and then we retrieve the best multimedia fragments corresponding to these images. Image retrieval is done using textual and structural information from ascendant, sibling and direct descendant nodes in the XML tree, while multimedia fragment retrieval is done by evaluating the score of ancestors of images retrieved in the first step. Experiments were done on the INEX 2006 and 2007 Multimedia Fragments task and show the interest of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aslandogan, Y.A., Yu, C.T.: Techniques and systems for image and video retrieval. IEEE Trans. on Knowl. and Data Eng., 56–63 (1999)
Denoyer, L., Gallinari, P.: The wikipedia XML corpus. In: SIGIR Forum 2006, pp. 64–69 (2006)
Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.): INEX 2005. LNCS, vol. 3977. Springer, Heidelberg (2006)
Fuhr, N., Lalmas, M., Malik, S., Szlávik, Z. (eds.): INEX 2004. LNCS, vol. 3493. Springer, Heidelberg (2005)
Fuhr, N., Lalmas, M., Trotman, A.: INEX 2006 (2006)
Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.): INEX 2007. LNCS, vol. 4862. Springer, Heidelberg (2008)
Hlaoua, L., Torjmen, M., Pinel-Sauvagnat, K., Boughanem, M.: XFIRM at INEX 2006. Ad-hoc, Relevance Feedback and MultiMedia Tracks. In: INEX [5], pp. 373–386
Iskandar, D.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.: Combining image and structured text retrieval. In: INEX [3]
Iskandar, D.N.F.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M.: Combining image and structured text retrieval. In: INEX [3], pp. 525–539
Iskandar, D.N.F.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M.: Social media retrieval using image features and structured text. In: INEX [5], pp. 358–372
Kamps, J., Pehcevski, J., Kazai, G., Lalmas, M., Robertson, S.: INEX 2007 evaluation measures. In: INEX [6], pp. 24–33
Kong, Z., Lalmas, M.: XML multimedia retrieval. In: Consens, M.P., Navarro, G. (eds.) SPIRE 2005. LNCS, vol. 3772, pp. 218–223. Springer, Heidelberg (2005)
Kong, Z., Lalmas, M.: Using XML logical structure to retrieve (Multimedia) objects. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 100–111. Springer, Heidelberg (2007)
Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 1–19 (2006)
Mass, Y., Mandelbrod, M.: Experimenting various user models for XML retrieval. In: INEX [3]
Pinel-Sauvagnat, K., Boughanem, M., Chrisment, C.: Answering content-and-structure-based queries on XML documents using relevance propagation. In: Information system, Special Issue SPIRE 2004, vol. 31, pp. 621–635 (January 2006)
Sauvagnat, K., Boughanem, M., Chrisment, C.: Searching XML documents using relevance propagation. LNCS. Springer, Heidelberg (2004)
Sauvagnat, K., Hlaoua, L., Boughanem, M.: XFIRM at INEX 2005: Ad-hoc and relevance feedback tracks. LNCS. Springer, Heidelberg (2006)
Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1349–1380 (2000)
Tjondronegoro, D., Zhang, J., Gu, J., Nguyen, A., Geva, S.: Integrating text retrieval and image retrieval in XML document searching. In: INEX [3], pp. 511–524
Tsikrika, T., Serdyukov, P., Rode, H., Westerveld, T., Aly, R., Hiemstra, D., de Vries, A.P.: Structured Document Retrieval, Multimedia Retrieval, and Entity Ranking Using PF/Tijah. In: INEX [6], pp. 273–286.
Tsikrika, T., Westerveld, T.: Report on the INEX 2007 multimedia track. In: INEX [6], pp. 410–422
van Zwol, R.: Multimedia strategies for \(^{\mbox{3}}\)-sdr, based on principal component analysis. In: INEX [3], pp. 540–553
van Zwol, R., Kazai, G., Lalmas, M.: INEX 2005 multimedia track. In: INEX [3]
Westerveld, T., van Zwol, R.: The INEX 2006 multimedia track. In: INEX [5], pp. 331–344
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Torjmen, M., Pinel-Sauvagnat, K., Boughanem, M. (2009). XML Multimedia Retrieval: From Relevant Textual Information to Relevant Multimedia Fragments. In: Boughanem, M., Berrut, C., Mothe, J., Soule-Dupuy, C. (eds) Advances in Information Retrieval. ECIR 2009. Lecture Notes in Computer Science, vol 5478. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00958-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-00958-7_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00957-0
Online ISBN: 978-3-642-00958-7
eBook Packages: Computer ScienceComputer Science (R0)