Tijana Janjusevic
ABSTRACT
Following the recent developments in social networking, there is an emerging interest to share experiences online with social peers through multimedia data. Consequently, exponential amount of multimedia information has been generated by everyday users and shared among social peers. As opposed to conventional digital archives, the user generated content archive does not confine to one particular domain and therefore semantic indexing of the content requires the creation of large number of training samples for each semantic query concept. Addressing this problem, we present an interactive multi-concept based browsing and retrieval framework using which users can construct high-level semantic queries based on mid-level primitive features. The proposed framework integrates innovative visualisation methodology developed for browsing, navigating and retrieving information from multimedia database. The framework is user centric and supports interactive formulation of high-level semantic queries for content retrieval using available content annotation. The performance of the proposed framework is evaluated using annotation based on automatic algorithms against Support Vector Machines, Multi-feature classification and particle swarm optimisation based relevance feedback techniques.
- J. Adcock and et al. Fxpal interactive search experiments for TRECVID 2007, 2007. Proceedings of the TREC Video Retrieval Evaluation.Google Scholar
- P. Anderson. What is web 2.0? ideas, technologies and implications for education. JISC Technology and Standards Watch., 2007.Google Scholar
- D. Borth and et al. Navidgator-Similarity Based Browsing for Image & Video Databases. In Proceedings of 31st Annual German Conference on Artificial Intelligence, KI 2008, volume II, pages 22--29, Kaiserslautern, Germany, September 2008. Google ScholarDigital Library
- P. Browne and et al. ibase: Navigating digital library collections. Lecture Notes in Computer Science, Image and Video Retrieval, 4071:510--513, 2006. Google ScholarDigital Library
- K. Chandramouli and E. Izquierdo. Image Retrieval using Particle Swarm Optimization. CRC Press, 2008.Google Scholar
- K. Chandramouli and E. Izquierdo. Semantic structuring and retrieval of event chapters in social photo collections. In Proceedings of the international conference on Multimedia information retrieval, pages 507--516, 2010. Google ScholarDigital Library
- S. Chang, W. Chen, and H. Sundaram. Semantic visual templates: linking visual features to semantics. In Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on, pages 531--535 vol.3, Oct 1998.Google ScholarCross Ref
- S. Chang and et al. Videoq: An automatic content-based video search system using visual cues. In ACM Multimedia97, 1997. Google ScholarDigital Library
- S. Chang and et al. A fully automated content-based video search engine supporting spatiotemporal queries. CirSysVideo, 8(5):602--615, September 1998. Google ScholarDigital Library
- M. Flickner and et al. Query by image and video content: the QBIC system. Computer, 28(9):23--32, Sep 1995. Google ScholarDigital Library
- T. Janjusevic and E. Izquierdo. Visualising the query space of the image collection. In Proceedings of IV09, pages 86--91, 2009. Google ScholarDigital Library
- R. Jesus and et al. Playing games as a way to improve automatic image annotation. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2008.Google Scholar
- T. Kato and et al. A sketch retrieval method for full color image database-query by visual example. In Pattern Recognition, 1992. Vol.I. Conference A: Computer Vision and Applications, Proceedings., 11th IAPR International Conference on, pages 530--533, Aug-3 Sep 1992.Google Scholar
- A. Mueen, R. Zainuddin, and Sapiyan. Miars: A medical image retrieval system. Journal of Medical Systems, 2009. Google ScholarDigital Library
- S. Santini and R. Jain. Integrated browsing and querying for image databases. IEEE MultiMedia, 7(3):26--39, 2000. Google ScholarDigital Library
- M. Sarkar and M. Brown. Graphical fisheye views of graphs. In Proceedings of CHI '92, pages 83--91, 1992. Google ScholarDigital Library
- S. Sav and et al. Interactive experiments in object-based retrieval. In Lecture Notes in Computer Science, pages 1--10. Springer Berlin / Heidelberg, 2006. Google ScholarDigital Library
- G. Smith and et al. Facetmap: A scalable search and browse visualization. IEEE Transactions on Visualization and Computer Graphics, 12(5):797--804, 2006. Google ScholarDigital Library
- J. R. Smith and S. Chang. Visualseek: a fully automated content-based image query system. In MULTIMEDIA '96: Proceedings of the fourth ACM international conference on Multimedia, pages 87--98, New York, NY, USA, 1996. ACM. Google ScholarDigital Library
- C. G. M. Snoek and et al. A learned lexicon-driven paradigm for interactive video retrieval. Multimedia, IEEE Trans. on, 9(2):280--292, Feb. 2007. Google ScholarDigital Library
- D. Stan and I. K. Sethi. eid: a system for exploration of image databases. Information Processing and Management, 39(3):335--361, 2003. Google ScholarDigital Library
- V. Tuulos, J. Scheible, and H. Nyholm. Combining web, mobile phones and public displays in large-scale: Manhattan story mashup. In LNCS, pages 37--54, 2007. Google ScholarDigital Library
- J. Vendrig and et al. Filter image browsing: Interactive image retrieval by using database overviews. Multimedia Tools Appl., 15(1):83--103, 2001. Google ScholarDigital Library
- L. von Ahn and L. Dabbish. Labeling images with a computer game. In CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 319--326, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- Q. Zhang and E. Izquierdo. Combining low-level features for semantic extraction in image retrieval. Eurasip Journal on Advances in Signal Processing, 2007, 2007. Google ScholarDigital Library
- J. Zhou and A. Robles-Kelly. A quasi-random sampling approach to image retrieval. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1--8, June 2008.Google ScholarCross Ref
Index Terms
- Concept based interactive retrieval for social environment
Recommendations
Concept framework for audio information retrieval: ARF
AbstractThe majority of researches on content-based retrieval focused on visual media. However audio is also an important medium and information carrier from the viewpoint of human auditory perception, so it is needed to retrieve for audio collection. ...
Content-based multimedia information retrieval: State of the art and challenges
Extending beyond the boundaries of science, art, and culture, content-based multimedia information retrieval provides new paradigms and methods for searching through the myriad variety of media all over the world. This survey reviews 100+ recent ...
A Relevance Feedback Architecture for Content-based Multimedia Information Retrieval Systems
CAIVL '97: Proceedings of the 1997 Workshop on Content-Based Access of Image and Video Libraries (CBAIVL '97)Content-based multimedia information retrieval (MIR) has become one of the most active research areas in the past few years. Many retrieval approaches based on extracting and representing visual properties of multimedia data have been developed. While ...
Comments