Abstract
Multimedia mobile devices have created new possibilities for developing and accessing a variety of multimedia items such as images, audio and video clips. Personal multimedia items are, nowadays, being consumed at an enormous rate. Therefore, the management of these media items has become a pressing problem. In this paper, a client-server content-based image retrieval framework for mobile platforms is developed, which provides the capability of content-based query and browsing from mobile devices. The proposed framework provides an adaptive user interface and a generic structure, which supports a wide range of mobile devices. In this framework, a client requests the server for retrieval of particular images with a particular content. The server performs a content-based retrieval of images from a selected database and streams the retrieved results back to the client in an efficient way. The query results are transmitted over a wireless network and a certain number of similar images are rendered on the mobile device screen using thumbnail sizes. The proposed framework serves as a basis of content-based image retrieval on mobile devices. It addresses several important challenges such as hardware and software limitations as well as efficient use of the available network bandwidth.
Similar content being viewed by others
References
Ahmad I, Kiranyaz S, Gabbouj M (2005) An efficient image retrieval scheme on java enabled mobile devices, MMSP 05, International Workshop on Multimedia Signal Processing, Shanghai, China, November
Alipr. http://wwwalipr.com/
Arreymbi J, Dastbaz M (2002) South Bank University, “Issues in delivering multimedia content to mobile devices”, Sixth International Conference on Information Visualisation (IV’02), London, England, July, pp 622
Boll S, Westermann U (2003) Meeting experience: MediaEther: an event space for context-aware multimedia experiences. Proc ACM SIGMM 2003 Workshop on Experiential Telepresence, Berkeley, CA, November, 2003, pp 21–30
Chandrasekharan P, Joshi A (2002) MobileIQ: a framework for mobile information access. Proc Mobile Data Management Conference, Singapore, Jan
Chopra V, Bakore A, Eaves J, Galbraith B, Li S, Wiggers C (2004) Professional apache tomcat 5, published by Wrox, May, ISBN 0764559028
Deitel HM, Deitel PJ, Deitel HM, Deitel PJ (1999) Java how to program, 5th edition, published by Prentice Hall, December
Facebook. http://www.facebook.com/
Flickr. http://www.flickr.com/
Gandhi B, Martinez A, Bentley F (2004) Intelligent multimedia content management on mobile devices, Multimedia and Expo, 2004. ICME ‘04, 2004 IEEE International Conference, Taipei, Taiwan. June, 3:1703–1706
Guldogan O, Gabbouj M (2005) Content-based image indexing and Retrieval framework on Symbian based mobile platform, European Signal Processing Conference, EUSIPCO 2005, Antalya, Turkey, September
Keogh J (2003) The complete reference J2ME, published by McGrawHill OSBORNE Edition. Feb 27. ISBN: 0072227109
Kim CY, Lee JK, Cho YH, Kim DH (2004) VISCORS: a visual-content recommender for the mobile web. IEEE Intell Syst 19(6):32–39
Kiranyaz S, Gabbouj M (2006) Interactive query implementation over high precision progressive query scheme. In Proc of WIAMIS Workshop 2006, Korea, 19–21 April
Kiranyaz S, Gabbouj M (2007) Hierarchical cellular tree: an efficient indexing scheme for content-based retrieval on multimedia databases. IEEE Trans Multimed 9(1):102–119
Kodakgallery. http://www.kodakgallery.com/
Kurz B, Popescu I, Gallacher S (2004) FAÇADE—a framework for context-aware content adaptation and delivery. Communication Networks and Services Research Conference (CNSR 2004), Fredericton, N.B., Canada, May
Li S, Houle P, Wilcox M, Phillips R, Mohseni P, Zeiger S, Bergsten H, Ferris M, Ayers D (1999) Professional java server programming, published by Peer Information Inc., August, ISBN: 1861002777
Linux Devices. http://www.linuxdevices.com/
Manjunath BS, Ohm JR, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circ Syst Vid Technol 11(6):703–715
Manjunath BS, Salembier P, Sikora T. Introduction to MPEG-7 Multimedia content description interface, published by John Wiley & Sons, LTD., ISBN 047148678 7
MarkUp. http://www.w3.org/MarkUp/
MS Windows mobile. http://www.microsoft.com/windowsmobile/
MUVIS. http://muvis.cs.tut.fi/
Nokia. http://www.nokia.com/
Nokia Energy Profiler. http://www.forum.nokia.com/Tools_Docs_and_Code/Tools/Plugins/Enablers/Nokia_Energy_Profiler/
OVI. http://www.ovi.com/
Partio M, Cramariuc B, Gabbouj M, Visa A (2002) Rock texture retrieval using gray level co-occurrence matrix. In Proc of 5th Nordic Signal Processing Symposium, Trondheim, Norway, October
Pentland A, Picard RW, Sclaroff S (1994) Photobook: tools for content based manipulation of image databases. Proc SPIE (Storage and Retrieval for Image and Video Databases II), April
Pham B, Wong O (2004) Computer human interface: “Handheld devices for applications using dynamic multimedia data” Proc. 2nd International Conference on Computer Graphics and Interactive Techniques in Austalasia and South East Asia, Singapore, June, 2004, pp 123–130
Photobucket. http://photobucket.com/
Roth V (1999) Panel: content–based image indexing and retrieval with mobile agents. ASAMA ‘99 Proceedings of the First International Symposium on Agent Systems and Applications and Third International Symposium on Mobile Agents. Palm Springs, California USA October, pp 260
Sarvas R, HerrarteE, Wilhelm A, Davis M (2004) Metadata creation system for mobile images. Proc of the 2nd international conference on Mobile systems, applications, and services, MobiSys, Boston USA, June, pp 36–48
Sarvas R, Viikari M, Pesonen J, Nevanlinna H (2004) MobShare: controlled and immediate sharing of mobile images. In Proc of Multimedia 2004, ACM, New York, NY, USA, October, pp 724–731
Smith JR, Chang SF (1996) VisualSEEk: a fully automated content-based image query system. ACM Multimedia, Boston, November
Sorvari A, Jalkanen J, Jokela R, Black A, Koli K, Moberg M, Keinonen T (2004) Usability issues in utilizing context metadata in content management of mobile devices. NORDICHI, Tampere, Finland, October 2004
Stumbleupon. http://www.stumbleupon.com/
Symbian OS. http://www.symbian.com/
Tollmar K, Yeh T, Darrell T (2004) IDeixis: image-based Deixis for finding location-based information. Mobile HCI, Vienna, pp 781–782
Virage. http://www.virage.com/
WebShot. http://www.webshots.com/
Wong C (2000) HTTP pocket reference, (Pocket Reference (O’Reilly)) published by O’Reilly. June. ISBN: 1565928628
YouTube. http://www.YouTube.com/
3gpp. http://www.3gpp.org/
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ahmad, I., Gabbouj, M. A generic content-based image retrieval framework for mobile devices. Multimed Tools Appl 55, 423–442 (2011). https://doi.org/10.1007/s11042-010-0556-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0556-5