Skip to main content

Advertisement

SpringerLink
Log in

Personalized multi-modality image management and search for mobile devices

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Mobile devices are quickly becoming a primary medium for personal information gathering, management, and sharing. Managing personal image data on mobile platforms is a challenging problem due to large data set size, content and context diversity, heterogeneous individual usage patterns, and resource constraints. This article presents a user-centric system, called iScope, for personal image management and sharing on mobile devices. iScope uses multi-modality clustering of both content and context information for efficient image management and search, and online learning techniques for predicting images of interest. It also supports distributed image search among networked devices while maintaining the same intuitive interface, enabling efficient information sharing among people. We have implemented iScope and conducted infield experiments using networked Nokia N810 portable Internet tablets. Energy efficiency was a primary design focus during the design and implementation of the iScope search algorithms. Experimental results demonstrate that iScope improves search time and search energy by 4.1× and 3.8× on average, relative to browsing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  1. American museum. http://americanhistory.si.edu/

  2. Measuring the information society (2011) International Telecommunications Union, Sept

  3. Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):1–60

    Google Scholar 

  4. Zhu C, Li K, Lv Q, Shang L, Dick RP (2009) iScope: personalized multi-modality image search for mobile devices. In: MobiSys’09, pp 277–290

  5. Widyantoro DH, Ioerger TR, Yen J (2002) An incremental approach to building a cluster hierarchy. In: ICDM ’02: proceedings of the 2002 IEEE international conference on data mining

  6. Lv Q, Charikar M, Li K, Kai (2004) Image similarity search with compact data structures. In: Proc. of the 13th ACM conf. on information and knowledge management, Nov

  7. Dalal M (2007) Personalized social & real-time collaborative search. In: Proc. of the 16th intl. conf. on World Wide Web

  8. Bao S, Xue G, Wu X, Yu Y, Fei B, Su Z (2007) Optimizing web search using social annotations. In: Proc. of the 16th intl. conf. on World Wide Web

  9. Heymann P, Koutrika G, Garcia-Molina H (2008) Can social bookmarking improve web search? In: Proceedings of 1st ACM international conference on web search and data mining

  10. Joels A (2006) RFID security and privacy: a research survey. IEEE J Sel Areas Commun (J-SAC) 24(2):381–395

    Google Scholar 

  11. Heikkila FM (2007) Encryption: security considerations for portable media devices. Secur Priv IEEE 5(4):22–27

    Google Scholar 

  12. Berry E, Kapur N, Williams L, Hodges S, Watson P, Smyth G, Srinivasan J, Smith R, Wilson B, Wood K The use of a wearable camera, sensecam, as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: a preliminary report

  13. Heesch D (2008) A survey of browsing models for content based image retrieval. Multimedia Tools Appl 40:261–284

    Article  Google Scholar 

  14. Ardizzone MME, La Cascia M, Vella F (2010) Three-domain image representation for personal photo album management. In: Proc. SPIE 7540, 75400Y

  15. Jia M, Fan X, Xie X, Li M, Ma W-Y (2006) Photo-to-search: using camera phones to inquire of the surrounding world. In: MDM ’06: proceedings of the 7th international conference on mobile data management, p 46

  16. Ahmad I, Abdullah S, Kiranyaz S, Gabbouj M (2005) Content-based image retrieval on mobile devices. In: Proc. of SPIE, vol 5684, Jan 2005

  17. Mattias Rost HC, Holmquist L (2011) Mobile exploration of geotagged photographs. Pers Ubiquitous Comput 16(6):665–676

    Google Scholar 

  18. Anguera X, Xu J, Oliver N (2008) Multimodal photo annotation and retrieval on a mobile phone. In: Proceeding of the 1st ACM international conference on multimedia information retrieval

  19. Chakraborty S, Dong Y, Yau DKY, Lui JC (2006) On the effectiveness of movement prediction to reduce energy consumption in wireless communication. IEEE Trans Mob Comput 5(2):157–169

    Google Scholar 

  20. Karagiannis T, Boudec J-YL, Vojnović M (2007) Power law and exponential decay of inter contact times between mobile devices. In: MobiCom’07, pp 183–194

  21. Kumar K, Nimmagadda Y, Hong Y-J, Lu Y-H (2008) Energy conservation by adaptive feature loading for mobile content-based image retrieval. In: Proc. of the 13th intl. symposium on low power electronics and design

  22. Hoi SCH, Lyu MR, Jin R (2006) A unified log-based relevance feedback scheme for image retrieval. IEEE Trans Knowl Data Eng 18:509–524

    Article  Google Scholar 

  23. Liu W, Jiang W, Chang S-F (2008) Relevance aggregation projections for image retrieval. In: Proc. of the 2008 intl. conf. on content-based image and video retrieval. ACM, pp 119–126

  24. Yang C, Dong M, Fotouhi F (2005) Semantic feedback for interactive image retrieval. In: MULTIMEDIA’05, pp 415–418

  25. Saha SK, Das AK, Chanda B (2007) Image retrieval based on indexing and relevance feedback. Pattern Recogn Lett 28(3):357–366

    Google Scholar 

  26. Sobti S, Garg N, Zheng F, Lai J, Shao Y, Zhang C, Ziskind E, Krishnamurthy A, Wang RY Segank: a distributed mobile storage system. In: Proc. of the 3rd USENIX conf. on file and storage technologies

  27. Peek D, Flinn J (2006) Ensemblue: integrating distributed storage and consumer electronics. In: OSDI’06, pp 219–232

  28. Yan T, Ganesan D, Manmatha R (2008) Distributed image search in camera sensor networks. In: SenSys ’08, pp 155–168

  29. Gaonkar S, Li J, Choudhury RR, Cox L, Schmidt A (2008) Micro-Blog: sharing and querying content through mobile phones and social participation. In: MobiSys’08, pp 174–186

  30. Miluzzo E, Lane ND, Fodor K, Peterson R, Lu H, Musolesi M, Eisenman SB, Zheng X, Campbell AT (2008) Sensing meets mobile social networks: the design, implementation and evaluation of the cenceme application. In: SenSys’08, pp 337–350

  31. Pering T, Want R, Gardere L, Vadas K, Welbourne E (2007) Musicology: bringing personal music into shared spaces. In: MobiQuitous, pp 1–8

  32. Dearman D, Kellar M, Truong KN (2008) An examination of daily information needs and sharing opportunities. In: Proceedings of the ACM 2008 conference on computer supported cooperative work, pp 679–688

Download references

Author information

Authors and Affiliations

  1. ECEE Department, University of Colorado Boulder, Boulder, CO, USA

    Kun Li & Li Shang

  2. ECE Department, Queen’s University, Kingston, Canada

    Changyun Zhu

  3. CS Department, University of Colorado Boulder, Boulder, CO, USA

    Qin Lv

  4. EE Department, University of Michigan, Ann Arbor, MI, USA

    Robert P. Dick

Authors
  1. Kun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Changyun Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qin Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Li Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Robert P. Dick
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kun Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, K., Zhu, C., Lv, Q. et al. Personalized multi-modality image management and search for mobile devices. Pers Ubiquit Comput 17, 1817–1834 (2013). https://doi.org/10.1007/s00779-013-0660-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-013-0660-4

Keywords

Search

Navigation