Skip to main content
SpringerLink
Log in

Informative image selection for crowdsourcing-based mobile location recognition

  • Special Issue Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

With the prevalence of smartphones, the demand of recognizing the location through their camera and sensors is paid abundant attentions. For constructing a location recognition image database, the crowdsourcing technology is introduced to collect images associated with other sensory data. However, as abundant crowdsourced images evolve, it is essential to select high-quality images to decrease the burden of storage when designing an offline location recognition system directly on mobile devices. To address this problem, we propose an image selection framework, i.e., Informative image Selection Framework (ISF), considering both the diversity in spatial distribution and representativeness of images with high quality. First, for the images corresponding to the same object, we propose the Self-adaptive Space Clustering algorithm to group them into several clusters for maintaining high diversity of the image database. Second, for every cluster, we propose the Crucial Part Feature Detection algorithm to detect representative images. Extensive experiments demonstrate that ISF is effective and efficient for image selection, outperforming other similar image selection schemes around 5%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Fang, Q., Sang, J.T., Xu, C.S.: Giant: Geo-informative attributes for location recognition and exploration. In: ACM International Conference on Multimedia, pp. 13–22 (2013)

  2. Sang, J.T., Mei, T., Xu, Y.Q., Zhao, C., Xu, C.S., Li, S.P.: Interaction design for mobile visual search. IEEE Trans. Multimed. 15(6), 1665–1676 (2013)

    Article  Google Scholar 

  3. Sang, J.T., Fang, Q., Xu, C.S.: Exploiting Social-Mobile Information for Location Visualization. ACM Trans. Intell. Syst. Technol. 8(3), 39–58 (2017)

    Article  Google Scholar 

  4. Sang, J.T., Xu, C.S., Liu, J.: User-aware image tag re nement via ternary semantic analysis. IEEE Trans. Multimed. 14(3), 883–895 (2012)

    Article  Google Scholar 

  5. Wang, H., Zhao, D., Ma, H.D., Xu, H.Y., Hou, X.B.: Crowdsourcing based mobile location recognition with richer fingerprints from smartphone sensors. In: IEEE Conference on Parallel and Distributed Systems, pp. 156–163 (2015)

  6. Zhao, D., Wang, H., Ma, H., Xu, H., Liu, L., Zhang, P.: CrowdOLR: Toward Object Location Recognition with crowdsourced fingerprints using smartphones. IEEE Transactions on Human-Machine Systems (2017). doi:10.1109/THMS.2017.2700443

    Article  Google Scholar 

  7. Ma, H.D., Zhao, D., Yuan P.Y.: Opportunities in mobile crowd sensing. IEEE Communica. Mag. 52(8), 29–35 (2014)

    Article  Google Scholar 

  8. Rudinac, S., Larson, M., Hanjalic, A.: Learning crowdsourced user preferences for visual summarization of image collections. IEEE Trans. Multimed. 15(6), 1231–1243 (2013)

    Article  Google Scholar 

  9. Guan, T., He, Y.F., Gao, J., Yang, J.Z., Yu, Q.: On-device mobile visual location recognition by integrating vision and inertial sensors. IEEE Trans. Multimed. 15(7), 1688–1699 (2013)

    Article  Google Scholar 

  10. Ji, R.R., Duan, L.Y., Chen, J., Yao, H.X., Yuan, J.S., Rui, Y., Gao, W.: Location discriminative vocabulary coding for mobile landmark search. Int. J. Comput. Vis. 96(3), 290–314 (2012)

    Article  Google Scholar 

  11. Li, X.W., Wu, C.C., Zach, C, Lazebnik, S., Frahm, J.M.: Modeling and recognition of landmark image collections using iconic scene graphs. In: European Conference on Computer Vision, pp. 427–440 (2008)

    Google Scholar 

  12. Wang H., Zhao D., Ma H., Xu H.: SSFS: A space-saliency fingerprint selection framework for crowdsourcing based mobile location recognition. In: Chen E., Gong Y., Tie Y. (eds) Advances in multimedia information processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science, vol 9917, pp. 650–659. Springer, Cham (2016)

    Google Scholar 

  13. Rudinac, S., Hanjalic, A., Larson, M.: Generating visual summaries of geographic areas using community-contributed images. IEEE Trans. Multimed. 15(4), 921–932 (2013)

    Article  Google Scholar 

  14. Yang, X.Y., Qian, X.M., Xue, Y.: Scalable mobile image retrieval by exploring contextual saliency. IEEE Trans. Image Process. 24(6), 1709–1721 (2015)

    Article  MathSciNet  Google Scholar 

  15. Ahn, L.V., Dabbish, L.: Labeling images with a computer game. In: Sigchi Conference on Human Factors in Computing Systems, pp. 319–326 (2004)

  16. Wang, Y., Hu, W.J., Wu, Y.B., Cao, G.H.: SmartPhoto: a resource-aware crowdsourcing approach for image sensing with smartphones. In: International Symposium on Mobile Ad Hoc Networking and Computing, pp. 113–122 (2014)

  17. Chen, H.H., Guo, B., Yu, Z.W., Chen, L.M.: CrowdPic: a multi-coverage picture collection framework for mobile crowd photographing. In: IEEE Conference on Ubiquitous Intelligence and Computing, pp. 68–76 (2015)

  18. Raychoudhury, V., Shrivastav, S., Sandha, S.S.: Cao, J.n.:CROWD-PAN-360: crowdsourcing based context-aware panoramic map generation for smartphone users. IEEE Trans. Parallel Distrib. Syst. 26(8), 2208–2219 (2014)

    Article  Google Scholar 

  19. Bay, H., Tuytelarars, T., Gool,L.: SURF: speeded up robust features. In: Proceedings of European Conference on Computer Vision, pp. 404–417 (2006)

    Chapter  Google Scholar 

  20. Liu, W., Mei, T., Zhang, Y.: Instant mobile video search with layered audio-video indexing and progressive transmission. IEEE Trans. Multimed. 16(8), 2242–2255 (2014)

    Article  Google Scholar 

  21. Gao, G.Y., Liu, C.H., Chen, M., Guo, S., Leung, K.K.: Cloud-based actor identification with batch-orthogonal local-sensitive hashing and sparse representation. IEEE Trans. Multimed. 18(9), 1749–1761 (2016)

    Article  Google Scholar 

  22. Ji, J.Q., Yan, S.C., Li, J.M., Gao, G.Y., Tian, Q., Zhang, B.: Batch-orthogonal locality-sensitive hashing for angular similarity. IEEE Trans. Pattern Anal. Mach. Intell 36(10), 1963–1974 (2014)

    Article  Google Scholar 

  23. Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: International Conference on Computer Vision Theory and Applications, pp. 331–340 (2009)

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grant No. 61332005 and No. 61502051, the Funds for Creative Research Groups of China under Grant No. 61421061, the Cosponsored Project of Beijing Committee of Education, and the Beijing Training Project for the Leading Talents in S&T (ljrc201502).

Author information

Authors and Affiliations

  1. Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia, School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China

    Hao Wang, Dong Zhao & Huadong Ma

Authors
  1. Hao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dong Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huadong Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hao Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Zhao, D. & Ma, H. Informative image selection for crowdsourcing-based mobile location recognition. Multimedia Systems 25, 513–523 (2019). https://doi.org/10.1007/s00530-017-0562-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-017-0562-9

Keywords

Search

Navigation