research-article

Collection-based sparse label propagation and its application on social group suggestion from photos

Authors:

Jiebo LuoAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 2, Issue 2

Article No.: 12, Pages 1 - 21

https://doi.org/10.1145/1899412.1899416

Published: 24 February 2011 Publication History

Abstract

Online social network services pose great opportunities and challenges for many research areas. In multimedia content analysis, automatic social group recommendation for images holds the promise to expand one's social network through media sharing. However, most existing techniques cannot generate satisfactory social group suggestions when the images are classified independently. In this article, we present novel methods to produce accurate suggestions of suitable social groups from a user's personal photo collection. First, an automatic clustering process is designed to estimate the group similarities, select the optimal number of clusters and categorize the social groups. Both visual content and textual annotations are integrated to generate initial predictions of the group categories for the images. Next, the relationship among images in a user's collection is modeled as a sparse graph. A collection-based sparse label propagation method is proposed to improve the group suggestions. Furthermore, the sparse graph-based collection model can be readily exploited to select the most influential and informative samples for active relevance feedback, which can be integrated with the label propagation process without the need for classifier retraining. The proposed methods have been tested on group suggestion tasks for real user collections and demonstrated superior performance over the state-of-the-art techniques.

References

[1]

Ames, M. and Naaman, M. 2007. Why we tag: Motivations for annotation in mobile and online media. In Proceedings of the Special Interest Group on Computer-Human Interaction (SIGCHI). ACM.

Digital Library

[2]

Belkin, M. and Niyogi, P. 2002. Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Computat.

Digital Library

[3]

Blei, D., Ng, A., and Jordan, M. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res.

Digital Library

[4]

Cao, L., Luo, J., and Huang, T. 2008. Annotating photo collections by label propagation according to multiple similarity cues. In Proceedings of the ACM Conference on Multimedia.

Digital Library

[5]

Chatzichristofis, S. and Boutalis, Y. 2008. CEDD: Color and Edge Directivity Descriptor: A compact descriptor for image indexing and retrieval. Comput. Vis. Syst., 312--322.

Digital Library

[6]

Chen, H. et al. 2008. SheepDog: Group and tag recommendation for Flickr photos by automatic search-based learning. In Proceedings of the ACM Conference on Multimedia.

Digital Library

[7]

Chen, W. Y., Chu, J. C., Luan, J., Bai, H., Wang, Y., and Chang, E. Y. 2009. Collaborative filtering for Orkut communities: discovery of user latent behavior. In Proceedings of the WWW Conference.

Digital Library

[8]

Duan, M. et al. 2009. Style modeling for tagging personal photo collections. In Proceedings of the International Conference on Image and Video Retrieval.

Digital Library

[9]

Efron, B. et al. 2003. Least angle regression. Ann. Stat.

[10]

Fan, J., Luo, H., and Hacid, M. 2005. Mining images on semantics via statistical learning. In Proceedings of the 11th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. ACM.

Digital Library

[11]

Goh, K. and Li, B. 2005. Using one-class and two-class SVMs for multiclass image annotation. IEEE Trans. Knowl. Data Engin.

Digital Library

[12]

Griffiths, T. and Steyvers, M. 2004. Finding scientific topics. Proc. Nat. Acad. Sci. USA.

[13]

Hastie, T., Tibshirani, R., and Friedman, J. The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer, New York.

[14]

Hays, J. and Efros, A. 2008. IM2GPS: Estimating geographic information from a single image. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.

[15]

Hofmann, T. 1999. Probabilistic latent semantic indexing. In Proceedings of the ACM SIGIR Conference on Information Retrieval.

Digital Library

[16]

Jain, A., Murty, M., and Flynn, P. 1999. Data clustering: A review. ACM Comp. Surv.

Digital Library

[17]

Jeh, G. and Widom, J. 2002. Simrank: A measure of structural context similarity. In Proceedings of the 8th International Conference on Knowledge Discovery and Data Mining.

Digital Library

[18]

Jia, J., Yu, N., and Hua, X. 2008. Annotating personal albums via web mining. In Proceedings of the ACM Conference on Multimedia.

Digital Library

[19]

Jin, X., Zhou, Y., and Mobasher, B. 2005. A maximum entropy web recommendation system: combining collaborative and content features. In Proceedings of the 11th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.

Digital Library

[20]

Jing, Y. and Baluja, S. 2008. VisualRank: Applying PageRank to large-scale image search. In Proceedings of the Internationals Conference on WWW.

[21]

Joshi, A., Porikli, F., and Papanikolopoulos, N. 2008. Multi-class active learning for image classification. In Proceedings of the International Conference on Computer Vision and Pattern Recognition.

[22]

Joshi, D. and Luo, J. 2008. Inferring generic activities and events from image content and bags of geo-tags. In Proceedings of the ACM International Conference on Image and Video Retrieval.

Digital Library

[23]

Li, X., Snoek, G., and Worring, M. 2008. Learning tag relevance by neighbor voting for social image retrieval. In Proceedings of the ACM International Conference on Multimedia.

Digital Library

[24]

Luo, J., Joshi, D., Yu, J., and Hao, W. 2008. Event recognition: Viewing the world with a third eye. In Proceedings of the ACM International Conference on Multimedia.

Digital Library

[25]

Negoescu, R. and Gatica-Perez, D. 2008. Analyzing Flickr groups. In Proceedings of the ACM Conference on Image and Video Retrieval (CIVR).

Digital Library

[26]

Oliva, A. and Torralba, A. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 3.

Digital Library

[27]

Pedro, J. and Siersdorfer, S. 2009. Ranking and classifying attractiveness of photos in folksonomies. In Proceedings of the World Wide Web Conference.

Digital Library

[28]

Rao, R., Olshausen, B., and Lewicki, M. 2002. Probabilistic Models of Brain: Perception and Neural Function. MIT Press.

[29]

Roweis, S. and Saul, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science.

[30]

Rui, Y., Huang, T. S., Ortega, M., and Mehrotra, S. 1998. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circ. Syst. Video Tech.

Digital Library

[31]

Sorokin, A. and Forsyth, D. 2008. Utility data annotation with Amazon Mechanical Turk. In Proceedings of the 1st IEEE Workshop on Internet Vision at CVPR 08.

[32]

Tang, J., Hua, X., Qi, G., Song, Y., and WU, X. 2008. Video annotation based on kernel linear neighborhood propagation. IEEE Trans. Multimed.

Digital Library

[33]

Tibshirani, R. 1996. Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc B. 58, 1, 267--288.

[34]

Tong, W. and Jin, R. 2007. Semi-Supervised Learning by Mixed Label Propagation. AAAI.

Digital Library

[35]

Torralba, A., Fergus, R., and Freeman, W. 2007. Tiny images. Tech. rep. MIT-CSAIL-TR-2007-024.

[36]

Verma, D. and Meila, M. 2003. A comparison of spectral clustering algorithms. Tech. rep. University of Washington.

[37]

Wang, C., Zhang, L., and Zhang, H. 2008. Learning to reduce the semantic gap in web image retrieval and Annotation. In Proceedings of the 31st Annual International ACM SIGIR Conference (SIGIR).

Digital Library

[38]

Wang, F. and Zhang, C. 2008. Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Engin.

Digital Library

[39]

Wang, G., Hoiem, D., and Forsyth, D. 2009. Learning image similarity from Flickr groups using stochastic intersection kernel machines. In Proceedings of the International Conference on Computer Vision.

[40]

Weinberger, K., Slaney, M., and Zwol, R. 2008. Resolving tag ambiguity. In Proceedings of the ACM Conference on Multimedia.

Digital Library

[41]

Wu, L., Hoi, S., Jin, R., Zhu, J., and Yu, N. 2009. Distance metric learning from uncertain side information with application to automated photo tagging. In Proceedings of the ACM International Conference on Multimedia.

Digital Library

[42]

Wu, L., Yang, L., Yu, N., and Hua, X. 2009. Learning to tag. In Proceedings of the International Conference on the World Wide Web.

Digital Library

[43]

Xu, Z. and Akella, R. 2008. A Bayesian logistic regression model for active relevance feedback. In Proceedings of the 31st ACM SIGIR Conference.

Digital Library

[44]

Yu, J., Amores, J., Sebe, N., Radeva, P., and Tian, Q. 2008. Distance learning for similarity estimation. IEEE Trans. Patt. Anal. Mach. Intell.

Digital Library

[45]

Yu, J. and Luo, J. 2008. Leveraging probabilistic season and location context models for scene understanding. In Proceedings of the ACM International Conference on Image and Video Retrieval.

Digital Library

[46]

Zaïane, O., Han, J., Li, Z., Chee, S., and Chiang, J. 1998. MultiMediaMiner: A system prototype for multimedia data mining. In Proceedings of ACM SIGMOD International Conference on Management of Data.

Digital Library

Cited By

Ojokoh BIgbe TAfolabi BDaramola O(2023)A graph model with integrated pattern and query-based technique for extracting answer to questions in community question answering systemSocial Network Analysis and Mining10.1007/s13278-023-01046-313:1Online publication date: 5-Mar-2023
https://doi.org/10.1007/s13278-023-01046-3
Zhou XWu BJin Q(2018)Analysis of User Network and Correlation for Community Discovery Based on Topic-Aware Similarity and Behavioral InfluenceIEEE Transactions on Human-Machine Systems10.1109/THMS.2017.272534148:6(559-571)Online publication date: Dec-2018
https://doi.org/10.1109/THMS.2017.2725341
Li ZTang J(2017)Weakly Supervised Deep Matrix Factorization for Social Image UnderstandingIEEE Transactions on Image Processing10.1109/TIP.2016.262414026:1(276-288)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TIP.2016.2624140
Show More Cited By

Index Terms

Collection-based sparse label propagation and its application on social group suggestion from photos
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing
  2. World Wide Web

Recommendations

Interactive social group recommendation for Flickr photos

Social groups on photo sharing Websites, such as Flickr, are self-organized communities to share photos and conversations with common interest and have gained massive popularity. Currently, users have to manually assign each photo to the appropriated ...
Personalized hybrid recommendation for group of users

Novel group hybrid method combining collaborative and content-based recommendation.Proposed method improves the quality of recommended items ordering.Proposed method increases the recommendation precision for very Top-N results.Applicable for single ...
Social group suggestion from user image collections
WWW '10: Proceedings of the 19th international conference on World wide web

Photo-sharing services have attracted millions of people and helped construct massive social networks on the Web. A popular trend is that users share their image collections within social groups, which greatly promotes the interactions between users and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 2, Issue 2

February 2011

175 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/1899412

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2011

Accepted: 01 August 2010

Revised: 01 June 2010

Received: 01 March 2010

Published in TIST Volume 2, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
626
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ojokoh BIgbe TAfolabi BDaramola O(2023)A graph model with integrated pattern and query-based technique for extracting answer to questions in community question answering systemSocial Network Analysis and Mining10.1007/s13278-023-01046-313:1Online publication date: 5-Mar-2023
https://doi.org/10.1007/s13278-023-01046-3
Zhou XWu BJin Q(2018)Analysis of User Network and Correlation for Community Discovery Based on Topic-Aware Similarity and Behavioral InfluenceIEEE Transactions on Human-Machine Systems10.1109/THMS.2017.272534148:6(559-571)Online publication date: Dec-2018
https://doi.org/10.1109/THMS.2017.2725341
Li ZTang J(2017)Weakly Supervised Deep Matrix Factorization for Social Image UnderstandingIEEE Transactions on Image Processing10.1109/TIP.2016.262414026:1(276-288)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TIP.2016.2624140
Zhou XWu BJin QJianhua Ma Li WYen N(2016)Personal Data Analytics to Facilitate Cyber Individual Modeling2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech)10.1109/DASC-PICom-DataCom-CyberSciTec.2016.22(39-46)Online publication date: Aug-2016
https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.22
Zoidi OFotiadou ENikolaidis NPitas I(2015)Graph-Based Label Propagation in Digital MediaACM Computing Surveys10.1145/270038147:3(1-35)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1145/2700381
Jin XLuo JYu JWang GJoshi DHan J(2013)Reinforced Similarity Integration in Image-Rich Information NetworksIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2011.22825:2(448-460)Online publication date: 1-Feb-2013
https://dl.acm.org/doi/10.1109/TKDE.2011.228
Zhu JLuo JYou QSmith J(2013)Towards Understanding the Effectiveness of Election Related Images in Social Media2013 IEEE 13th International Conference on Data Mining Workshops10.1109/ICDMW.2013.112(421-425)Online publication date: Dec-2013
https://doi.org/10.1109/ICDMW.2013.112
Zeng CJia DWang JHong LNie WLi ZTian JTian JChin AChen E(2012)Context-aware social media recommendation based on potential groupProceedings of the 1st International Workshop on Context Discovery and Data Mining10.1145/2346604.2346611(1-9)Online publication date: 12-Aug-2012
https://dl.acm.org/doi/10.1145/2346604.2346611
Jia DZeng CNie WLi ZPeng Z(2012)A New Approach for Date Sharing and Recommendation in Social WebDatabase and Expert Systems Applications10.1007/978-3-642-32597-7_28(314-328)Online publication date: 2012
https://doi.org/10.1007/978-3-642-32597-7_28

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents