research-article

CelebrityNet: A Social Network Constructed from Large-Scale Online Celebrity Images

Authors:

David A. Shamma,

Sina Jafarpour,

Roelof Van Zwol,

Xuanhui WangAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 12, Issue 1

Article No.: 3, Pages 1 - 22

https://doi.org/10.1145/2801125

Published: 24 August 2015 Publication History

Abstract

Photos are an important information carrier for implicit relationships. In this article, we introduce an image based social network, called CelebrityNet, built from implicit relationships encoded in a collection of celebrity images. We analyze the social properties reflected in this image-based social network and automatically infer communities among the celebrities. We demonstrate the interesting discoveries of the CelebrityNet. We particularly compare the inferred communities with human manually labeled ones and show quantitatively that the automatically detected communities are highly aligned with that of human interpretation. Inspired by the uniqueness of visual content and tag concepts within each community of the CelebrityNet, we further demonstrate that the constructed social network can serve as a knowledge base for high-level visual recognition tasks. In particular, this social network is capable of significantly improving the performance of automatic image annotation and classification of unknown images.

References

[1]

S. Bakhshi, D. A. Shamma, and E. Gilbert. 2014. Faces engage us: Photos with faces attract more likes and comments on Instagram. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 965--974.

Digital Library

[2]

M. A. Beauchamp. 1965. An improved index of centrality. Behav. Sci. 10, 2, 161--163.

[3]

M. R. Boutell, J. Luo, X. Shen, and C. M. Brown. 2004. Learning multi-label scene classification. Patt. Recog. 37, 9, 1757--1771.

[4]

S. Brin and L. Page. 1998. The anatomy of a large-scale hypertextual Web search engine. Comput. Netw. ISDN Syst. 30, 1, 107--117.

Digital Library

[5]

L. Cao, J. Yu, J. Luo, and T. S. Huang. 2009. Enhancing semantic and geographic annotation of web images via logistic canonical correlation regression. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). ACM, New York, 125--134.

Digital Library

[6]

Y.-Y. Chen, W. H. Hsu, and H.-Y. M. Liao. 2012. Discovering informative social subgraphs and predicting pairwise relationships from group photos. In Proceedings of the 20th ACM International Conference on Multimedia (MM'12). ACM, New York, 669--678.

Digital Library

[7]

N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In Proceedings of CVPR. 886.

Digital Library

[8]

J. Deng, A. Berg, K. Li, and L. Fei-Fei. 2010. What does classifying more than 10,000 image categories tell us? In Proceedings of ECCV'10. 71--84.

Digital Library

[9]

I. Derényi, G. Palla, and T. Vicsek. 2005. Clique percolation in random networks. Phys. Rev. Lett. 94.

[10]

L. Ding and A. Yilmaz. 2010. Learning relations among movie characters: A social network perspective. In Proceedings of ECCV'10. 410--423.

Digital Library

[11]

Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. J. Mach. Learn. Res. 9, 1871--1874.

Digital Library

[12]

P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. 2007. Object detection with discriminatively trained part based models. J. Art. Intell. Res. 29.

[13]

L. C. Freeman. 1977. A set of measures of centrality based on betweenness. Sociometry 35--41.

[14]

W. Gao and K. Wong. 2006. Natural document clustering by clique percolation in random graphs. In Proceedings of the 3rd Asia Conference on Information Retrieval Technology. Springer, 119--131.

Digital Library

[15]

N. Ghamrawi and A. McCallum. 2005. Collective multi-label classification. In Proceedings of CIKM. 195--200.

Digital Library

[16]

M. C. Gonzaléz, H. J. Herrmann, J. Kertész, and T. Vicsek. 2007. Community structure and ethnic preferences in school friendship networks. Phys. A 379, 1, 307--316.

[17]

P. R. Gould. 1967. On the geographical interpretation of eigenvalues. Trans. Instit. British Geog. 53--86.

[18]

P. Jaccard. 1901. Étude comparative de la distribution florale dans une portion des Alpes et des Jura. Bulletin del la Société Vaudoise des Sciences Naturelles.

[19]

F. Kang, R. Jin, and R. Sukthankar. 2006. Correlated label propagation with application to multi-label learning. In Proceedings of CVPR. 1719--1726.

Digital Library

[20]

H.-N. Kim, J.-G. Jung, and A. El Saddik. 2010. Associative face co-occurrence networks for recommending friends in social networks. In Proceedings of 2nd ACM SIGMM Workshop on Social Media (WSM'10). ACM, New York, 27--32.

Digital Library

[21]

I. Konstas, V. Stathopoulos, and J. M. Jose. 2009. On social networks and collaborative recommendation. In Proceedings of SIGIR. ACM, 195--202.

Digital Library

[22]

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 1097--1105.

[23]

J. Leskovec, K. J. Lang, and M. Mahoney. 2010. Empirical comparison of algorithms for network community detection. In Proceedings of the 19th International Conference on World Wide Web. ACM, 631--640.

Digital Library

[24]

L.-J. Li, X. Kong, and P. S. Yu. 2014. Visual recognition by exploiting latent social links in image collections. In MultiMedia Modeling, Springer, 121--132.

Digital Library

[25]

Y. Lin, F. Lv, S. Zhu, M. Yang, T. Cour, K. Yu, L. Cao, and T. Huang. 2011. Large-scale image classification: Fast feature extraction and svm training. In Proceedings of CVPR. 1689--1696.

Digital Library

[26]

X. Liu, Z. Shi, Z. Li, X. Wang, and Z. Shi. 2010. Sorted label classifier chains for learning images with multi-label. In Proceedings of the 18th ACM International Conference on Multimedia (MM'10).

Digital Library

[27]

Y. Liu, R. Jin, and L. Yang. 2006. Semi-supervised multi-label learning by constrained non-negative matrix factorization. In Proceedings of AAAI. 421--426.

Digital Library

[28]

Q. Lu and L. Getoor. 2003. Link-based classification. In Proceedings of ICML.

[29]

Yong Luo, Dacheng Tao, Bo Geng, Chao Xu, and Stephen J. Maybank. 2013. Manifold regularized multitask learning for semi-supervised multilabel image classification. IEEE Trans. Image Process. 22, 2, 523--536.

Digital Library

[30]

L. K. McDowell, K. M. Gupta, and D. W. Aha. 2007. Cautious inference in collective classification. In Proceedings of AAAI. 596--601.

Digital Library

[31]

G. Palla, I. Derényi, I. Farkas, and T. Vicsek. 2005. Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 7043, 814--818.

[32]

Guo-Jun Qi, Xian-Sheng Hua, Yong Rui, Jinhui Tang, Tao Mei, and Hong-Jiang Zhang. 2007. Correlative multi-label video annotation. In Proceedings of the 15th International Conference on Multimedia. ACM, 17--26.

Digital Library

[33]

J. Read, B. Pfahringer, G. Holmes, and E. Frank. 2009. Classifier chains for multi-label classification. In Proceedings of ECML/PKDD.

Digital Library

[34]

Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2014. ImageNet Large Scale Visual Recognition Challenge.

[35]

Z. Stone, T. Zickler, and T. Darrell. 2008. Autotagging Facebook: Social network context improves photo annotation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008 (CVPRW'08). 1--8.

[36]

Z. Stone, T. Zickler, and T. Darrell. 2010. Toward large-scale face recognition using social network context. Proc. IEEE 98, 8, 1408--1415.

[37]

Pang-Ning Tan, Michael Steinbach, and Vipin Kumar. 2005. Introduction to Data Mining. Addison Wesley.

[38]

S. V. N. Vishwanathan, Z. Sun, and N. Theera-Ampornpunt. 2010. Multiple kernel learning and the SMO algorithm. In Proceedings of NIPS. 2361--2369.

[39]

G. Wang, A. Gallagher, J. Luo, and D. Forsyth. 2010. Seeing people in social context: Recognizing people and social relationships. In Proceedings of ECCV. Springer, 169--182.

Digital Library

[40]

S. Wasserman and K. Faust. 1994. Social Network Analysis: Methods and Applications. Cambridge University Press.

[41]

J. Weston, S. Bengio, and N. Usunier. 2010. Large scale image annotation: Learning to rank with joint word-image embeddings. Mach. Learn. 81, 1, 21--35.

Digital Library

[42]

Zheng-Jun Zha, Xian-Sheng Hua, Tao Mei, Jingdong Wang, G.-J. Qi, and Zengfu Wang. 2008. Joint multi-label multi-instance learning for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2008 (CVPR'08). IEEE, 1--8.

[43]

J. Zhuang, T. Mei, S. Hoi, X. Hua, and S. Li. 2011. Modeling social strength in social media community via kernel-based learning. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11).

Digital Library

Cited By

Aimar ERadeva PDimiccoli M(2019)Social Relation Recognition in Egocentric Photostreams2019 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2019.8803634(3227-3231)Online publication date: Sep-2019
https://doi.org/10.1109/ICIP.2019.8803634
Wang ZChen TRen JYu WCheng HLin L(2018)Deep reasoning with knowledge graph for social relationship understandingProceedings of the 27th International Joint Conference on Artificial Intelligence10.5555/3304415.3304560(1021-1028)Online publication date: 13-Jul-2018
https://dl.acm.org/doi/10.5555/3304415.3304560
Sun QSchiele BFritz M(2017)A Domain Based Approach to Social Relation Recognition2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.54(435-444)Online publication date: Jul-2017
https://doi.org/10.1109/CVPR.2017.54

Index Terms

CelebrityNet: A Social Network Constructed from Large-Scale Online Celebrity Images

Recommendations

Social Multimedia Signals: Sense, Process, and Put Them to Work

Social media gives ordinary people the power to be content creators and information disseminators. This information is embedded in multimedia shared across social networks, containing valuable indications about various facets of human life–about ...
Building social capital with Facebook: Type of network, availability of other media, and social self-efficacy matter^#
Highlights
- Type of friends affects building social capital via Facebook and traditional media.
Abstract
Findings about Facebook's effect on relationships are mixed, possibly due to lack of models that acknowledge differences across users, types of their friends, and use of competing media. To address this, we proposed and tested how ...
Characterizing social cascades in flickr
WOSN '08: Proceedings of the first workshop on Online social networks

Online social networking sites like MySpace and Flickr have become a popular way to share and disseminate content. Their massive popularity has led to the viral marketing of content, products, and political campaigns on the sites themselves. Despite the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 12, Issue 1

August 2015

220 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2816987

Editor:
Ralf Steinmetz
Technische Universität Darmstadt, Germany

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Accepted: 01 March 2015

Revised: 01 January 2015

Received: 01 July 2014

Published in TOMM Volume 12, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
628
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Aimar ERadeva PDimiccoli M(2019)Social Relation Recognition in Egocentric Photostreams2019 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2019.8803634(3227-3231)Online publication date: Sep-2019
https://doi.org/10.1109/ICIP.2019.8803634
Wang ZChen TRen JYu WCheng HLin L(2018)Deep reasoning with knowledge graph for social relationship understandingProceedings of the 27th International Joint Conference on Artificial Intelligence10.5555/3304415.3304560(1021-1028)Online publication date: 13-Jul-2018
https://dl.acm.org/doi/10.5555/3304415.3304560
Sun QSchiele BFritz M(2017)A Domain Based Approach to Social Relation Recognition2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.54(435-444)Online publication date: Jul-2017
https://doi.org/10.1109/CVPR.2017.54

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents