Mohamad Rabbath
Susanne Boll
ABSTRACT
Facebook witnesses an explosion of the number of shared photos: With 100 million photo uploads a day it creates as much as a whole Flickr each two months in terms of volume. Facebook has also one of the healthiest platforms to support third party applications, many of which deal with photos and related events. While it is essential for many Facebook applications, until now there is no easy way to detect and link photos that are related to the same events, which are usually distributed between friends and albums. In this work, we introduce an approach that exploits Facebook features to link photos related to the same event. In the current situation where the EXIF header of photos is missing in Facebook, we extract visual-based, tagged areas-based, friendship-based and structure-based features. We evaluate each of these features and use the results in our approach. We introduce and evaluate a semi-supervised probabilistic approach that takes into account the evaluation of these features. In this approach we create a lookup table of the initialization values of our model variables and make it available for other Facebook applications or researchers to use. The evaluation of our approach showed promising results and it outperformed the other the baseline method of using the unsupervised EM algorithm in estimating the parameters of a Gaussian mixture model. We also give two examples of the applicability of this approach to help Facebook applications in better serving the user.
- J. Geigel and A. C. Loui. Using genetic algorithms for album page layouts. IEEE MultiMedia, 10.(4):16--27, 2003. Google Scholar
Digital Library
- J. E. Gentile, K. W. Bowyer, and P. J. Flynn. Profile face detection: A subset Multi-Biometric approach. In 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems, pages 1--6. IEEE, Sept. 2008.Google ScholarCross Ref
- N. Gkalelis, V. Mezaris, and I. Kompatsiaris. A joint content-event model for event-centric multimedia indexing. In ICSC, pages 79--84. IEEE, 2010. Google ScholarDigital Library
- X. Liu, R. Troncy, and B. Huet. Finding media illustrating events. In Proceedings of the 1st ACM International Conference on Multimedia Retrieval, ICMR '11, pages 58:1--58:8, 2011. Google ScholarDigital Library
- T. Mei, B. Wang, X.-S. Hua, H.-Q. Zhou, and S. Li. Probabilistic multimodality fusion for event based home photo clustering. In ICME, pages 1757--1760, 2006.Google ScholarCross Ref
- R. A. Negoescu and D. Gatica-Perez. Analyzing flickr groups. In Proceedings of the 7th ACM International Conference on Image and Video Retrieval, CIVR 2008, Niagara Falls, Canada, July 7--9, 2008, pages 417--426, 2008. Google ScholarDigital Library
- J. C. Platt. Autoalbum: Clustering digital photographs using probabilistic model merging. In IEEE Workshop on Content-Based Access of Image and Video Libraries 2000, pages 96--100. Press, 2000. Google ScholarDigital Library
- J. C. Platt, M. Czerwinski, and B. A. Field. Phototoc: Automatic clustering for browsing personal photographs. Technical Report MSR-TR-2002-17, Microsoft Research, 2002.Google Scholar
- T. Quack, B. Leibe, and L. Van Gool. World-scale mining of objects and events from community photo collections. In Proceedings of the 2008 international conference on Content-based image and video retrieval, CIVR '08, pages 47--56, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- M. Rabbath, P. Sandhaus, and S. Boll. Automatic creation of photo books from stories in social media. ACM Trans. Multimedia Comput. Commun. Appl., 7S:27:1--27:18, Nov. 2011. Google ScholarDigital Library
- M. Rabbath, P. Sandhaus, and S. Boll. Large scale flexible event-based clustering from photos in social media. In Proceedings of the Third International Conference on Internet Multimedia Computing and Service, ICIMCS '11, pages 26--29, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- M. Redi and B. Merialdo. Saliency moments for image categorization. In Proceedings of the 1st ACM International Conference on Multimedia Retrieval, ICMR '11, pages 39:1--39:8, 2011. Google ScholarDigital Library
- B. Shevade, H. Sundaram, and L. Xie. Modeling personal and social network context for event annotation in images. In Proc. of the 7th ACM/IEEE-CS joint Conf. on Digital libraries (JCDL), pages 127--134, 2007. Google ScholarDigital Library
- G. Strong and M. Gong. Organizing and browsing photos using different feature vectors and their evaluations. In Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR '09, pages 3:1--3:8, 2009. Google ScholarDigital Library
- M. R. Trad, A. Joly, and N. Boujemaa. Large scale visual-based event matching. In ICMR, page 53, 2011. Google ScholarDigital Library
- R. Troncy, B. Malocha, and A. T. S. Fialho. Linking events with media. In Proceedings of the 6th International Conference on Semantic Systems, I-SEMANTICS '10, pages 42:1--42:4, 2010. Google ScholarDigital Library
- P. A. Viola and M. J. Jones. Robust real-time face detection. International Journal of Computer Vision, 57(2):137--154, 2004. Google ScholarDigital Library
- U. Westermann and R. Jain. Toward a Common Event Model for Multimedia Applications. IEEE MultiMedia, 14(1):19--29, 2007. Google ScholarDigital Library
- L. Zhang, L. Chen, M. Li, and H. Zhang. Automated annotation of human faces in family albums. In Proceedings of the eleventh ACM international conference on Multimedia, MULTIMEDIA '03, pages 355--358, 2003. Google ScholarDigital Library
Index Terms
- Analysing Facebook features to support event detection for photo-based Facebook applications
Recommendations
The Janus face of Facebook: Positive and negative sides of social networking site use
AbstractThere is an increasing awareness that social networking site (SNS) use includes a socio-psychologically positive and a negative side. However, research remains largely silent on which side dominates in driving SNS use. To address this ...
Highlights- We investigate the two sides of self-presentation and need to belong in SNSs.
- ...
Building social capital with Facebook: Type of network, availability of other media, and social self-efficacy matter#
Highlights- Type of friends affects building social capital via Facebook and traditional media.
AbstractFindings about Facebook's effect on relationships are mixed, possibly due to lack of models that acknowledge differences across users, types of their friends, and use of competing media. To address this, we proposed and tested how ...
What happens on Facebook stays on Facebook? The implications of Facebook interaction for perceived, receiving, and giving social support
Facebook interaction is positively related to receiving social support on Facebook.Facebook interaction is positively related to giving social support on Facebook.Facebook interaction is not associated with perceived social support in general.Receiving ...
Comments