ABSTRACT
This work deals with the problem of event annotation in social networks. The problem is made difficult due to variability of semantics and due to scarcity of labeled data. Events refer to real-world phenomena that occur at a specific time and place, and media and text tags are treated as facets of the event metadata. We are proposing a novel mechanism for event annotation by leveraging related sources (other annotators) in a social network. Our approach exploits event concept similarity, concept co-occurrence and annotator trust. We compute concept similarity measures across all facets. These measures are then used to compute event-event and user-user activity correlation. We compute inter-facet concept co-occurrence statistics from the annotations by each user. The annotator trust is determined by first requesting the trusted annotators (seeds) from each user and then propagating the trust amongst the social network using the biased PageRank algorithm. For a specific media instance to be annotated, we start the process from an initial query vector and the optimal recommendations are determined by using a coupling strategy between the global similarity matrix, and the trust weighted global co-occurrence matrix. The coupling links the common shared knowledge (similarity between concepts) that exists within the social network with trusted and personalized observations (concept co-occurrences). Our initial experiments on annotated everyday events are promising and show substantial gains against traditional SVM based techniques.
- Flickr http://www.flickr.com.Google Scholar
- SEraja http://www.seraja.com/.Google Scholar
- L. V. AHN and L. DABBISH (2004). Labeling images with a computer game, Proceedings of the SIGCHI conference on Human factors in computing systems, 1-58113-702-8, ACM Press, 319--326, Vienna, Austria. Google ScholarDigital Library
- C. ANDERSON (2006). The long tail: why the future of business is selling less of more. Hyperion 1401302378 New York. Google ScholarDigital Library
- S. BRIN and L. PAGE (1998). The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems 30(1-7): 107--117. Google ScholarDigital Library
- E. CHANG, K. GOH, G. SYCHAY and G. WU (2003). CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines. IEEE Transactions on Circuits and Systems for Video Technology 13(1): 26--38. Google ScholarDigital Library
- A. K. DEY (2001). Understanding and Using Context. Personal and Ubiquitous Computing Journal 5(1): 4--7. Google ScholarDigital Library
- P. DOURISH (2004). What we talk about when we talk about context. Personal and Ubiquitous Computing 8(1): 19--30. Google ScholarDigital Library
- Z. GYONGYI, H. GARCIA-MOLINA and J. PEDERSEN (2004). Combating web spam with TrustRank, Proceedings of the 30th International Conference on Very Large Data Bases (VLDB) 2004, Toronto, Canada. Google ScholarDigital Library
- D. HUTTENLOCHER, G. KLANDERMAN and W. RUCKLIDGE (1993). Comparing Images Using the Hausdorff Distance. IEEETPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence 15(9): pp. 850--863. Google ScholarDigital Library
- L. KENNEDY, A. HAUPTMANN, M. NAPHADE, A. HAUPTMANN, J. R. SMITH and S.-F. CHANG (2006). LSCOM Lexicon Definitions and Annotations Version 1.0, DTO Challenge Workshop on Large Scale Concept Ontology for Multimedia, ADVENT Technical Report #217-2006-3, March 2006., Columbia University.Google Scholar
- J. KLEINBERG (1999). Authoritative sources in a hyperlinked environment. Journal of the ACM 46: 604--632. Google ScholarDigital Library
- B. LI, K. GOH and E. CHANG (2003.). Confidence-based Dynamic Ensemble for Image Annotation and Semantics Discovery., ACM International Conference on Multimedia., 195--206, Berkeley, CA. Google ScholarDigital Library
- H. LIU and P. SINGH (2004). ConceptNet: a practical commonsense reasoning toolkit. BT Technology Journal 22(4): pp. 211--226. Google ScholarDigital Library
- G. A. MILLER, R. BECKWITH and C. FELLBAUM (1993). Introduction to WordNet: An on-Line Lexical Database. International Journal of Lexicography 3(4): 235--244.Google ScholarCross Ref
- M. NAAMAN, H. GARCIA-MOLINA, A. PAEPCKE and R. B. YEH (2005). Leveraging Context to Resolve Identity in Photo Albums, Proc. of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), June 2005, Denver, CO. Google ScholarDigital Library
- B. SHEVADE, H. SUNDARAM and M.-Y. KAN (2005). A Collaborative Annotation Framework, Proc. International Conference on Multimedia and Expo 2005, Jan. 2005, Amsterdam, The Netherlands.Google ScholarCross Ref
- B. SHEVADE, H. SUNDARAM and L. XIE (2007). Modeling Personal and Social Network Context for Event Annotation in Images, Proc. Joint Conf. on Digital Libraries 2007, Jun. 2007, Vancouver, Canada. Google ScholarDigital Library
- B. STERLING (2005). Order Out of Chaos. Wired. 13.04 http://www.wired.com/wired/archive/13.04/view.html?pg=4.Google Scholar
- S. H. STROGATZ (2001). Exploring complex networks. 410(6825): 268.Google Scholar
- SVMLIGHT http://svmlight.joachims.org/Google Scholar
- M. TRURAN, J. GOULDING and H. ASHMAN (2005). Co-active intelligence for image retrieval, Proceedings of the 13th annual ACM international conference on Multimedia, 1-59593-044-2, ACM Press, 547--550, Hilton, Singapore. Google ScholarDigital Library
- T. V. WAL (2006) Off the Top: Folksonomy http://www.vanderwal.net/random/category.php?cat=153.Google Scholar
- U. WESTERMANN and R. JAIN (2007). Toward a Common Event Model for Multimedia Applications. IEEE Multimedia 14(1): 19--29. Google ScholarDigital Library
- A. WILHELM, Y. TAKHTEYEV, R. SARVAS, N. V. HOUSE and M. DAVIS (2004). Photo Annotation on a Camera Phone, ACM Conference on Human Computer Interaction, Apr. 2004, Vienna, Austria. Google ScholarDigital Library
Index Terms
- Contextual wisdom: social relations and correlations for multimedia event annotation
Recommendations
Modeling personal and social network context for event annotation in images
JCDL '07: Proceedings of the 7th ACM/IEEE-CS joint conference on Digital librariesThis paper describes a framework to annotate images using personal and social network contexts. The problem is important as the correct context reduces the number of image annotation choices.. Social network context is useful as real-world activities of ...
Constructing a cross-document event coreference corpus for Dutch
AbstractEvent coreference resolution is a task in which different text fragments that refer to the same real-world event are automatically linked together. This task can be performed not only within a single document but also across different documents ...
Social Multimedia Signals: Sense, Process, and Put Them to Work
Social media gives ordinary people the power to be content creators and information disseminators. This information is embedded in multimedia shared across social networks, containing valuable indications about various facets of human life–about ...
Comments