short-paper

Event recognition from photo collections via PageRank

Authors:

Mubarak ShahAuthors Info & Claims

MM '09: Proceedings of the 17th ACM international conference on Multimedia

Pages 621 - 624

https://doi.org/10.1145/1631272.1631371

Published: 19 October 2009 Publication History

Abstract

We propose a method of mining most informative features for the event recognition from photo collections. Our goal is to classify different event categories based on the visual content of a group of photos that constitute the event. Such photo groups are typical in a personal photo collection of different events. Visual features are extracted from the images, yet the features from individual images are often noisy and not all of them represent the distinguishing characteristics of an event. We employ the PageRank technique to mine the most informative features from the images that belong to the same event. Subsequently, we classify different event categories using the multiple images of the same event because we argue that they are more informative about the content of an event rather than any single image. We compare our proposed approach with the standard bag of features method (BOF) and observe considerable improvements in recognition accuracy.

References

[1]

L. Zelnik-Manor and M. Irani. Event-based analysis of video, CVPR 2001.

[2]

D. Xu and S.-F. Chang. Video event recognition using kernel methods with multilevel temporal alignment, PAMI 2008.

Digital Library

[3]

S. Ebadollahi, L. Xie, S.-F. Chang, J. R. Smith. Visual event detection using multi-dimensional concept dynamics, ICME 2006.

[4]

J. Liu, Y. Zhai, et al. University of Central Florida at TRECVID 2006: High-Level Feature Extraction and Video Search, TRECVID 2006.

[5]

J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos in the wild, CVPR 2009.

[6]

W. Jiang and A. C. Loui. Semantic event detection based on visual concept prediction, ICME 2008.

[7]

A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope, IJCV 2001.

Digital Library

[8]

G. Kim, C. F. and M. Hebert. Unsupervised modeling of object categories using link analysis techniques, CVPR 2008.

[9]

Y. Wu, J.-Y. Bouguet, A. Nefian, and I. Kozintsev. Learning concept templates from web images to query personal image databases, ICME 2007.

[10]

L. Cao, J. Luo, H. Kautz and T. S. Huang. Annotating collections of photos using hierarchical event and scene models, CVPR 2008.

[11]

J. Yuan, J. Luo and Y. Wu. Mining compositional features, CVPR 2008.

[12]

J. Liu, Y. Yang and M. Shah. Learning Semantic Visual Vocabularies Using Diffusion Distance, CVPR 2009.

[13]

Y. Jing and S. Baluja. VisualRank: Applying PageRank to large-scale image search, PAMI 2008.

Digital Library

[14]

D. G. Lowe. Distinctive image features from scale invariant keypoints, IJCV 2004.

Digital Library

[15]

M. Leordeanu and M. Hebert. A spectral technique for correspondence problems using pair wise constraints, ICCV 2005.

Digital Library

Cited By

Xiao KQian ZQin B(2022)A Survey of Data Representation for Multi-Modality Event Detection and EvolutionApplied Sciences10.3390/app1204220412:4(2204)Online publication date: 20-Feb-2022
https://doi.org/10.3390/app12042204
Yang XZhang TXu C(2018)Deep-Structured Event Modeling for User-Generated PhotosIEEE Transactions on Multimedia10.1109/TMM.2017.278821020:8(2100-2113)Online publication date: Aug-2018
https://doi.org/10.1109/TMM.2017.2788210
LIU BP. KATO MTANAKA K(2016)Cognition-Aware Summarization of Photos Representing EventsIEICE Transactions on Information and Systems10.1587/transinf.2016EDP7079E99.D:12(3140-3153)Online publication date: 2016
https://doi.org/10.1587/transinf.2016EDP7079
Show More Cited By

Index Terms

Event recognition from photo collections via PageRank
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
  2. Information systems applications
    1. Data mining
    2. Multimedia information systems
      1. Multimedia databases

Recommendations

Collaborative event annotation in tagged photo collections

Events constitute a significant means of multimedia content organization and sharing. Despite the recent interest in detecting events and annotating media content in an event-centric way, there is currently insufficient support for managing events in ...
Event Recognition in Photo Collections with a Stopwatch HMM
ICCV '13: Proceedings of the 2013 IEEE International Conference on Computer Vision

The task of recognizing events in photo collections is central for automatically organizing images. It is also very challenging, because of the ambiguity of photos across different event classes and because many photos do not convey enough relevant ...
Social Event Mining in Large Photo Collections
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval

A significant part of publicly available photos on the Internet depicts a variety of different social events. In order to organize this steadily growing media content and to make it easily accessible, novel indexing methods are required. Essential ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '09: Proceedings of the 17th ACM international conference on Multimedia

October 2009

1202 pages

ISBN:9781605586083

DOI:10.1145/1631272

General Chairs:
Wen Gao
Peking University, China
,
Yong Rui
Microsoft, China
,
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Program Chairs:
Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, China
,
Eckehard Steinbach
Technical University of Munich, Germany
,
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Michelle Zhou
IBM T. J. Watson Research Center, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 19 - 24, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
409
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xiao KQian ZQin B(2022)A Survey of Data Representation for Multi-Modality Event Detection and EvolutionApplied Sciences10.3390/app1204220412:4(2204)Online publication date: 20-Feb-2022
https://doi.org/10.3390/app12042204
Yang XZhang TXu C(2018)Deep-Structured Event Modeling for User-Generated PhotosIEEE Transactions on Multimedia10.1109/TMM.2017.278821020:8(2100-2113)Online publication date: Aug-2018
https://doi.org/10.1109/TMM.2017.2788210
LIU BP. KATO MTANAKA K(2016)Cognition-Aware Summarization of Photos Representing EventsIEICE Transactions on Information and Systems10.1587/transinf.2016EDP7079E99.D:12(3140-3153)Online publication date: 2016
https://doi.org/10.1587/transinf.2016EDP7079
Yang XZhang TXu CHanjalic ASnoek CWorring MBulterman DHuet BKelliher AKompatsiaris YLi J(2016)Abnormal Event Discovery in User Generated PhotosProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2975215(47-51)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2964284.2975215
Yang XZhang TXu C(2016)Semantic Feature Mining for Video Event UnderstandingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/296271912:4(1-22)Online publication date: 3-Aug-2016
https://dl.acm.org/doi/10.1145/2962719
Bacha SAllili MBenblidia N(2016)Event recognition in photo albums using probabilistic graphical models and feature relevanceJournal of Visual Communication and Image Representation10.1016/j.jvcir.2016.07.02140:PB(546-558)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1016/j.jvcir.2016.07.021
Zeppelzauer MSchopfhauser D(2016)Multimodal classification of events in social mediaImage and Vision Computing10.1016/j.imavis.2015.12.00453:C(45-56)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.imavis.2015.12.004
Fu JMei TYang KLu HRui YGangemi ALeonardi SPanconesi A(2015)Tagging Personal Photos with Transfer Deep LearningProceedings of the 24th International Conference on World Wide Web10.1145/2736277.2741112(344-354)Online publication date: 18-May-2015
https://dl.acm.org/doi/10.1145/2736277.2741112
Yang XZhang TXu CHossain M(2015)Automatic Visual Concept Learning for Social Event UnderstandingIEEE Transactions on Multimedia10.1109/TMM.2015.239363517:3(346-358)Online publication date: Mar-2015
https://doi.org/10.1109/TMM.2015.2393635
Cong Guo Xinmei Tian (2015)Event recognition in personal photo collections using hierarchical model and multiple features2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2015.7340864(1-6)Online publication date: Oct-2015
https://doi.org/10.1109/MMSP.2015.7340864
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten