skip to main content
10.1145/2733373.2809934acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Evento 360: Social Event Discovery from Web-scale Multimedia Collection

Published: 13 October 2015 Publication History

Abstract

We present Evento 360 (URL: http://evento360.info), an online interactive social event browser, which allows the user to explore events detected within a web-scale multimedia corpus. The system addresses five key aspects of social multimedia event detection and summarization: multimodality, scale, diversity of representations, noise of multimedia items, and missing metadata. The detection algorithm uses unsupervised clustering approach that exploits temporal, spatial and textual metadata. For each detected event cluster, to choose the best subset of photos that meet both relevance and diversity criteria, the system uses hierarchical clustering that exploits both visual and audio information. Evento 360's user interface provides a search feature that is not limited to a certain set of events, but rather can handle an arbitrary event query. It allows the user to retrieve and explore relevant events. The system scales well and is effective in producing high-quality summaries of the detected events.

References

[1]
D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993--1022, Mar. 2003.
[2]
J. Cao, Z. Huang, Y. Yang, and H. T. Shen. UQ-DKE's participation at MediaEval 2014 placing task. In MediaEval Workshop 2014, 2014.
[3]
D. Dang-Nguyen, L. Piras, G. Giacinto, G. Boato, and F. De Natale. Retrieval of diverse images by pre-filtering and hierarchical clustering. In MediaEval Workshop 2014, 2014.
[4]
B. Ionescu, A. L. Gînsča, B. Boteanu, A. Popescu, M. Lupu, and H. Müller. Retrieving diverse social images at MediaEval 2015: Challenge, dataset and evaluation. In MediaEval 2015 Workshop, to appear.
[5]
B. Ionescu, A. Popescu, M. Lupu, A. L. Gînsča, and H. Müller. Retrieving diverse social images at MediaEval 2014: Challenge, dataset and evaluation. In MediaEval 2014 Workshop, 2014.
[6]
A. Kanagasundaram, R. Vogt, D. Dean, S. Sridharan, and M. Mason. I-vector based speaker recognition on short utterances. In Proceedings of the 12th Conference of the ISCA, pages 2341--2344, 2011.
[7]
X. Liu, R. Troncy, and B. Huet. Finding media illustrating events. In Proceedings of the 1st ACM ICMR, pages 58:1--58:8, 2011.
[8]
D. Manchon Vizuete, I. Gris-Sarabia, X. Giró Nieto, et al. UPC at MediaEval 2014 social event detection task. In MediaEval Workshop 2014, 2014.
[9]
G. Petkos, S. Papadopoulos, and Y. Kompatsiaris. Social event detection using multimodal clustering and integrating supervisory signals. In Proceedings of the 2nd ACM ICMR, 2012.
[10]
G. Petkos, S. Papadopoulos, V. Mezaris, and Y. Kompatsiaris. Social event detection at MediaEval 2014: Challenges, datasets, and evaluation. In MediaEval 2014 Workshop.
[11]
T. Reuter and P. Cimiano. Event-based classification of social media streams. In Proceedings of the 2nd ACM ICMR, 2012.
[12]
M. Riga, G. Petkos, S. Papadopoulos, E. Schinas, and Y. Kompatsiaris. CERTH@ MediaEval 2014 social event detection task. In MediaEval Workshop 2014.
[13]
S. Rudinac, A. Hanjalic, and M. Larson. Generating visual summaries of geographic areas using community-contributed images. Multimedia, IEEE Transactions on, 15(4):921--932, June 2013.
[14]
H. Sayyadi, M. Hurst, and A. Maykov. Event detection and tracking in social streams. In Proceedings of the ICWSM. AAAI, 2009.
[15]
E. Spyromitros-Xioufis, S. Papadopoulos, Y. Kompatsiaris, and I. Vlahavas. Socialsensor: Finding diverse images at MediaEval 2014. In MediaEval Workshop 2014, 2014.
[16]
B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015.
[17]
J. Weng. Event detection in Twitter. In Proceedings of the 5th International Conference on Weblogs and Social Media, 2011.
[18]
M. Zaharieva, M. Schopfhauser, M. Del Fabro, and M. Zeppelzauer. Clustering and retrieval of social events in flickr. In MediaEval 2014 Workshop, 2014.

Cited By

View all
  • (2024)Towards Temporal Event Detection: A Dataset, Benchmarks and ChallengesIEEE Transactions on Multimedia10.1109/TMM.2023.327652326(1102-1113)Online publication date: 2024
  • (2018)Geo-Distinctive Visual Element Matching for Location Estimation of ImagesIEEE Transactions on Multimedia10.1109/TMM.2017.276332320:5(1179-1194)Online publication date: May-2018
  • (2017)Dual graph regularized NMF model for social event detection from Flickr dataWorld Wide Web10.1007/s11280-016-0405-120:5(995-1015)Online publication date: 1-Sep-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '15: Proceedings of the 23rd ACM international conference on Multimedia
October 2015
1402 pages
ISBN:9781450334594
DOI:10.1145/2733373
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. event summarization
  2. social event detection
  3. topic models

Qualifiers

  • Research-article

Funding Sources

Conference

MM '15
Sponsor:
MM '15: ACM Multimedia Conference
October 26 - 30, 2015
Brisbane, Australia

Acceptance Rates

MM '15 Paper Acceptance Rate 56 of 252 submissions, 22%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)1
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Towards Temporal Event Detection: A Dataset, Benchmarks and ChallengesIEEE Transactions on Multimedia10.1109/TMM.2023.327652326(1102-1113)Online publication date: 2024
  • (2018)Geo-Distinctive Visual Element Matching for Location Estimation of ImagesIEEE Transactions on Multimedia10.1109/TMM.2017.276332320:5(1179-1194)Online publication date: May-2018
  • (2017)Dual graph regularized NMF model for social event detection from Flickr dataWorld Wide Web10.1007/s11280-016-0405-120:5(995-1015)Online publication date: 1-Sep-2017
  • (2016)ACM Multimedia(ACMMM) 2015 ReportACM Multimedia(ACMMM)2015参加報告The Journal of The Institute of Image Information and Television Engineers10.3169/itej.70.29370:3(293-297)Online publication date: 2016
  • (2016)Multimodal-based Multimedia Analysis, Retrieval, and Services in Support of Social Media ApplicationsProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2971471(1425-1429)Online publication date: 1-Oct-2016
  • (2016)Multimodal Analysis of User-Generated Content in Support of Social Media ApplicationsProceedings of the 2016 ACM on International Conference on Multimedia Retrieval10.1145/2911996.2912032(423-426)Online publication date: 6-Jun-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media