Skip to main content
SpringerLink
Log in

Linking socially contributed media with events

  • Special Issue Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Recent years have witnessed the blooming of Web 2.0 content such as Flickr and YouTube, etc. How we can benefit from such rich media resources is still an open and challenging question. In this paper, we present a method combining semantic inferencing and visual analysis for automatically finding media (photos and videos) illustrating events. We report on experiments validating our heuristic for mining media sharing platforms and large event directories in order to mutually enrich the descriptions of the content they host. Our overall goal is to design a Web-based environment that allows users to explore and select events, to inspect associated media, and to discover meaningful, surprising or entertaining connections between events, media and people participating in events. We present a large dataset composed of semantic descriptions of events, photos and videos interlinked with the larger Linked Open Data cloud and we show the benefits of using semantic Web technologies for integrating multimedia metadata.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. http://en.wikipedia.org/wiki/Exchangeable_image_file_format.

  2. The code is available at: https://github.com/MediaAnalysis/EventEnricher.

  3. The entire dataset is composed of more than 30 million RDF triples and is available as a dump at http://www.eurecom.fr/~troncy/ldtc2010/.

References

  1. Arase, Y., Xie, X., Hara, T., Nishio, S.: Mining people’s trips from large scale geo-tagged photos. In: 18th ACM International Conference on Multimedia, pp. 133–142. Firenze, Italy (2010)

  2. Bao, B.-K., Min, W., Sang, J., Xu, C.: Multimedia news digger on emerging topics from social streams. In: Proceedings of the 20th ACM International Conference on Multimedia, MM ’12, pp. 1357–1358 (2012)

  3. Becker, H., Naaman, M., Gravano, L.: Event identification in social media. In: 12th International Workshop on the Web and Databases. Providence, USA (2009)

  4. Billsus, D., Pazzani, M.J.: A hybrid user model for news story classification. In: Proceedings of the Seventh International Conference on User Modeling, pp. 99–108 (1999)

  5. Chen, K.-Y., Luesukprasert, L., Chou, S.-C.T.: Hot topic extraction based on timeline analysis and multidimensional sentence modeling. IEEE Trans. Knowl. Data Eng. 19(8), 1016–1025 (2007)

    Article  Google Scholar 

  6. Chen, L., Roy, A.: Event detection from flickr data through wavelet-based spatial analysis. In: ACM Conference on CIKM (2009)

  7. Delgado, D., Magalhães, J.A., Correia, N.: Assisted news reading with automated illustrations. In: ACM Conference on Multimedia, pp. 1647–1650 (2010)

  8. Diakopoulos, N., Naaman, M., Kivran-Swaine, F.: Diamonds in the rough: social media visual analytics for journalistic inquiry. In: 2010 IEEE Symposium on Visual Analytics Science and Technology, pp. 115–122 (2010)

  9. Fialho, A., Troncy, R., Hardman, L., Saathoff, C., Scherp, A.: What’s on this evening? Designing user support for event-based annotation and exploration of media. In: 1st International Workshop on EVENTS—Recognising and Tracking Events on the Web and in Real Life, pp. 40–54. Athens, Greece (2010)

  10. Joshi, D., Wang, J.Z., Li, J.: The story picturing engine—a system for automatic text illustration. ACM Trans. Multimed. Comput. Commun. Appl. 2(1), 68–89 (2006)

    Article  Google Scholar 

  11. Liu, X., Troncy, R., Huet, B.: Finding media illustrating events. In: 1st ACM International Conference on Multimedia Retrieval. Trento, Italy (2011)

  12. Mattivi, R., Uijlings, J., De Natale, F., Sebe, N.: Categorization of a collection of pictures into structured events. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, p. 1. New York, USA (2012)

  13. Min, W., Bao, B.-K., Xu, C.: What happened near big ben: event-driven landmark mining from flickr. In: Proceedings of the 13th Pacific-Rim Conference on Advances in Multimedia Information Processing, PCM’12, pp. 769–778. Springer, Berlin (2012)

  14. Quack, T., Leibe, B., Van Gool, L.: World-scale mining of objects and events from community photo collections. In: Proceedings of the 2008 International Conference on Content-Based Image and Video Retrieval, p. 47. New York, USA (2008)

  15. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: International Conference on WWW, pp. 851–860 (2010)

  16. Schwarz, K., Rojtberg, P., Caspar, J., Gurevych, I., Goesele, M., Lensch, H.P.A.: Text-to-Video: story illustration from online photo collections. Knowl. Based Intell. Inf. Eng. Syst. 6279, 402–409 (2010)

    Article  Google Scholar 

  17. Toda, H., Kataoka, R.: A clustering method for news articles retrieval system. In: Special Interest Tracks and Posters of the 14th International Conference on World Wide Web, p. 988. New York, USA (2005)

  18. Trad, M.R., Joly, A., Boujemaa, N.: Large scale visual-based event matching. In: Proceedings of the 1st ACM International Conference on Multimedia Retrieval, pp. 1–7. New York, USA (2011)

  19. Troncy, R., Malocha, B., Fialho, A.: Linking events with media. In: 6th International Conference on Semantic Systems. Graz, Austria (2010)

  20. Weng, J., Lee, B.-S.: Event eetection in Twitter. In: Fifth International AAAI Conference on Weblogs and Social Media, pp. 401–408. HP Laboratories (2011)

  21. Westermann, U., Jain, R.: Toward a common event model for multimedia applications. IEEE MultiMed. 14(1), 19–29 (2007)

    Article  Google Scholar 

  22. Zheng, Y.-T., Zhao, M., Song, Y., Adam, H., Buddemeier, U., Bissacco, A., Brucher, F., Chua, T.-S., Neven, H.: Tour the world: building a web-scale landmark recognition engine. In: 22nd International Conference on Computer Vision and Pattern Recognition. Miami, Florida, USA (2009)

  23. Zhu, X., Goldberg, A.B., Eldawy, M., Dyer, C.R., Strock, B.: A text-to-picture synthesis system for augmenting communication. In: Proceedings of the 22nd National Conference on Artificial Intelligence, vol. 2, pp. 1590–1595 (2007)

Download references

Acknowledgments

This work was supported by the National Basic Research Program of China (No. 2013CB329604), the European Commission under contracts FP7-287911 LinkedTV and FP7-318101 MediaMixer.

Author information

Authors and Affiliations

  1. School of Computer and Information, Hefei University of Technology, Hefei, China

    Xueliang Liu

  2. EURECOM, Sophia-Antipolis, France

    Benoit Huet

Authors
  1. Xueliang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benoit Huet
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xueliang Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, X., Huet, B. Linking socially contributed media with events. Multimedia Systems 22, 433–442 (2016). https://doi.org/10.1007/s00530-014-0436-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-014-0436-3

Keywords

Search

Navigation