research-article

Reliving on demand: a total viewer experience

Authors:

Vivek K. Singh,

Madirakshi Das,

Peter StublerAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 333 - 342

https://doi.org/10.1145/2072298.2072342

Published: 28 November 2011 Publication History

Abstract

Billions of people worldwide use images and videos to capture various events in their lives. The primary purpose of the proposed media sharing application is digital re-living of those events by the photographers and their families and friends. The most popular tools for achieving this today are still static slide-shows (SSS) which primarily focus on visual effects rather than understanding the semantics of the media assets being used, or allowing different viewers (e.g. friends, family, who have different relationships, interests, time availabilities, and familiarities) any control over the flow of the show. We present a novel system that generates an aesthetically appealing and semantically drivable audio-visual media show based on several reliving dimensions of events, people, locations, and time. We allow each viewer to interact with the default presentation to 'on-the-fly' redirect the flow of reliving as desired from their individual perspectives. Moreover, each reliving session is logged and can be shared with other people over a wide array of platforms and devices, allowing sharing experience to go beyond the sharing of the media assets themselves. From a detailed analysis of the logged sessions across different user categories, we have obtained many interesting findings on the reliving needs, behaviors and patterns, which in turn validate our design motivations and principles.

References

[1]

D. C. A. Bulterman. Using SMIL to encode interactive, peer-level multimedia annotations. ACM Symposium on Document engineering, 2003.

Digital Library

[2]

L. Cao, J. Luo, A. Gallagher, X. Jin, J. Han, T. S. Huang. A Worldwide Tourism Recommendation System Based on Geotagged Web Photos. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, 2010.

[3]

R. G. Cattelan, C. Teixeira, R. Goularte, and M. D. G. C. Pimentel. Watch-and-comment as a paradigm toward ubiquitous interactive video editing. ACM Trans. Multimedia Comput. Commun. Appl. 4(4), Article 28, 2008.

Digital Library

[4]

J.-C. Chen, W.-T. Chu, J.-H. Kuo, C.-Y. Weng, and J.-L. Wu. Tiling Slideshow. ACM Int. Conf. on Multimedia, 2006.

Digital Library

[5]

J. Chen, J. Xiao, and Y. Gao. iSlideShow: A Content-aware Slideshow System. Int. Conf. on Intelligent User Interfaces, 2010.

Digital Library

[6]

R. Datta D. Joshi, J. Li and J.Z. Wang, Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Computing Surveys, 40(2), 2008.

Digital Library

[7]

R. Datta and J. Z. Wang. ACQUINE: Aesthetic Quality Inference Engine - Real-time Automatic Rating of Photo Aesthetics. ACM Int. Conf. on Multimedia Information Retrieval, 2010.

Digital Library

[8]

J. Huber, J. Steimle, M. Mühlhäuser. Toward More Efficient User Interfaces for Mobile Video Browsing: An In-Depth Exploration of the Design Space. ACM Int. Conf. on Multimedia, 2010.

Digital Library

[9]

A. Jaimes, D. Gatica-Perez, N. Sebe, and T. Huang. Human-Centered Computing: Toward a Human Revolution. IEEE Computer, 40(5), 30--34, 2007.

Digital Library

[10]

R. Jain. EventWeb: Events and Experiences in Human Centered Computing. IEEE Computer, 2008.

[11]

W. Jiang, A.C. Loui, C.D. Cerosaletti. Automatic Aesthetic Value Assessment in Photographic Images. IEEE Int. Conf. on Multimedia and Expo, 2010.

[12]

Y. Ke, X. Tang, and F. Jing. The Design of High-Level Features for Photo Quality Assessment. IEEE Int. Conf. on CVPR, 2006.

Digital Library

[13]

A. C. Loui, A. Savakis. Automated Event Clustering and Quality Screening of Consumer Pictures for Digital Albuming. IEEE Trans. on Multimedia, 5(3), 2003.

Digital Library

[14]

W.-Y. Ma. Rethinking Multimedia Search in the "Clients + Cloud" Era. ACM Int. Workshop on Large-scale Multimedia Retrieval and Mining, 2009.

Digital Library

[15]

G. Marchionini. Exploratory Search: From Finding to Understanding. ACM Communications, 49(4), 41--46, 2006.

Digital Library

[16]

M. Rabbath, P. Sandhus P, S. Boll. Automatic Creation of Photo Books from Stories in Social Media, ACM Int. Workshop on Social Media, 2010.

Digital Library

[17]

K. Ren, R. Sarvas, and J. Ćalić. Interactive Search and Browsing Interface for Large-scale Visual Repositories, Multimedia Tools and Applications, 2010.

Digital Library

[18]

Y. Rui, T.S. Huang, and S. Mehrotra. Content-Based Image Retrieval with Relevance Feedback in MARS. IEEE Int. Conf. Image Processing, 1997.

[19]

A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-Based Image Retrieval at the End of the Early Years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349--1380, 2000

Digital Library

[20]

C.G.M. Snoek, K.E.A. van de Sande, O. de Rooij, B. Huurnink, E. Gavves, D. Odijk, M. de Rijke, Th. Gevers, M. Worring, D.C. Koelma, A.W.M. Smeulders. The MediaMill TRECVID 2010 Semantic Video Search Engine. NIST TRECVID Workshop, 2010.

[21]

P. Viola and M. Jones. Rapid Object Detection using a Boosted Cascade of Simple Features. IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2001.

[22]

J. Xiao, X. Zhang, P. Cheatle, Y. Gao, and C. B. Atkins. Mixed-Initiative Photo Collage Authoring. ACM Int. Conf. on Multimedia, 2008.

Digital Library

[23]

S. Xu, T. Jin, F. C. M. Lau. Automatic Generation of Music Slide Show Using Personal Photos. IEEE Int. Symposium on Multimedia, 2008.

Digital Library

[24]

K.-P. Yee, K. Swearingen, K. Li, and M. Hearst. Faceted Metadata for Image Search and Browsing. ACM SIGCHI Conf. on Human factors in Computing Systems, 2003.

Digital Library

Cited By

Fulgencio HFarmer JBuchanan GStevenson D(2018)Conceptualizing the everyday life application componentsProceedings of the 30th Australian Conference on Computer-Human Interaction10.1145/3292147.3292195(88-91)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3292147.3292195
Laiola Guimaraes RCesar PBulterman DPrazeres CSampaio PSantanchè ASantos CGoularte R(2013)Personalized presentations from community assetsProceedings of the 19th Brazilian symposium on Multimedia and the web10.1145/2526188.2526208(257-264)Online publication date: 5-Nov-2013
https://dl.acm.org/doi/10.1145/2526188.2526208
Bulterman DCesar PGuimarães R(2013)Socially-aware multimedia authoringACM Transactions on Multimedia Computing, Communications, and Applications10.1145/24918939:1s(1-23)Online publication date: 17-Oct-2013
https://dl.acm.org/doi/10.1145/2491893
Show More Cited By

Index Terms

Reliving on demand: a total viewer experience
1. Applied computing
  1. Document management and text processing
    1. Document preparation
      1. Multi / mixed media creation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Hypertext / hypermedia

Recommendations

Dynamic media show drivable by semantics
MM '11: Proceedings of the 19th ACM international conference on Multimedia

We demonstrate a system to generate dynamic media shows that are significantly richer than static slide shows, which are currently the most popular form of photo playback. The goal is to enable media reliving experiences that are aesthetically pleasing, ...
Watching and talking: media content as social nexus
ICMR '12: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval

New multimedia applications, such as community-created video repositories and tools for synchronous sharing, have revolutionized the ways that media is watched and shared. Effective instrumentation of these applications can enable researchers and system ...
A holistic design perspective on media capturing and reliving
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

People capture far more media than they are able to relive. In this paper we identify the discrepancy between media capturing and media reliving from a design perspective. We propose a holistic perspective, that invites designers of media experiences to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fulgencio HFarmer JBuchanan GStevenson D(2018)Conceptualizing the everyday life application componentsProceedings of the 30th Australian Conference on Computer-Human Interaction10.1145/3292147.3292195(88-91)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3292147.3292195
Laiola Guimaraes RCesar PBulterman DPrazeres CSampaio PSantanchè ASantos CGoularte R(2013)Personalized presentations from community assetsProceedings of the 19th Brazilian symposium on Multimedia and the web10.1145/2526188.2526208(257-264)Online publication date: 5-Nov-2013
https://dl.acm.org/doi/10.1145/2526188.2526208
Bulterman DCesar PGuimarães R(2013)Socially-aware multimedia authoringACM Transactions on Multimedia Computing, Communications, and Applications10.1145/24918939:1s(1-23)Online publication date: 17-Oct-2013
https://dl.acm.org/doi/10.1145/2491893
Jansen JCesar PGuimaraes RBulterman DConcolato CSchmitz P(2012)Just-in-time personalized video presentationsProceedings of the 2012 ACM symposium on Document engineering10.1145/2361354.2361368(59-68)Online publication date: 4-Sep-2012
https://dl.acm.org/doi/10.1145/2361354.2361368
Singh VLuo JJoshi DDas MLei PStubler PCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Dynamic media show drivable by semanticsProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072473(815-816)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072473

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten