research-article

Improving Early Navigation in Time-Lapse Video with Spread-Frame Loading

Authors:

Michael van der Kamp,

Md. Sami Uddin,

Sally VailAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 555, Pages 1 - 12

https://doi.org/10.1145/3290605.3300785

Published: 02 May 2019 Publication History

Abstract

Time-lapse videos are often navigated by scrubbing with a slider. When networks are slow or images are large, however, even thumbnail versions load so slowly that scrubbing is limited to the start of the video. We developed a frame-loading technique called spread-loading that enables scrubbing regardless of delivery rate. Spread-loading orders frame delivery to maximize coverage of the entire sequence; this provides a temporal overview of the entire video that can be fully navigated at any time during delivery. The overview initially has a coarse temporal resolution, becoming finer-grained with each new frame. We compared spread-loading with traditional linear loading in a study where participants were asked to find specific episodes in a long time-lapse sequence, using three views with increasing levels of detail. Results show that participants found target episodes significantly and substantially faster with spread-loading, regardless of whether they could click to change the load point. Users rated spread-loading as requiring less effort, and strongly preferred the new technique.

Supplementary Material

MP4 File (paper555.mp4)

Supplemental video

Download
352.78 MB

References

[1]

Saamer Akhshabi, Ali C Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In Proceedings of the second annual ACM conference on Multimedia systems. ACM, 157--168.

Digital Library

[2]

John G Apostolopoulos, Wai-tian Tan, and Susie J Wee. 2002. Video streaming: Concepts, algorithms, and systems. HP Laboratories, report HPL-2002--260 (2002).

[3]

Mauro Barbieri, Gerhard Mekenkamp, Marco Ceccarelli, and Jan Nesvadba. 2001. The color browser: a content driven linear video browsing tool. In null. IEEE, 160.

[4]

Connelly Barnes, Dan B Goldman, Eli Shechtman, and Adam Finkelstein. 2010. Video tapestries with continuous temporal zoom. In ACM Transactions on Graphics (TOG), Vol. 29. ACM, 89.

Digital Library

[5]

Eric P Bennett and Leonard McMillan. 2007. Computational time-lapse video. In ACM Transactions on Graphics (TOG), Vol. 26. ACM, 102.

Digital Library

[6]

John Boreczky, Andreas Girgensohn, Gene Golovchinsky, and Shingo Uchihashi. 2000. An interactive comic book presentation for exploring video. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 185--192.

Digital Library

[7]

Linjun Chang, Yichen Yang, and Xian-Sheng Hua. 2008. Smart video player. In Multimedia and Expo, 2008 IEEE International Conference on. IEEE, 1605--1606.

[8]

Sarah Cohen, Werner Nutt, and Yehoshua Sagic. 2007. Deciding equivalances among conjunctive aggregate queries. J. ACM 54, 2, Article 5 (April 2007), 50 pages.

Digital Library

[9]

Oscar De Bruijn and Robert Spence. 2000. Rapid serial visual presentation: a space-time trade-off in information presentation. In Advanced visual interfaces. 189--192.

Digital Library

[10]

Pierre Dragicevic, Gonzalo Ramos, Jacobo Bibliowitcz, Derek Nowrouzezahrai, Ravin Balakrishnan, and Karan Singh. 2008. Video browsing by direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 237--246.

Digital Library

[11]

Beverly L Harrison, Russell Owen, and Ronald M Baecker. 1994. Timelines: an interactive system for the collection and visualization of temporal data. In Graphics Interface. Canadian Information Processing Society, 141--141.

[12]

Liwei He, Elizabeth Sanocki, Anoop Gupta, and Jonathan Grudin. 1999. Auto-summarization of audio-video presentations. In Proceedings of the seventh ACM international conference on Multimedia (Part 1). ACM, 489--498.

Digital Library

[13]

Yasamin Heshmat, Carman Neustaedter, and Brendan DeBrincat. 2017. The autobiographical design and long term usage of an always-on video recording system for the home. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 675--687.

Digital Library

[14]

Wolfgang Hürst. 2006. Interactive audio-visual video browsing. In Proceedings of the 14th ACM international conference on Multimedia. ACM, 675--678.

Digital Library

[15]

Damir Isovic, Gerhard Fohler, and Tomas Lennvall. 2002. Analysis of mpeg-2 video streams. Mtrc report. Mardalen Real-time Research Center, Mardalen University, Sweden (2002).

[16]

Dan Jackson, James Nicholson, Gerrit Stoeckigt, Rebecca Wrobel, Anja Thieme, and Patrick Olivier. 2013. Panopticon: A parallel video overview system. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 123--130.

Digital Library

[17]

Haojian Jin, Yale Song, and Koji Yatani. 2017. ElasticPlay: Interactive Video Summarization with Dynamic Time Budgets. In Proceedings of the 2017 ACM on Multimedia Conference. ACM, 1164--1172.

Digital Library

[18]

Neel Joshi, Wolf Kienzle, Mike Toelle, Matt Uyttendaele, and Michael F Cohen. 2015. Real-time hyperlapse creation via optimal frame selection. ACM Transactions on Graphics (TOG) 34, 4 (2015), 63.

Digital Library

[19]

Juho Kim, Philip J Guo, Carrie J Cai, Shang-Wen Daniel Li, Krzysztof Z Gajos, and Robert C Miller. 2014. Data-driven interaction techniques for improving navigation of educational videos. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 563--572.

Digital Library

[20]

Baochun Li, Zhi Wang, Jiangchuan Liu, and Wenwu Zhu. 2013. Two decades of internet video streaming: A retrospective view. ACM transactions on multimedia computing, communications, and applications (TOMM) 9, 1s (2013), 33.

Digital Library

[21]

Francis C Li, Anoop Gupta, Elizabeth Sanocki, Li-wei He, and Yong Rui. 2000. Browsing digital video. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 169--176.

Digital Library

[22]

João Martinho and Teresa Chambel. 2009. ColorsInMotion: interactive visualization and exploration of video spaces. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era. ACM, 190--197.

Digital Library

[23]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2012. Swift: reducing the effects of latency in online video scrubbing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 637--646.

Digital Library

[24]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2013. Swifter: improved online video scrubbing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1159--1168.

Digital Library

[25]

Chong-Wah Ngo, Yu-Fei Ma, and Hong-Jiang Zhang. 2005. Video summarization and scene detection by graph modeling. IEEE Transactions on Circuits and Systems for Video Technology 15, 2 (2005), 296--305.

Digital Library

[26]

Michael Nunes, Saul Greenberg, Sheelagh Carpendale, and Carl Gutwin. 2007. What did I miss? Visualizing the past through video traces. In ECSCW 2007. Springer, 1--20.

[27]

Amy Pavel, Dan B Goldman, Björn Hartmann, and Maneesh Agrawala. 2015. Sceneskim: Searching and browsing movies using synchronized captions, scripts and plot summaries. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 181-- 190.

Digital Library

[28]

Dulce Ponceleon, Savitha Srinivasan, Arnon Amir, Dragutin Petkovic, and Dan Diklic. 1998. Key to effective video retrieval: effective cataloging and browsing. In Proceedings of the sixth ACM international conference on Multimedia. ACM, 99--107.

Digital Library

[29]

Suporn Pongnumkul, Jue Wang, Gonzalo Ramos, and Michael Cohen. 2010. Content-aware dynamic timeline for video browsing. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 139--142.

Digital Library

[30]

Gonzalo Ramos and Ravin Balakrishnan. 2003. Fluid interaction techniques for the control and annotation of digital video. In Proceedings of the 16th annual ACM symposium on User interface software and technology. ACM, 105--114.

Digital Library

[31]

Alex Rav-Acha, Yael Pritch, and Shmuel Peleg. 2006. Making a long video short: Dynamic video synopsis. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, Vol. 1. IEEE, 435--441.

Digital Library

[32]

Klaus Schoeffmann, Marco A Hudelist, and Jochen Huber. 2015. Video interaction tools: a survey of recent work. ACM Computing Surveys (CSUR) 48, 1 (2015), 14.

Digital Library

[33]

Conglei Shi, Siwei Fu, Qing Chen, and Huamin Qu. 2015. VisMOOC: Visualizing video clickstream data from massive open online courses. In Visualization Symposium (PacificVis), 2015 IEEE Pacific. IEEE, 159-- 166.

[34]

Anthony Tang, Saul Greenberg, and Sidney Fels. 2009. Exploring video streams using slit-tear visualizations. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 3509--3510.

Digital Library

[35]

Shingo Uchihashi, Jonathan Foote, Andreas Girgensohn, and John Boreczky. 1999. Video manga: generating semantically meaningful CHI 2019, May 4--9, 2019, Glasgow, Scotland Uk C. Gutwin et al. video summaries. In Proceedings of the seventh ACM international conference on Multimedia (Part 1). ACM, 383--392.

Digital Library

[36]

Md Sami Uddin, Carl Gutwin, and Alix Goguey. 2017. Using artificial landmarks to improve revisitation performance and spatial learning in linear control widgets. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, 48--57.

Digital Library

[37]

Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 143--146.

Digital Library

[38]

Dapeng Wu, Yiwei Thomas Hou, Wenwu Zhu, Ya-Qin Zhang, and Jon M Peha. 2001. Streaming video over the Internet: approaches and directions. IEEE Transactions on circuits and systems for video technology 11, 3 (2001), 282--300.

Digital Library

[39]

Baoquan Zhao, Shujin Lin, Xiaonan Luo, Songhua Xu, and Ruomei Wang. 2017. A Novel System for Visual Navigation of Educational Videos Using Multimodal Cues. In Proceedings of the 2017 ACM on Multimedia Conference. ACM, 1680--1688.

Digital Library

Cited By

Baker AGutwin CMatejka JStavness I(2024)Interaction Techniques for Comparing VideoProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670948(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670948
Swift MAyers WPallanck SWehrwein S(2023)Visualizing the Passage of Time with Video Temporal PyramidsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320945429:1(171-181)Online publication date: Jan-2023
https://doi.org/10.1109/TVCG.2022.3209454

Index Terms

Improving Early Navigation in Time-Lapse Video with Spread-Frame Loading
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Web-based interaction

Recommendations

The video explorer: a tool for navigation and searching within a single video based on fast content analysis
MMSys '10: Proceedings of the first annual ACM SIGMM conference on Multimedia systems

We propose a video browsing tool supporting new efficient navigation means and content-based search within a single video, allowing for interactive exploration and playback of video content. The user interface provides flexible navigation indices by ...
Combining checkpointing and scrubbing in FPGA-based real-time systems
VTS '13: Proceedings of the 2013 IEEE 31st VLSI Test Symposium (VTS)

SRAM-based FPGAs provide an attractive solution for building high-performance embedded computing systems. Fault tolerant mechanisms are usually implemented in FPGA-based critical systems to improve their vulnerability to transient faults. Most fault ...
Content-driven Multi-modal Techniques for Non-linear Video Navigation
IUI '15: Proceedings of the 20th International Conference on Intelligent User Interfaces

The growth of Massive Open Online Courses (MOOCs) has been remarkable in the last few years. A significant amount of MOOCs content is in the form of videos and participants often use non-linear navigation to browse through a video. This paper proposes ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was co-authored by an affiliate of the Canadian National Government. As such, the Crown in Right of Canada retains an equal interest in the copyright. Reprint requests should be forwarded to ACM, and reprints must include clear attribution to ACM and National Research Council Canada -NRC.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
307
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Baker AGutwin CMatejka JStavness I(2024)Interaction Techniques for Comparing VideoProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670948(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670948
Swift MAyers WPallanck SWehrwein S(2023)Visualizing the Passage of Time with Video Temporal PyramidsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320945429:1(171-181)Online publication date: Jan-2023
https://doi.org/10.1109/TVCG.2022.3209454

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten