Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
Pages 285 - 287
Abstract
Digital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. Pen and touch interactions presented in tablet computers are natural and efficient. Pen additional data, like pressure and tilt, can be used for novel interactions. However, most of the previous research that combines pen and touch inputs discards such additional inputs and limits the interactions to Cartesian coordinates and is applied to data visualization or static media contexts. In this work, we have implemented a prototype running on a tablet that aims to facilitate video browsing through the combination of pinch gestures and pen tilt. It aims to provide more natural and tangible interactions to control dynamic media and, at the same time, promote novel interactions using familiar inputs.
Supplementary Material
Demo video
- Download
- 55.13 MB
References
[1]
Peter Brandl, Clifton Forlines, Daniel Wigdor, Michael Haller, and Chia Shen. 2008. Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction on Horizontal Interfaces. In Proc. of AVI ’08 (Napoli, Italy) (AVI ’08). Association for Computing Machinery, New York, NY, USA, 154–161. https://doi.org/10.1145/1385569.1385595
[2]
Diogo Cabral and Nuno Correia. 2012. Videoink: A Pen-Based Approach for Video Editing. In Adjunct Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST Adjunct Proceedings ’12). Association for Computing Machinery, New York, NY, USA, 67–68. https://doi.org/10.1145/2380296.2380325
[3]
Diogo Cabral and Nuno Correia. 2017. Video editing with pen-based technology. Multimedia Tools and Applications 76, 5 (2017), 6889–6914. https://doi.org/10.1007/s11042-016-3329-y
[4]
Diogo Cabral, Marcelo Ramos, and Pedro F. Campos. 2020. Applying Pen Pressure, Tilt and Touch Interactions to Data Visualizations. In Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces (Virtual Event, Portugal) (ISS ’20). Association for Computing Machinery, New York, NY, USA, 57–60. https://doi.org/10.1145/3380867.3426198
[5]
Ken Dancyger. 2018. The technique of film and video editing: history, theory, and practice. Routledge, New York, NY, USA.
[6]
Nicholas Diakopoulos and Irfan Essa. 2006. Videotater: An Approach for Pen-Based Digital Video Segmentation and Tagging. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology(Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 221–224. https://doi.org/10.1145/1166253.1166287
[7]
William Hamilton, Andruid Kerne, and Tom Robbins. 2012. High-Performance Pen + Touch Modality Interactions: A Real-Time Strategy Game ESports Context. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 309–318. https://doi.org/10.1145/2380116.2380156
[8]
Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang ’Anthony’ Chen, Fabrice Matulic, William Buxton, and Andrew Wilson. 2014. Sensing Techniques for Tablet+stylus Interaction. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 605–614. https://doi.org/10.1145/2642918.2647379
[9]
Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + Touch = New Tools. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 27–36. https://doi.org/10.1145/1866029.1866036
[10]
Nam Wook Kim, Nathalie Henry Riche, Benjamin Bach, Guanpeng Xu, Matthew Brehmer, Ken Hinckley, Michel Pahud, Haijun Xia, Michael J. McGuffin, and Hanspeter Pfister. 2019. DataToon: Drawing Dynamic Network Comics With Pen + Touch Interaction. In Proc. of CHI ’19 (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300335
[11]
Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/2512349.2512802
[12]
Ken Pfeuffer, Ken Hinckley, Michel Pahud, and Bill Buxton. 2017. Thumb + Pen Interaction on Tablets. In Proc. of CHI ’17 (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3254–3266. https://doi.org/10.1145/3025453.3025567
[13]
Gonzalo Ramos and Ravin Balakrishnan. 2003. Fluid Interaction Techniques for the Control and Annotation of Digital Video. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology(Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 105–114. https://doi.org/10.1145/964696.964708
[14]
Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proc. of CHI ’04 (Vienna, Austria) (CHI ’04). Association for Computing Machinery, New York, NY, USA, 487–494. https://doi.org/10.1145/985692.985754
[15]
Hugo Romat, Nathalie Henry Riche, Ken Hinckley, Bongshin Lee, Caroline Appert, Emmanuel Pietriga, and Christopher Collins. 2019. ActiveInk: (Th)Inking with Data. In Proc. of CHI ’19 (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300272
[16]
Stephanie Santosa, Fanny Chevalier, Ravin Balakrishnan, and Karan Singh. 2013. Direct Space-Time Trajectory Control for Visual Media Editing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 1149–1158. https://doi.org/10.1145/2470654.2466148
[17]
Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection Using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2009–2012. https://doi.org/10.1145/2556288.2557056
[18]
Abigail J. Sellen and Richard H.R. Harper. 2003. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA.
[19]
Ben Shneiderman. 2007. Creativity Support Tools: Accelerating Discovery and Innovation. Commun. ACM 50, 12 (dec 2007), 20–32. https://doi.org/10.1145/1323688.1323689
[20]
Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Proc. of CHI ’20 (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376782
[21]
Yizhong Xin, Xiaojun Bi, and Xiangshi Ren. 2011. Acquiring and Pointing: An Empirical Study of Pen-Tilt-Based Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 849–858. https://doi.org/10.1145/1978942.1979066
[22]
E. Zgraggen, R. Zeleznik, and S. M. Drucker. 2014. PanoramicData: Data Analysis through Pen Touch. IEEE Transactions on Visualization and Computer Graphics 20, 12(2014), 2112–2121.
[23]
Jiayi Eris Zhang, Nicole Sultanum, Anastasia Bezerianos, and Fanny Chevalier. 2020. DataQuilt: Extracting Visual Elements from Images to Craft Pictorial Visualizations. In Proc. of CHI ’20 (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376172
Index Terms
- Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets
UIST '21: The 34th Annual ACM Symposium on User Interface Software and TechnologyTablets are attractive for design work anywhere, but 3D manipulations are notoriously difficult. We explore how engaging the stylus and multi-touch in concert can render such tasks easier. We introduce Bi-3D, an interaction concept where touch gestures ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionThe proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets and ...
Comments
Information & Contributors
Information
Published In
November 2022
315 pages
ISBN:9781450398206
DOI:10.1145/3568444
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 December 2022
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Conference
MUM 2022
MUM 2022: 21th International Conference on Mobile and Ubiquitous Multimedia
November 27 - 30, 2022
Lisbon, Portugal
Acceptance Rates
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 61Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format