Diogo Cabral
ABSTRACT
Digital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. Pen and touch interactions presented in tablet computers are natural and efficient. Pen additional data, like pressure and tilt, can be used for novel interactions. However, most of the previous research that combines pen and touch inputs discards such additional inputs and limits the interactions to Cartesian coordinates and is applied to data visualization or static media contexts. In this work, we have implemented a prototype running on a tablet that aims to facilitate video browsing through the combination of pinch gestures and pen tilt. It aims to provide more natural and tangible interactions to control dynamic media and, at the same time, promote novel interactions using familiar inputs.
Supplemental Material
- Peter Brandl, Clifton Forlines, Daniel Wigdor, Michael Haller, and Chia Shen. 2008. Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction on Horizontal Interfaces. In Proc. of AVI ’08 (Napoli, Italy) (AVI ’08). Association for Computing Machinery, New York, NY, USA, 154–161. https://doi.org/10.1145/1385569.1385595Google Scholar
Digital Library
- Diogo Cabral and Nuno Correia. 2012. Videoink: A Pen-Based Approach for Video Editing. In Adjunct Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST Adjunct Proceedings ’12). Association for Computing Machinery, New York, NY, USA, 67–68. https://doi.org/10.1145/2380296.2380325Google ScholarDigital Library
- Diogo Cabral and Nuno Correia. 2017. Video editing with pen-based technology. Multimedia Tools and Applications 76, 5 (2017), 6889–6914. https://doi.org/10.1007/s11042-016-3329-yGoogle ScholarDigital Library
- Diogo Cabral, Marcelo Ramos, and Pedro F. Campos. 2020. Applying Pen Pressure, Tilt and Touch Interactions to Data Visualizations. In Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces (Virtual Event, Portugal) (ISS ’20). Association for Computing Machinery, New York, NY, USA, 57–60. https://doi.org/10.1145/3380867.3426198Google ScholarDigital Library
- Ken Dancyger. 2018. The technique of film and video editing: history, theory, and practice. Routledge, New York, NY, USA.Google Scholar
- Nicholas Diakopoulos and Irfan Essa. 2006. Videotater: An Approach for Pen-Based Digital Video Segmentation and Tagging. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology(Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 221–224. https://doi.org/10.1145/1166253.1166287Google ScholarDigital Library
- William Hamilton, Andruid Kerne, and Tom Robbins. 2012. High-Performance Pen + Touch Modality Interactions: A Real-Time Strategy Game ESports Context. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 309–318. https://doi.org/10.1145/2380116.2380156Google ScholarDigital Library
- Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang ’Anthony’ Chen, Fabrice Matulic, William Buxton, and Andrew Wilson. 2014. Sensing Techniques for Tablet+stylus Interaction. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 605–614. https://doi.org/10.1145/2642918.2647379Google ScholarDigital Library
- Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + Touch = New Tools. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 27–36. https://doi.org/10.1145/1866029.1866036Google ScholarDigital Library
- Nam Wook Kim, Nathalie Henry Riche, Benjamin Bach, Guanpeng Xu, Matthew Brehmer, Ken Hinckley, Michel Pahud, Haijun Xia, Michael J. McGuffin, and Hanspeter Pfister. 2019. DataToon: Drawing Dynamic Network Comics With Pen + Touch Interaction. In Proc. of CHI ’19 (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300335Google ScholarDigital Library
- Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/2512349.2512802Google ScholarDigital Library
- Ken Pfeuffer, Ken Hinckley, Michel Pahud, and Bill Buxton. 2017. Thumb + Pen Interaction on Tablets. In Proc. of CHI ’17 (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3254–3266. https://doi.org/10.1145/3025453.3025567Google ScholarDigital Library
- Gonzalo Ramos and Ravin Balakrishnan. 2003. Fluid Interaction Techniques for the Control and Annotation of Digital Video. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology(Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 105–114. https://doi.org/10.1145/964696.964708Google ScholarDigital Library
- Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proc. of CHI ’04 (Vienna, Austria) (CHI ’04). Association for Computing Machinery, New York, NY, USA, 487–494. https://doi.org/10.1145/985692.985754Google ScholarDigital Library
- Hugo Romat, Nathalie Henry Riche, Ken Hinckley, Bongshin Lee, Caroline Appert, Emmanuel Pietriga, and Christopher Collins. 2019. ActiveInk: (Th)Inking with Data. In Proc. of CHI ’19 (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300272Google ScholarDigital Library
- Stephanie Santosa, Fanny Chevalier, Ravin Balakrishnan, and Karan Singh. 2013. Direct Space-Time Trajectory Control for Visual Media Editing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 1149–1158. https://doi.org/10.1145/2470654.2466148Google ScholarDigital Library
- Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection Using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2009–2012. https://doi.org/10.1145/2556288.2557056Google ScholarDigital Library
- Abigail J. Sellen and Richard H.R. Harper. 2003. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA.Google ScholarDigital Library
- Ben Shneiderman. 2007. Creativity Support Tools: Accelerating Discovery and Innovation. Commun. ACM 50, 12 (dec 2007), 20–32. https://doi.org/10.1145/1323688.1323689Google ScholarDigital Library
- Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Proc. of CHI ’20 (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376782Google ScholarDigital Library
- Yizhong Xin, Xiaojun Bi, and Xiangshi Ren. 2011. Acquiring and Pointing: An Empirical Study of Pen-Tilt-Based Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 849–858. https://doi.org/10.1145/1978942.1979066Google ScholarDigital Library
- E. Zgraggen, R. Zeleznik, and S. M. Drucker. 2014. PanoramicData: Data Analysis through Pen Touch. IEEE Transactions on Visualization and Computer Graphics 20, 12(2014), 2112–2121.Google ScholarCross Ref
- Jiayi Eris Zhang, Nicole Sultanum, Anastasia Bezerianos, and Fanny Chevalier. 2020. DataQuilt: Extracting Visual Elements from Images to Craft Pictorial Visualizations. In Proc. of CHI ’20 (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376172Google ScholarDigital Library
Index Terms
- Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets
UIST '21: The 34th Annual ACM Symposium on User Interface Software and TechnologyTablets are attractive for design work anywhere, but 3D manipulations are notoriously difficult. We explore how engaging the stylus and multi-touch in concert can render such tasks easier. We introduce Bi-3D, an interaction concept where touch gestures ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionThe proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets ...
Comments