Dustin Freeman
Ravin Balakrishnan
ABSTRACT
We present Tangible Actions, an ad-hoc, just-in-time, visual programming by example language designed for large multitouch interfaces. With the design of Tangible Actions, we contribute a continually-created system of programming tokens that occupy the same space as the objects they act on. Tangible Actions are created by the gestural actions of the user, and they allow the user to reuse and modify their own gestures with a lower interaction cost than the original gesture. We implemented Tangible Actions in three different tabletop applications, and ran an informal evaluation. While we found that study participants generally liked and understood Tangible Actions, having the objects and the actions co-located can lead to visual and interaction clutter.
Supplemental Material
- Agarawala, A. and Balakrishnan, B. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. ACM CHI 2006, pp. 1283--1292. Google Scholar
Digital Library
- Beaudouin-Lafon, M. Instrumental Interaction: An Interaction Model for Designing Post-WIMP User Interfaces. ACM CHI 2000, pp. 446--453. Google ScholarDigital Library
- Bartneck, C., & Funk, M. Dancing With Myself: The Interactive Visual Canon Platform. ACM CHI 2009, pp. 3501--3502. Google ScholarDigital Library
- Baudisch, P., Tan, D., Collomb, M., Robbins, D., Hinckley, K., Agrawala, M., Zhao, S., and Ramos, G. Phosphor: Explaining Transitions in the User Interface Using Afterglow Effects. ACM UIST 2006, pp. 169--178. Google ScholarDigital Library
- Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P. Bederson, B., and Zierlinger, A. Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-operated Systems. INTERACT 2003, pp. 57--64.Google Scholar
- Bezerianos, A., Dragicevic, P., Balakrishnan, R. Mnemonic rendering: An image-based approach for exposing hidden changes in dynamic displays. ACM UIST 2006, pp. 159--168. Google ScholarDigital Library
- Bezerianos, A. and Balakrishnan, R. The Vacuum: Facilitating the manipulation of distant objects. ACM CHI 2005, pp. 361--370. Google ScholarDigital Library
- Bødker, S. and Andersen, P. B. Complex Mediation. ACM Human-Computer Interaction, 20 (4), 2005, pp. 353--402. Google ScholarDigital Library
- Chang, T-H., Yeh, T. and Miller, R. GUI Testing Using Computer Vision. ACM CHI 2010, pp 1535--1544. Google ScholarDigital Library
- Xiang Cao, Clifton Forlines, and Ravin Balakrishnan. Multi-user interaction using handheld projectors. ACM UIST 2007. pp, 43--52. Google ScholarDigital Library
- Clark, H. (1996). Using Language. Cambridge: Cambridge University Press.Google Scholar
- Cypher, A. (Ed.). (1993). Watch What I Do: Programming by Demonstration. Cambridge, MA: MIT Press. Google ScholarDigital Library
- Edwards, K. W., Igarashi, T., LaMarca, A., and Mynatt, E. D. 2000. A temporal model for multi-level undo and redo. ACM UIST 2000. pp 31--40. Google ScholarDigital Library
- Freeman, D., Benko, H., Ringel-Morris, M. and Wigdor, D. ShadowGuides: Visualizations for In-Situ Learning of Multitouch and Whole-Hand Gestures. ACM ITS 2009, pp. 165--172. Google ScholarDigital Library
- Frohlich, D. (1993) The History and Future of Direct Manipulation. Behaviour & Information Technology 12, 6 (1992), pp 315--329.Google Scholar
- Kazi, R. H., Chua, K. C., Zhao, S., Davis, R., and Low, K. SandCanvas: a multi-touch art medium inspired by sand animation. ACM CHI 2011. pp. 1283--1292. Google ScholarDigital Library
- Hutchins, E., Hollan, J. and Norman, D. (1985). Direct Manipulation Interfaces, in Norman, D. and Draper, Stephen W. (Editors), User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, pp. 87--124.Google Scholar
- Igarashi, T., Matsuoka, S., Kawachiya, S. and Tanaka, H. Interactive beautification: a technique for rapid geometric design. ACM SIGGRAPH 2007. Google ScholarDigital Library
- Joy, W. An Introduction to the C Shell. In UNIX Programmer's Manual, Seventh Edition, Third Berkeley UNIX Distribution, Dept. of EE & CS, University of California, Berkeley, 1979.Google Scholar
- Khan, A., Fitzmaurice, G., Almeida, D., Burtnyk, N. and Kurtenback, G. A remote control interface for large displays. ACM UIST 2004, pp 127--136. Google ScholarDigital Library
- Kobayashi, M. and Igarashi, T. Boomerang: suspendable drag-and-drop interactions based on a throw-and-catch metaphor. ACM UIST 2007, pp 187--190. Google ScholarDigital Library
- Kurlander, D. and Feiner, S. A History-Based Macro By Example System. ACM UIST 1992, pp 99--106. Google ScholarDigital Library
- Lieberman, H. (ed.) (2001). Your Wish is My Command: Programming by Example. San Francisco: Morgan Kaufmann.Google Scholar
- Malan, D. and Leitner, H. Scratch for budding computer scientists. ACM SIGCSE 2007, pp. 223--227. Google ScholarDigital Library
- MERL DiamondTouch. http://www.merl.com/projects/DiamondTouch/Google Scholar
- Microsoft Surface, http://www.microsoft.com/surfaceGoogle Scholar
- Myers, B. Demonstrational Interfaces: A Step Beyond Direct Manipulation. IEEE Computer 25, 8 (August 1992), 61--73. Google ScholarDigital Library
- Natural User Interface Group, http://nuigroup.comGoogle Scholar
- Potter, R. "Just-in-Time Programming". In A. Cypher, editor, Watch What I do: Programming by Demonstration, MIT Press, London, England, 1993. Google ScholarDigital Library
- Ritchie, D. 1979. The Evolution of the Unix Time-Sharing System. In Proceedings of a Symposium on Language Design and Programming Methodology, Jeffrey M. Tobias (Ed.). Springer-Verlag, London, UK, pp. 25--36. Google ScholarDigital Library
- Ruvini, Jean-David. The Challenges of Implicit Programming by Example. ACM IUI 2004.Google Scholar
- Shneiderman, Ben (1983). Direct Manipulation: A Step Beyond Programming Languages. Computer, Vol. 16, No. 8, Aug. 1983, pp. 57--69. Google ScholarDigital Library
- SMART Table. http://smarttech.com/tableGoogle Scholar
- Stuerzlinger, W., Chapuis, O., Phillips, D., and Roussel, N. User interface façades: towards fully adaptable user interfaces. ACM UIST 2006. pp, 309--318 Google ScholarDigital Library
- Su, S., Paris, S., Aliaga, F., Scull, C., Johnson, S. and Durand, F. (2009). Interactive Visual Histories for Vector Graphics. MIT CSAIL Technical Report June 24, 2009.Google Scholar
- Teitelman, W. and Masinter, L. The Interlisp programming environment, Computer vol. 14, no. 4, 1981, pp. 25--34 Google ScholarDigital Library
Index Terms
- Tangible actions
Recommendations
Exploring how tangible tools enable collaboration in a multi-touch tabletop game
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IIDigital tabletop surfaces afford multiple user interaction and collaboration. Hybrid tabletops that include both tangible and multitouch elements are increasingly being deployed in public settings (e.g. Microsoft Surface, reacTable). Designers need to ...
Supporting Collaboration on Very Large-Scale Interactive Wall Surfaces
In this paper we describe CubIT, a multi-user presentation and collaboration system installed at the Queensland University of Technology's (QUT) Cube facility. The `Cube' is an interactive visualisation facility made up of five very large-scale ...
PeriTop: extending back-projected tabletops with top-projected peripheral displays
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfacesIntegrating digital tabletops into homes or desktop environments will give rise to a set of problems emerging from placing everyday objects on interactive tabletops. Chief among them is the arbitrary placement of physical objects that considerably ...
Comments