skip to main content
10.1145/2076354.2076373acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

Tangible actions

Published: 13 November 2011 Publication History

Abstract

We present Tangible Actions, an ad-hoc, just-in-time, visual programming by example language designed for large multitouch interfaces. With the design of Tangible Actions, we contribute a continually-created system of programming tokens that occupy the same space as the objects they act on. Tangible Actions are created by the gestural actions of the user, and they allow the user to reuse and modify their own gestures with a lower interaction cost than the original gesture. We implemented Tangible Actions in three different tabletop applications, and ran an informal evaluation. While we found that study participants generally liked and understood Tangible Actions, having the objects and the actions co-located can lead to visual and interaction clutter.

Supplementary Material

JPG File (p87-freeman.jpg)
MP4 File (p87-freeman.mp4)

References

[1]
Agarawala, A. and Balakrishnan, B. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. ACM CHI 2006, pp. 1283--1292.
[2]
Beaudouin-Lafon, M. Instrumental Interaction: An Interaction Model for Designing Post-WIMP User Interfaces. ACM CHI 2000, pp. 446--453.
[3]
Bartneck, C., & Funk, M. Dancing With Myself: The Interactive Visual Canon Platform. ACM CHI 2009, pp. 3501--3502.
[4]
Baudisch, P., Tan, D., Collomb, M., Robbins, D., Hinckley, K., Agrawala, M., Zhao, S., and Ramos, G. Phosphor: Explaining Transitions in the User Interface Using Afterglow Effects. ACM UIST 2006, pp. 169--178.
[5]
Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P. Bederson, B., and Zierlinger, A. Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-operated Systems. INTERACT 2003, pp. 57--64.
[6]
Bezerianos, A., Dragicevic, P., Balakrishnan, R. Mnemonic rendering: An image-based approach for exposing hidden changes in dynamic displays. ACM UIST 2006, pp. 159--168.
[7]
Bezerianos, A. and Balakrishnan, R. The Vacuum: Facilitating the manipulation of distant objects. ACM CHI 2005, pp. 361--370.
[8]
Bødker, S. and Andersen, P. B. Complex Mediation. ACM Human-Computer Interaction, 20 (4), 2005, pp. 353--402.
[9]
Chang, T-H., Yeh, T. and Miller, R. GUI Testing Using Computer Vision. ACM CHI 2010, pp 1535--1544.
[10]
Xiang Cao, Clifton Forlines, and Ravin Balakrishnan. Multi-user interaction using handheld projectors. ACM UIST 2007. pp, 43--52.
[11]
Clark, H. (1996). Using Language. Cambridge: Cambridge University Press.
[12]
Cypher, A. (Ed.). (1993). Watch What I Do: Programming by Demonstration. Cambridge, MA: MIT Press.
[13]
Edwards, K. W., Igarashi, T., LaMarca, A., and Mynatt, E. D. 2000. A temporal model for multi-level undo and redo. ACM UIST 2000. pp 31--40.
[14]
Freeman, D., Benko, H., Ringel-Morris, M. and Wigdor, D. ShadowGuides: Visualizations for In-Situ Learning of Multitouch and Whole-Hand Gestures. ACM ITS 2009, pp. 165--172.
[15]
Frohlich, D. (1993) The History and Future of Direct Manipulation. Behaviour & Information Technology 12, 6 (1992), pp 315--329.
[16]
Kazi, R. H., Chua, K. C., Zhao, S., Davis, R., and Low, K. SandCanvas: a multi-touch art medium inspired by sand animation. ACM CHI 2011. pp. 1283--1292.
[17]
Hutchins, E., Hollan, J. and Norman, D. (1985). Direct Manipulation Interfaces, in Norman, D. and Draper, Stephen W. (Editors), User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, pp. 87--124.
[18]
Igarashi, T., Matsuoka, S., Kawachiya, S. and Tanaka, H. Interactive beautification: a technique for rapid geometric design. ACM SIGGRAPH 2007.
[19]
Joy, W. An Introduction to the C Shell. In UNIX Programmer's Manual, Seventh Edition, Third Berkeley UNIX Distribution, Dept. of EE & CS, University of California, Berkeley, 1979.
[20]
Khan, A., Fitzmaurice, G., Almeida, D., Burtnyk, N. and Kurtenback, G. A remote control interface for large displays. ACM UIST 2004, pp 127--136.
[21]
Kobayashi, M. and Igarashi, T. Boomerang: suspendable drag-and-drop interactions based on a throw-and-catch metaphor. ACM UIST 2007, pp 187--190.
[22]
Kurlander, D. and Feiner, S. A History-Based Macro By Example System. ACM UIST 1992, pp 99--106.
[23]
Lieberman, H. (ed.) (2001). Your Wish is My Command: Programming by Example. San Francisco: Morgan Kaufmann.
[24]
Malan, D. and Leitner, H. Scratch for budding computer scientists. ACM SIGCSE 2007, pp. 223--227.
[25]
MERL DiamondTouch. http://www.merl.com/projects/DiamondTouch/
[26]
Microsoft Surface, http://www.microsoft.com/surface
[27]
Myers, B. Demonstrational Interfaces: A Step Beyond Direct Manipulation. IEEE Computer 25, 8 (August 1992), 61--73.
[28]
Natural User Interface Group, http://nuigroup.com
[29]
Potter, R. "Just-in-Time Programming". In A. Cypher, editor, Watch What I do: Programming by Demonstration, MIT Press, London, England, 1993.
[30]
Ritchie, D. 1979. The Evolution of the Unix Time-Sharing System. In Proceedings of a Symposium on Language Design and Programming Methodology, Jeffrey M. Tobias (Ed.). Springer-Verlag, London, UK, pp. 25--36.
[31]
Ruvini, Jean-David. The Challenges of Implicit Programming by Example. ACM IUI 2004.
[32]
Shneiderman, Ben (1983). Direct Manipulation: A Step Beyond Programming Languages. Computer, Vol. 16, No. 8, Aug. 1983, pp. 57--69.
[33]
SMART Table. http://smarttech.com/table
[34]
Stuerzlinger, W., Chapuis, O., Phillips, D., and Roussel, N. User interface façades: towards fully adaptable user interfaces. ACM UIST 2006. pp, 309--318
[35]
Su, S., Paris, S., Aliaga, F., Scull, C., Johnson, S. and Durand, F. (2009). Interactive Visual Histories for Vector Graphics. MIT CSAIL Technical Report June 24, 2009.
[36]
Teitelman, W. and Masinter, L. The Interlisp programming environment, Computer vol. 14, no. 4, 1981, pp. 25--34

Cited By

View all
  • (2013)Stripe action: A novel technique for performing icons in multi-touch interfacesProceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC)10.1109/MEC.2013.6885261(1271-1274)Online publication date: Dec-2013
  • (2012)HandyWidgetsProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396667(197-200)Online publication date: 11-Nov-2012

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
November 2011
295 pages
ISBN:9781450308717
DOI:10.1145/2076354
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. end-user programming
  2. gestures
  3. multitouch
  4. programming by example
  5. scripting
  6. visual programming

Qualifiers

  • Research-article

Conference

ITS'11
Sponsor:
ITS'11: Interactive Tabletops and Surfaces
November 13 - 16, 2011
Kobe, Japan

Acceptance Rates

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2013)Stripe action: A novel technique for performing icons in multi-touch interfacesProceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC)10.1109/MEC.2013.6885261(1271-1274)Online publication date: Dec-2013
  • (2012)HandyWidgetsProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396667(197-200)Online publication date: 11-Nov-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media