research-article

VIGO: instrumental interaction in multi-surface environments

Authors:

Clemens Nylandsted Klokmose,

Michel Beaudouin-LafonAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 869 - 878

https://doi.org/10.1145/1518701.1518833

Published: 04 April 2009 Publication History

Abstract

This paper addresses interaction in multi-surface environments and questions whether the current application-centric approaches to user interfaces are adequate in this context, and presents an alternative approach based on instrumental interaction. The paper presents the VIGO (Views, Instruments, Governors and Objects) architecture and describes a prototype implementation. It then illustrates how to apply VIGO to support distributed interaction. Finally, it demonstrates how a classical Ubicomp interaction technique, Pick-and-Drop, can be easily implemented using VIGO.

Supplementary Material

JPG File (32.jpg)

Download
7.62 KB

JPG File (p869.jpg)

Download
8.10 KB

FLV File (32.flv)

Download
18.22 MB

MOV File (p869.mov)

Download
27.79 MB

References

[1]

C. Appert and M. Beaudouin-Lafon. Swingstates: adding state machines to the swing toolkit. In Proc. ACM User Interface Software Technology (UIST'2006), 319--322, New York, NY, USA, 2006. ACM.

Digital Library

[2]

R. Ballagas, M. Ringel, M. Stone, and J. Borchers. istuff: a physical user interface toolkit for ubiquitous computing environments. In Proc. ACM conference on Human factors in computing systems (CHI'03), 537--544, New York, NY, USA, 2003. ACM.

Digital Library

[3]

L. Balme, A. Demeure, N. Barralon, J. Coutaz, and G. Calvary. CAMELEON-RT: a software architecture reference model for distributed, migratable, and plastic user interfaces. In EUSAI 2004, LNCS 3295, 291--302, 2004.

[4]

M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proc. ACM Conference on Human Factors in Computing Systems (CHI'2000), 446--453. ACM Press, 2000.

Digital Library

[5]

M. Beaudouin-Lafon and W. E. Mackay. Reification, polymorphism and reuse: three principles for designing visual interfaces. In Proc. ACM Conference on Advanced Visual Interfaces (AVI'2000), 102--109, New York, NY, USA, 2000. ACM.

Digital Library

[6]

O. Beaudoux and M. Beaudouin-Lafon. Dpi: A conceptual model based on documents and interaction instruments. In Proc. Computers XV Interaction without frontier (HCI 2001 and IHM 2001). Springer Verlag, 2001.

[7]

S. Bødker. Through the Interface. A Human Activity Approach to User Interface Design. Lawrence Erlbaum Associates, Inc., 1991.

Digital Library

[8]

C. Brodersen, S. Bødker, and C. N. Klokmose. Quality of learning in ubiquitous interaction. In Proc. European Conference on Cognitive Ergonomics (ECCE), 2007.

Digital Library

[9]

A. Demeure, J. Sottet, G. Calvary, J. Coutaz, V. Ganneau, and J. Vanderdonckt. The 4C reference model for distributed user interfaces. In Int. Conf. on Autonomic and Autonomous Systems, 61--69, 2008.

Digital Library

[10]

A. Fettig. Twisted Network Programming Essentials. O'Reilly Media, Inc., 2005.

Digital Library

[11]

E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reuseable Object-Oriented Software. Addison-Wesley, 1994.

Digital Library

[12]

T. C. N. Graham, T. Urnes, and R. Nejabi. Efficient distributed implementation of semi-replicated synchronous groupware. In Proc. ACM symposium on User interface software and technology (UIST'1998), 1--10, New York, NY, USA, 1996. ACM.

Digital Library

[13]

R. D. Hill. The abstraction-link-view paradigm: using constraints to connect user interfaces to applications. In Proc. ACM Human factors in computing systems (CHI'92), 335--342, New York, NY, USA, 1992. ACM.

Digital Library

[14]

I. Illich. Tools for Conviviality. Fontana/Collins, 1973.

[15]

G. E. Krasner and S. T. Pope. A cookbook for using the model-view controller user interface paradigm in smalltalk-80. J. Object Oriented Program., 1(3):26--49, 1988.

Digital Library

[16]

Merriam-Webster. Dictionary and Thesaurus. 2008. http://www.merriam-webster.com/.

[17]

M. Modahl, B. Agarwalla, G. Abowd, U. Ramachandran, and T. S. Saponas. Toward a standard ubiquitous computing framework. In Proc. ACM Workshop on Middleware for pervasive and ad-hoc computing (MPAC'2004), 135--139, New York, NY, USA, 2004. ACM.

Digital Library

[18]

G. Mori, F. Paternò, and C. Santoro. Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. on Soft. Eng., 30(8):507--520, 2004.

Digital Library

[19]

B. A. Myers. Separating application code from toolkits: eliminating the spaghetti of call-backs. In Proc. ACM Symposium on User interface software and technology (UIST'1991), 211--220, New York, NY, USA, 1991. ACM.

Digital Library

[20]

B. A. Myers, J. Nichols, J. O.Wobbrock, and R. C. Miller. Taking handheld devices to the next level. Computer, 37(12):36--43, 2004.

Digital Library

[21]

M. W. Newman, S. Izadi, W. K. Edwards, J. Z. Sedivy, and T. F. Smith. User interfaces when and where they are needed: an infrastructure for recombinant computing. In Proc. ACM symposium on User interface software and technology (UIST'2002), 171--180, New York, NY, USA, 2002. ACM.

Digital Library

[22]

D. R. Olsen. Evaluating user interface systems research. In Proc. ACM Symposium on User interface software and technology (UIST'2007), 251--258, New York, NY, USA, 2007. ACM.

Digital Library

[23]

D. R. Olsen, S. Jefferies, T. Nielsen, W. Moyes, and P. Fredrickson. Cross-modal interaction using xweb. In Proc. ACM Symposium on User interface software and technology (UIST'2000), 191--200, New York, NY, USA, 2000. ACM.

Digital Library

[24]

T. Reenskaug. Models - views - controllers. Technical report, Xerox Parc, 1979.

[25]

J. Rekimoto. Pick-and-drop: A direct manipulation technique for multiple computer environments. In Proc. ACM Symposium on User Interface Software and Technology (UIST'97), 31--39, 1997.

Digital Library

[26]

J. Rekimoto. A multiple device approach for supporting whiteboard-based interactions. In Proceedings of the 1998 ACM Conference on Human Factors in Computing Systems (CHI'98), 1998.

Digital Library

[27]

P. Tandler. Software infrastructure for ubiquitous computing environments: Supporting synchronous collaboration with heterogeneous devices. In Proc. International conference on Ubiquitous Computing (Ubi-Comp'2001), 96--115, London, UK, 2001. Springer-Verlag.

Digital Library

[28]

M. Weiser. The computer for the 21st century. Scientific American, 265(3):66--75, Feb. 1991.

Cited By

Borowski MFog BGriggio CEagan JKlokmose C(2022)Between Principle and Pragmatism: Reflections on Prototyping Computational Media with WebstratesACM Transactions on Computer-Human Interaction10.1145/356989530:4(1-53)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3569895
Beaudouin-Lafon MBødker SMackay W(2021)Generative Theories of InteractionACM Transactions on Computer-Human Interaction10.1145/346850528:6(1-54)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3468505
Fox AGuo PKlokmose CDalsgaard PSatyanarayan AXia HHollan JAguiar AChiba SBoix E(2020)Towards a dynamic multiscale personal information space: beyond application and document centered views of informationCompanion Proceedings of the 4th International Conference on Art, Science, and Engineering of Programming10.1145/3397537.3397542(136-143)Online publication date: 23-Mar-2020
https://dl.acm.org/doi/10.1145/3397537.3397542
Show More Cited By

Index Terms

VIGO: instrumental interaction in multi-surface environments
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Instrumental interaction: an interaction model for designing post-WIMP user interfaces
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

This article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction ...
Designing interaction, not interfaces
AVI '04: Proceedings of the working conference on Advanced visual interfaces

Although the power of personal computers has increased 1000-fold over the past 20 years, user interfaces remain essentially the same. Innovations in HCI research, particularly novel interaction techniques, are rarely incorporated into products. In this ...
Pointage bi-manuel avec le CubTile dans un espace 2D de type focus+contexte
IHM '10: Proceedings of the 22nd Conference on l'Interaction Homme-Machine

The CubTile is a cubic-shaped device with 5 tactile multi-touch faces. It was initially designed for 3D interaction. In this article we explore its use for navigation and pointing in a 2D space. In this way, we propose a bi-manual interaction technique, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
1,202
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Borowski MFog BGriggio CEagan JKlokmose C(2022)Between Principle and Pragmatism: Reflections on Prototyping Computational Media with WebstratesACM Transactions on Computer-Human Interaction10.1145/356989530:4(1-53)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3569895
Beaudouin-Lafon MBødker SMackay W(2021)Generative Theories of InteractionACM Transactions on Computer-Human Interaction10.1145/346850528:6(1-54)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3468505
Fox AGuo PKlokmose CDalsgaard PSatyanarayan AXia HHollan JAguiar AChiba SBoix E(2020)Towards a dynamic multiscale personal information space: beyond application and document centered views of informationCompanion Proceedings of the 4th International Conference on Art, Science, and Engineering of Programming10.1145/3397537.3397542(136-143)Online publication date: 23-Mar-2020
https://dl.acm.org/doi/10.1145/3397537.3397542
Larsen-Ledet IKorsgaard HBødker SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Collaborative Writing Across Multiple Artifact EcologiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376422(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376422
Seinfeld SFeuchtner TMaselli AMüller J(2020)User Representations in Human-Computer InteractionHuman–Computer Interaction10.1080/07370024.2020.172479036:5-6(400-438)Online publication date: 19-Feb-2020
https://doi.org/10.1080/07370024.2020.1724790
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Borowski MRädle RKlokmose CMandryk RHancock MPerry MCox A(2018)Codestrate PackagesExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3188563(1-6)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3188563
Zagermann JPfeil UAcevedo CReiterer HHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Studying the benefits and challenges of spatial distribution and physical affordances in a multi-device workspaceProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3152855(249-259)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3152855
Nouwens MGriggio CMackay WMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)"WhatsApp is for family; Messenger is for friends"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025484(727-735)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025484
Lacoche JDuval TArnaldi BMaisel ERoyan J(2017)Providing plasticity and redistribution for 3D user interfaces using the D3PART modelJournal on Multimodal User Interfaces10.1007/s12193-017-0239-x11:2(197-210)Online publication date: 27-Jan-2017
https://doi.org/10.1007/s12193-017-0239-x
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten