Abstract.
We describe a system that supports practical, vision-based user interfaces, addressing the issues of a usable interaction paradigm, support for application developers, and support for application deployment in real-world environments. Interfaces are defined as configurations of predefined interactive widgets that can be moved from one surface to another. Complex interfaces can be dynamically reconfigured, changing both form and location on the fly, because the functional definition of the interface is decoupled from the specification of its location in the environment. We illustrate the power of such an architecture in the context of projected interactive displays.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Davis L (ed) (2002) In: Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG 2002), IEEE Computer Society, Washington DC
Ishii H, Ullmer B (1997) Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms. In: Proc. of CHI’97, Atlanta, GA pp. 234-241
Kjeldsen F (1997) Visual Recognition of Hand Gesture as a Practical Interface Modality. PhD dissertation, Columbia University, New York, NY
Kjeldsen F, Hartman J (2001) Design Issues for Vision-based Computer Interaction Systems. In: Proc. of the Workshop on Perceptual User Interfaces. Orlando, FL
Kjeldsen F(2002) Interacting with Steerable Projected Displays. In: Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG’02), Washington DC
Pingali G(2002) User-Following Displays. In: Proc. of the IEEE International Conference on Multimedia and Expo 2002 (ICME’02), Lausanne, Switzerland
Pinhanez C (2001) The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In: Proc. of Ubiquitous Computing 2001 (Ubicomp’01). Atlanta, GA
Pinhanez CS, Bobick AF (2002) “It/”: A Theater Play Featuring an Autonomous Computer Character. In: Presence: Teleoperators and Virtual Environments 11(5):536-548
Starner T(1997) Augmented Reality through Wearable Computing. In: Presence: Teleoperators and Virtual Environments 6(4):386-398
Sukaviriya N, Podlaseck M, Kjeldsen R, Levas A, Pingali G, Pinhanez C (2003) Embedding Interactions in a retail Store Environment: The Design and Lessons Learned. In:Proc. of the 9th IFIP TC13 International Conference on Human-Computer Interaction (INTERACT03), September 2003
Turk M (ed) (2001) Proc. of the Workshop on Perceptual/Perceptive User Interfaces. Orlando, FL
Wolberg G (1994) Digital Image Warping, IEEE Press, New York, NY
Wu Y, Huang T (1999) Vision-Based Gesture Recognition: A Review. Lecture Notes in Artificial Intelligence, vol 1739. Springer, Berlin Heidelberg New York
Ye G, Corsco J, Burschka D, Hager G (2003), VICs: A Modular Vision-Based HCI Framework. In: Proc. of the 3rd International Conference on Vision Systems, Graz, Austria. pp 257-267
Zhang Z(2001) Visual Panel: Virtual Mouse, Keyboard, and 3D Controller with an Ordinary Piece of Paper. In: Proc. of the ACM Workshop on Perceptual/Perceptive User Interfaces (PUI’01), Orlando, FL
Author information
Authors and Affiliations
Corresponding author
Additional information
Published online: 13 July 2004
Rights and permissions
About this article
Cite this article
Kjeldsen, R., Levas, A. & Pinhanez, C. Dynamically reconfigurable vision-based user interfaces. Machine Vision and Applications 16, 6–12 (2004). https://doi.org/10.1007/s00138-004-0145-6
Issue Date:
DOI: https://doi.org/10.1007/s00138-004-0145-6