Abstract
Multi-display environments (MDEs) are becoming more and more common. By introducing multi-modal interaction techniques such as gaze, body/hand and gestures, we established a sophisticated and intuitive interface for MDEs where the displays are stitched seamlessly and dynamically according to the users’ viewpoints. Each user can interact with the multiple displays as if she is in front of an ordinary desktop GUI environment.
Chapter PDF
Similar content being viewed by others
References
Kraemer, K.L., King, J.L.: Computer-based systems for cooperative work and group decision making. ACM Computing Surveys 20, 115–146 (1988)
Biehl, J.T., Bailey, B.P.: ARIS: an interface for application relocation in an interactive space. In: Proceedings of Graphics Interface (GI), pp. 107–116 (2004)
Myers, B.A., Stiel, H., Gargiulo, R.: Collaboration using multiple PDAs connected to a PC. In: Proceedings of ACM Conference on Computer Supported Cooperative Work (CSCW), pp. 285–294 (1998)
Prante, T., Streitz, N.A., Tandler, P.: Roomware: computers disappear and interaction evolves. Computer 37, 47–54 (2004)
Rekimoto, J.: A multiple device approach for supporting whiteboard-based interactions. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 344–351 (1998)
Rekimoto, J., Saitoh, M.: Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 378–385 (1999)
Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., Smith, M.: Stitching: pen gestures that span multiple displays. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), pp. 23–31 (2004)
Khan, G., Fitzmaurice, D., Almeida, N., Burtnyk, N., Kurtenbach, G.: A remote control interface for large displays. In: Proceedings of ACM Symposium on User Interface Software and Technology (UIST), pp. 127–136 (2004)
Tan, D.S., Meyers, B., Czerwinski, M.: WinCuts: manipulating arbitrary window regions for more effective use of screen space. In: Extended Abstracts on Human Factors in Computing Systems (ACM SIGCHI), pp. 1525–1528 (2004)
Bolt, R.A.: Put-that-there: voice and gesture at the graphics interface. In: Proceedings of Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 262–270 (1980)
Schmandt, C., Hulteen, E.A.: The intelligent voice-interactive interface. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 363–366 (1982)
Igarashi, T., Hughes, J.F.: Voice as sound: using non-verbal voice input for interactive control. In: Proceedings of ACM Symposium on User Interface Software and Technology (UIST), pp. 155–156 (2001)
Fukumoto, M., Mase, K., Suenaga, Y.: Finger-pointer: a glove free interface. In: Posters and Short Talks of Conference on Human Factors in Computing Systems (ACM SIGCHI), p. 62 (1992)
Zhai, S., Morimoto, C., Ihde, S.: Manual and gaze input cascaded (MAGIC) pointing. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 246–253 (1999)
Bolt, R.A.: Gaze-orchestrated dynamic windows. In: Proceedings of Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 109–119 (1981)
Fono, D., Vertegaal, R.: EyeWindows: evaluation of eye-controlled zooming windows for focus selection. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 151–160 (2005)
Sakurai, S., Itoh, Y., Kitamura, Y., Nacenta, M., Yamaguchi, T., Subramanian, S., Kishino, F.: A middleware for seamless use of multiple displays. In: Graham, T.C.N., Palanque, P. (eds.) DSV-IS 2008. LNCS, vol. 5136, pp. 252–266. Springer, Heidelberg (2008)
Nacenta, M., Sakurai, S., Yamaguchi, T., Miki, Y., Itoh, Y., Kitamura, Y., Subramanian, S., Gutwin, C.: E-conic: a perspective-aware interface for multi-display environments. In: Proceedings of ACM Symposium on User Interface Software and Technology, pp. 279–288 (2007)
Nacenta, M., Sallam, S., Champoux, B., Subramanian, S., Gutwin, C.: Perspective cursor: perspective-based interaction for multi-display environments. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 289–298 (2006)
Baudisch, P., Rosenholtz, R.: Halo: a technique for visualizing off-screen object. In: Proceedings of Conference on Human Factors in Computing Systems (ACM SIGCHI), pp. 481–488 (2003)
Sakurai, S., Yamaguchi, T., Kitamura, Y., Nacenta, M., Itoh, Y., Fukazawa, R., Subramanian, S., Kishino, F.: M3: Multi-modal interface in multi-display environment for multi-users. In: ACM SIGGRAPH Asia Emerging Technologies (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kitamura, Y., Sakurai, S., Yamaguchi, T., Fukazawa, R., Itoh, Y., Kishino, F. (2009). Multi-modal Interface in Multi-Display Environment for Multi-users. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)