skip to main content
10.1145/1570433.1570438acmconferencesArticle/Chapter ViewAbstractPublication PageseicsConference Proceedingsconference-collections
research-article

StateStream: a developer-centric approach towards unifying interaction models and architecture

Published: 15 July 2009 Publication History

Abstract

Complex and dynamic interaction behaviors in applications such as Virtual Reality (VR) systems are difficult to design and develop. Reasons for this include the complexity and limitations in specification models and their integration with the underlying architecture, and lack of supporting development tools. In this paper we present our StateStream approach, which uses a dynamic programming language to bridge the gap between the behavioral model descriptions, the underlying VR architecture and customized development tools. Whereas the dynamic language allows full flexibility, the interaction model adds explicit structures for interactive behavior. A dual modeling mechanism is used to capture both discrete and continuous interaction behavior. The models are described and executed in the dynamic language itself, unifying the description of interaction, its execution and the connection with external software components.
We will highlight the main features of StateStream, and illustrate how the tight integration of interaction model and architecture enables a flexible and open-ended development environment. We will demonstrate the use of StateStream in a prototype system for studying and adapting complex 3D interaction techniques for VR.

References

[1]
J. Allard, C. Ménier, E. Boyer, and B. Ran. Running Large VR Applications on a PC Cluster: the FlowVR Experience. In Proc. of EGVE/IPT'05, pages 59--68, 2005.
[2]
Caroline Appert and Michel Beaudouin-Lafon. SwingStates: adding state machines to the swing toolkit. In Proc. of UIST'06, pages 319--322, 2006.
[3]
Michael von der Beeck. A Comparison of Statecharts Variants. In Proc. of ProCoS'94, pages 128--148, 1994.
[4]
Renaud Blanch and Michel Beaudouin-Lafon. Programming rich interactions using the hierarchical state machine toolkit. In Proc. AVI'06, pages 51--58, 2006.
[5]
David A. Carr. Specification of interface interaction objects. In Proc. of CHI'94, pages 372--378, 1994.
[6]
Matthew J. Conway and Randy Pausch. Alice: easy to learn interactive 3D graphics. SIGGRAPH Comput. Graph., 31(3):58--59, 1997.
[7]
James Cremer, Joseph Kearney, and Yiannis Papelis. HCSM: a framework for behavior and scenario control in virtual environments. ACM Trans. Model. Comput. Simul., 5(3):242--267, 1995.
[8]
Alan Dix, Jair Leite, and Adrian Friday. XSED--XML-Based Description of Status: Event Components and Systems. In Proc. of EIS 2007, pages 210--226, 2008.
[9]
Pablo Figueroa, Mark Green, and H. James Hoover. InTml: a description language for VR applications. In Proc. of Web3D'02, pages 53--58, 2002.
[10]
G. de Haan and F. H. Post. Flexible Architecture for the Development of Realtime Interaction Behavior. In Proc. of SEARIS'08, pages 71--75, 2008.
[11]
Gerwin de Haan, Michal Koutek, and Frits H. Post. Flexible Abstraction Layers for VR application development. In Proceedings of IEEE Virtual Reality 2007, pages 239--242, 2007.
[12]
Gerwin de Haan, Rene Molenaar, Michal Koutek, and Frits H. Post. Consistent Viewing and Interaction for Multiple Users in Projection-Based VR Systems. Computer Graphics Forum, 26(3):695--704, 2007.
[13]
David Harel. Statecharts: A visual formalism for complex systems. Sci. Comput. Program., 8(3):231--274, 1987.
[14]
B. Hartmann, S. R. Klemmer, M. Bernstein, L. Abdulla, B. Burr, A. Robinson-Mosher, and J. Gee. Reflective physical prototyping through integrated design, test, and analysis. Proc. of UIST '06, pages 299--308, 2006.
[15]
Zayd Hendricks, Gary Marsden, and Edwin Blake. A meta-authoring tool for specifying interactions in virtual reality environments. In Proc. of AFRIGRAPH'03, pages 171--180, 2003.
[16]
R. J. K. Jacob, L. Deligiannidis, and S. Morrison. A software model and specification language for non-WIMP user interfaces. Transactions on Computer-Human Interaction, 6(1):1--46, 1999.
[17]
Marc Eric Latoschik, Dirk Reiners, Roland Blach, Pablo Figueroa, and Raimund Dachselt. IEEE VR 2008 Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS). Shaker Verlag, Aachen, Germany, 2008.
[18]
Gerald Luttgen, Michael von der Beeck, and Rance Cleaveland. A compositional approach to statecharts semantics. SIGSOFT Softw. Eng. Notes, 25(6):120--129, 2000.
[19]
Mieke Massink, David J. Duke, and Shamus P. Smith. Towards Hybrid Interface Specifications for Virtual Environments. In Proc. of DSV-IS, pages 30--51, 1999.
[20]
Brad Myers, Scott E. Hudson, and Randy Pausch. Past, present, and future of user interface software tools. ACM Transactions Computer-Human Interaction, 7(1):3--28, 2000.
[21]
Dan R. Olsen. Evaluating user interface systems research. In Proc. of UIST'07, pages 251--258, 2007.
[22]
Alex Olwal and Steven Feiner. Unit: modular development of distributed interaction techniques for highly interactive user interfaces. In Proc. of GRAPHITE'04, pages 131--138, 2004.
[23]
Andrew Ray and Doug A. Bowman. Towards a system for reusable 3D interaction techniques. In Proc. of VRST'07, pages 187--190, 2007.
[24]
O. Shaer and R. J. K. Jacob. Toward a Software Model and a Specification Language for Next-Generation User Interfaces. CHI'05 Workshop on The Future of User Interface Software Tools, 2005.
[25]
Shamus P. Smith. Exploring the Specification of Haptic Interaction. In Interactive Systems. Design, Specification, and Verification, volume 4323 of Lecture Notes in Computer Science, pages 171--184, 2007.
[26]
Davy Vanacken, Joan De Boeck, Chris Raymaekers, and Karin Coninx. NIMMIT: A notation for modeling multimodal interaction techniques. In Proc. of GRAPP, pages 224--231, 2006.
[27]
C. Wingrave and D. Bowman. CHASM: Bridging Description and Implementation of 3D Interfaces. In Proc. of IEEE VR Workshop on New Directions in 3DUIs, pages 85--88, 2005.
[28]
C. Wingrave and D. Bowman. Tiered Developer-Centric Representations for 3D Interfaces: Concept-Oriented Design in Chasm. In Proc. of IEEE VR'08, pages 193--200, 2008.
[29]
G. Zachmann. A language for describing behavior of and interaction with virtual worlds. In Proc. of VRST'96, pages 143--150, 1996.

Cited By

View all
  • (2016)Vista widgetsProceedings of the 22nd ACM Conference on Virtual Reality Software and Technology10.1145/2993369.2993382(251-260)Online publication date: 2-Nov-2016
  • (2013)IOWAStateProceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2494603.2480299(59-68)Online publication date: 24-Jun-2013
  • (2011)A Framework to Develop VR Interaction Techniques Based on OpenInterface and AFreeCAHuman-Computer Interaction – INTERACT 201110.1007/978-3-642-23765-2_1(1-18)Online publication date: 2011

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
EICS '09: Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
July 2009
348 pages
ISBN:9781605586007
DOI:10.1145/1570433
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 July 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D interaction
  2. model-driven engineering
  3. python
  4. user interface description language

Qualifiers

  • Research-article

Conference

EICS'09
Sponsor:
EICS'09: Engineering Interactive Computing Systems
July 15 - 17, 2009
PA, Pittsburgh, USA

Acceptance Rates

Overall Acceptance Rate 73 of 299 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Vista widgetsProceedings of the 22nd ACM Conference on Virtual Reality Software and Technology10.1145/2993369.2993382(251-260)Online publication date: 2-Nov-2016
  • (2013)IOWAStateProceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2494603.2480299(59-68)Online publication date: 24-Jun-2013
  • (2011)A Framework to Develop VR Interaction Techniques Based on OpenInterface and AFreeCAHuman-Computer Interaction – INTERACT 201110.1007/978-3-642-23765-2_1(1-18)Online publication date: 2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media