skip to main content
10.1145/2407336.2407365acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Evaluating scala, actors, & ontologies for intelligent realtime interactive systems

Published: 10 December 2012 Publication History

Abstract

This article evaluates the utility of three technical design approaches implemented during the development of a Realtime Interactive Systems (RIS) architecture focusing on the areas of Virtual and Augmented Reality (VR and AR), Robotics, and Human-Computer Interaction (HCI). The design decisions are (1) the choice of the Scala programming language, (2) the implementation of the actor computational model, and (3) the central incorporation of ontologies as a base for semantic modeling, required for several Artificial Intelligence (AI) methods. A white-box expert review is applied to a detailed use case illustrating an interactive and multimodal game scenario, which requires a number of complex functional features like speech and gesture processing and instruction mapping. The review matches the three design decisions against three comprehensive non-functional requirements from software engineering: Reusability, scalability, and extensibility. The qualitative evaluation is condensed to a semi-quantitative summary, pointing out the benefits of the chosen technical design.

References

[1]
T. Abaci, J. Ciger, and D. Thalmann. Planning with smart ob jects. WSCG, pages 25--28, 2005.
[2]
J. Allard, V. Gouranton, L. Lecointre, E. Melin, and B. Raffin. Net Juggler: Running VR Juggler with Multiple Displays on a Commodity Component Cluster. In Proceedings of the IEEE Virtual Reality Conference, page 273. IEEE, 2002.
[3]
J. Allard, J.-D. Lesage, and B. Raffin. Modularity for Large Virtual Reality Applications. Presence: Teleoperators and Virtual Environments, 19(2):142--162, 2010.
[4]
R. Aylett and M. Luck. Applying Artificial Intelligence to Virtual Reality: Intelligent Virtual Environments. Applied Artificial Intelligence, 14(1):3--32, 2000.
[5]
A. D. Bierbaum, C. Just, P. Hartling, K. Meinert, A. Baker, and C. Cruz-Neira. VR Juggler: A Virtual Platform for Virtual Reality Application Development. In Proceedings of the IEEE Virtual Reality Conference, pages 89--96. IEEE, 2001.
[6]
M. Bues, T. Gleue, and R. Blach. Lightning: Dataflow in motion. In Proceedings of the IEEE Virtual Reality SEARIS Workshop, pages 7--11, 2008.
[7]
H. Chafi, A. Sujeeth, K. Brown, H. Lee, A. Atreya, and K. Olukotun. A domain-specific approach to heterogeneous parallelism. Principles and Practices of Parallel Programming, PPoPP, 11, 2011.
[8]
P. Chevaillier, T. Trinh, M. Barange, F. Devillers, J. Soler, P. Loor, and R. Querrec. Semantic modelling of virtual environments using MASCARET. In Proceedings of the IEEE Virtual Reality SEARIS Workshop. IEEE, 2011.
[9]
M. Fischbach, D. Wiebusch, A. Giebler-Schubert, M. E. Latoschik, S. Rehfeld, and H. Tramberend. SiXton's curse - Simulator X demonstration. In Proceedings of the IEEE VR, pages 255--256, 2011.
[10]
M. Fischbach, D. Wiebusch, M. E. Latoschik, \ G. Bruder, and F. Steinicke. Blending Real and Virtual Worlds using Self-Reflection and Fiducials. In Proceedings of the ICEC, Demo Papers, 2012.
[11]
J. Herling and W. Broll. The Ocean framework: providing the basis for next-gen MR applications. In Proceedings of the IEEE Virtual Reality SEARIS Workshop. IEEE, 2010.
[12]
C. Hewitt, P. Bishop, and R. Steiger. A universal modular ACTOR formalism for artificial intelligence. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 235--245, 1973.
[13]
C. Hofer and K. Ostermann. Modular domain-specific language components in Scala. In SIGPLAN Notices, volume 46, pages 83--92. ACM, 2010.
[14]
P. Kapahnke, P. Liedtke, S. Nesbigall, S. Warwas, and M. Klusch. ISReal: An Open Platform for Semantic-Based 3D Simulations in the 3D Internet. The Semantic Web--ISWC, pages 161--176, 2010.
[15]
J. Kelso and L. E. Arsenault. Diverse: A framework for building extensible and reconfigurable device independent virtual environments. In IEEE Virtual Reality, pages 183--190, 2002.
[16]
M. Latoschik and H. Tramberend. A scala-based actor-entity architecture for intelligent interactive simulations. In Proceedings of the Virtual Reality SEARIS Workshop, pages 9--17, 2012.
[17]
M. E. Latoschik and H. Tramberend. Simulator X: A Scalable and Concurrent Software Platform for Intelligent Realtime Interactive Systems. In Proceedings of the IEEE VR, 2011.
[18]
E. A. Lee. The problem with threads. IEEE Computer, 39(5):33--42, 2006.
[19]
J.-L. Lugrin and M. Cavazza. Making Sense of Virtual Environments: Action Representation, Grounding and Common Sense. In Proceedings of the Intelligent User Interfaces, 2007.
[20]
J.-L. Lugrin and M. Cavazza. Towards AR Game Engines. In Proceedings of the IEEE Virtual Reality SEARIS Workshop. IEEE, 2010.
[21]
M. Odersky, L. Spoon, and B. Venners. Programming in Scala. Artima Inc, 2nd edition, 2010.
[22]
B. Pellens, F. Kleinermann, and O. De Troyer. An Approach Facilitating 3D/VR System Development Using Behavior Design Patterns. In Proceedings of the IEEE Virtual Reality SEARIS Workshop. IEEE, 2010.
[23]
M. Thielscher. FLUX: A logic programming method for reasoning agents. Theory and Practice of Logic Programming, 5(4--5):533--565, 2005.
[24]
H. Tramberend. Avocado: A Distributed Virtual Reality Framework. In IEEE Virtual Reality Conference, pages 14--21, 1999.
[25]
W3C OWL Working Group. OWL 2 Web Ontology Language Document Overview. Technical report, W3C, October 2009.
[26]
W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel. Sphinx-4: A flexible open source framework for speech recognition. Technical report, Sun Microsystems, Inc., 2004.
[27]
D. Wiebusch and M. E. Latoschik. Enhanced Decoupling of Components in Intelligent Realtime Interactive Systems using Ontologies. In Proceedings of the Virtual Reality SEARIS Workshop, pages 43--51. IEEE, 2012.

Cited By

View all
  • (2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
  • (2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
  • (2017)Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265709823:4(1342-1351)Online publication date: 1-Apr-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '12: Proceedings of the 18th ACM symposium on Virtual reality software and technology
December 2012
226 pages
ISBN:9781450314695
DOI:10.1145/2407336
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. actor model
  2. domain specific languages
  3. intelligent realtime interactive systems
  4. multimodal interaction
  5. ontology
  6. scala
  7. smart objects

Qualifiers

  • Research-article

Conference

VRST'12

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
  • (2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
  • (2017)Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265709823:4(1342-1351)Online publication date: 1-Apr-2017
  • (2016)Semantic framework for interactive animation generationProceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 110.1145/3013971.3013998(137-145)Online publication date: 3-Dec-2016
  • (2015)Software Techniques for Multimodal Input Processing in Realtime Interactive SystemsProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2823308(623-627)Online publication date: 9-Nov-2015
  • (2014)Smart Graphics/Intelligent GraphicsInformatik-Spektrum10.1007/s00287-013-0759-z37:1(36-41)Online publication date: 15-Jan-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media