research-article

Heterogeneous modeling of gesture-based 3D applications

Authors:

Tom MensAuthors Info & Claims

MPM '12: Proceedings of the 6th International Workshop on Multi-Paradigm Modeling

Pages 19 - 24

https://doi.org/10.1145/2508443.2508447

Published: 01 October 2012 Publication History

Get Access

Abstract

Model-driven software engineering (MDE) is a well-known approach for developing software. It reduces complexity, facilitates maintenance and allows for the simulation, verification, validation and execution of software models. In this article, we show how MDE and model execution can be leveraged in the context of human-computer interaction (HCI). We claim that in this application domain it is beneficial to use heterogeneous models, combining different models of computation for different components of the system. We report on a case study that we have carried out to develop an executable model of a gesture-based application for manipulating 3D objects, using the Kinect sensor as input device, and the OGRE graphical engine as output device for real-time rendering. The interaction part of this application is fully specified as an executable heterogeneous model with the ModHel'X modeling environment. We exploit the semantic adaptation between different models of computation to implement a layered application using the most appropriate models of computation for each layer.

References

[1]

F. Balarin, L. Lavagno, C. Passerone, A. L. Sangiovanni-Vincentelli, M. Sgroi, and Y. Watanabe. Modeling and designing heterogeneous systems. In Concurrency and Hardware Design, volume 2549 of LNCS, pages 228--273. Springer, 2002.

Digital Library

Google Scholar

[2]

L. Bass, R. Pellegrino, S. Reed, S. Sheppard, and M. Szczur. The arch model: Seeheim revisited. In CHI 91 User Interface Developpers Workshop, 1991.

Google Scholar

[3]

F. Boulanger, C. Hardebolle, C. Jacquet, and D. Marcadet. Semantic adaptation for models of computation. In Proc. Int'l Conf. Application of Concurrency to System Design (ACSD), pages 153--162. IEEE, 2011.

Digital Library

Google Scholar

[4]

C. Brooks, E. A. Lee, X. Liu, S. Neuendorffer, Y. Zhao, and H. Zheng. Heterogeneous concurrent modeling and design in Java (volume 3: Ptolemy II domains). Technical Report UCB/EECS-2008-30, University of California, Berkeley, 2008.

Google Scholar

[5]

F. P. Brooks. The Mythical Man-Month: Essays on Software Engineering. Addison-Wesley, 20th anniversary edition, 1995.

Digital Library

Google Scholar

[6]

R. Deshayes and T. Mens. Statechart modelling of interactive gesture-based applications. In Int'l Workshop on Combining Design and Engineering of Interactive Systems through Models and Tools (ComDeisMoto), satellite event of INTERACT 2011, 2011.

Google Scholar

[7]

J. Eker, J. W. Janneck, E. A. Lee, J. Liu, X. Liu, J. Ludvig, S. Neuendorffer, S. R. Sachs, and Y. Xiong. Taming heterogeneity - the Ptolemy approach. Proc. IEEE, 91(1):127--144, 2003.

Google Scholar

[8]

C. Hardebolle and F. Boulanger. Exploring multi-paradigm modeling techniques. SIMULATION: Transactions of The Society for Modeling and Simulation International, 85(11/12):688--708, November/December 2009.

Digital Library

Google Scholar

[9]

D. Navarre, P. A. Palanque, R. Bastide, A. Schyn, M. Winckler, L. P. Nedel, and C. M. D. S. Freitas. A formal description of multimodal interaction techniques for immersive virtual reality applications. In M. F. Costabile and F. Paternò, editors, INTERACT, volume 3585 of LNCS, pages 170--183. Springer, 2005.

Digital Library

Google Scholar

[10]

D. Navarre, P. A. Palanque, J.-F. Ladry, and E. Barboni. Icos: A model-based user interface description technique dedicated to interactive systems addressing usability, reliability and scalability. ACM Trans. Comput.-Hum. Interact., 16(4), 2009.

Digital Library

Google Scholar

Cited By

View all

González OEspaña SPastor OPonsa PGuasch D(2015)Including multi-stroke gesture-based interaction in user interfaces using a model-driven methodProceedings of the XVI International Conference on Human Computer Interaction10.1145/2829875.2829931(1-8)Online publication date: 7-Sep-2015
https://dl.acm.org/doi/10.1145/2829875.2829931
Deshayes R(2013)A domain-specific modeling approach for gestural interaction2013 IEEE Symposium on Visual Languages and Human Centric Computing10.1109/VLHCC.2013.6645275(181-182)Online publication date: Sep-2013
https://doi.org/10.1109/VLHCC.2013.6645275
Deshayes RMens TPalanque P(2013)A generic framework for executable gestural interaction models2013 IEEE Symposium on Visual Languages and Human Centric Computing10.1109/VLHCC.2013.6645240(35-38)Online publication date: Sep-2013
https://doi.org/10.1109/VLHCC.2013.6645240
Show More Cited By

Index Terms

Heterogeneous modeling of gesture-based 3D applications
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Modeling and simulation
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Summary of the 6th International Workshop on Multi-Paradigm Modeling (MPM'12)
MPM '12: Proceedings of the 6th International Workshop on Multi-Paradigm Modeling

At the heart of Multi-Paradigm Modeling (MPM) is the conviction that modeling "everything" explicitly, at the right level of abstraction and using the most appropriate formalism(s) is the key to success in model driven engineering. Indeed, the model ...
Interaction modeling on heterogeneous spaces
INTERACCION '12: Proceedings of the 13th International Conference on Interacción Persona-Ordenador

This paper presents a metamodel that defines an abstract syntax to represent the interaction between entities and their environment through heterogeneous interactive spaces. It also presents a concrete syntax that defines a domain specific language ...
From Architecture Modeling to Application Provisioning for the Cloud by Combining UML and TOSCA
CLOSER 2016: Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 1 and 2

Recent efforts to standardize a deployment modeling language for cloud applications resulted in TOSCA. At

the same time, the software modeling standard UML supports architecture modeling from different viewpoints.

Combining these standards from cloud ...

Comments

Information & Contributors

Information

Published In

MPM '12: Proceedings of the 6th International Workshop on Multi-Paradigm Modeling

October 2012

78 pages

ISBN:9781450318051

DOI:10.1145/2508443

Conference Chairs:
Cécile Hardebolle
Supelec E3S, Gif-sur-Yvette, France
,
Eugene Syriani
University of Alabama, Tuscaloosa AL
,
Jonathan Sprinkle
University of Arizona, Tucson AZ
,
Tamás Mészáros
Budapest University of Technology and Economics, Budapest, Hungary

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MODELS '12

Sponsor:

SIGSOFT

MODELS '12: ACM/IEEE 15th International Conference on Model Driven Engineering Languages and Systems

October 1, 2012

Innsbruck, Austria

Acceptance Rates

MPM '12 Paper Acceptance Rate 6 of 20 submissions, 30%;

Overall Acceptance Rate 6 of 20 submissions, 30%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
69
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

González OEspaña SPastor OPonsa PGuasch D(2015)Including multi-stroke gesture-based interaction in user interfaces using a model-driven methodProceedings of the XVI International Conference on Human Computer Interaction10.1145/2829875.2829931(1-8)Online publication date: 7-Sep-2015
https://dl.acm.org/doi/10.1145/2829875.2829931
Deshayes R(2013)A domain-specific modeling approach for gestural interaction2013 IEEE Symposium on Visual Languages and Human Centric Computing10.1109/VLHCC.2013.6645275(181-182)Online publication date: Sep-2013
https://doi.org/10.1109/VLHCC.2013.6645275
Deshayes RMens TPalanque P(2013)A generic framework for executable gestural interaction models2013 IEEE Symposium on Visual Languages and Human Centric Computing10.1109/VLHCC.2013.6645240(35-38)Online publication date: Sep-2013
https://doi.org/10.1109/VLHCC.2013.6645240
Schoreels JDeshayes RMens T(2013)KinectBalls: An Interactive Tool for Ball Throwing GamesIntelligent Technologies for Interactive Entertainment10.1007/978-3-319-03892-6_11(90-95)Online publication date: 2013
https://doi.org/10.1007/978-3-319-03892-6_11

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Summary of the 6th International Workshop on Multi-Paradigm Modeling (MPM'12)

Interaction modeling on heterogeneous spaces

From Architecture Modeling to Application Provisioning for the Cloud by Combining UML and TOSCA

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations