B. Helena Rodriguez
ABSTRACT
The Soa2mSituation is a semantic model for specifying structure and behavior of multimodal interfaces according with the interaction context. Our research focuses on a multimodal model of services for the dynamic composition of interactive features in multimodal systems. We propose an interaction situation model to enhance the management of the interaction conditions in terms of roles, stereotypical activities and perception. The ontology is based on the upper-level ontology DOLCE+DnS Lite. It provides a flexible means for multimodal components annotation and context-aware presentation in a SOA architecture. This architecture is based on the W3C's Multimodal Interaction Architecture and Interfaces standard.
- DOLCE: http://www.loa-cnr.it/DOLCE.html http://www.loa-cnr.it/Papers/D07_v21a.pdfGoogle Scholar
- Rodriguez, B. Helena. "A SOA model, semantic and multimodal, and its support for the discovery and registration of assistance services". PhD Thesis, Institut Mines-Télécom, Telecom ParisTech, Paris, 2013.Google Scholar
- MMI-Arch: http://www.w3.org/TR/mmi-arch/Google Scholar
- Barwise, J. and Perry, J. "The situation underground" In: Stanford Working Papers in Semantics, Stanford University Press, 1980. Vol. 1.Google Scholar
- DEY, A. K. "Understanding and Using Context" In: Personal and Ubiquitous Computing, Fev. 2001. Springer, London. Vol. 5. No. 1. pp. 4--7. http://dx.doi.org/10.1007/s007790170019 Google ScholarDigital Library
- Crowley,J., Coutaz, J., Rey, G. and Reignier, P. "Perceptual components for context aware computing" In: Proceedings of the 4th international conference on Ubiquitous Computing UbiComp '02. Gaetano Borriello and Lars Erik Holmquist (Eds). Springer-Verlag, London, UK. p.p. 117--134. Available (04/02/2012) at: http://www.springerlink.com/index/CYG6J0TX829CJC8E.pdf Google ScholarDigital Library
- Schilit, B. N., Hilbert, D. M. and Trevor, J. "Context-aware communication" In: Wireless Communications, IEEE, 2002. Vol.9. No.5. p.p. 46--54. http://dx.doi.org/10.1109/MWC.2002.1043853 Google ScholarDigital Library
- Brooks, R., Brezeal, C., Irie, R., Kemp, C., Majanovic, M., Scasselltati, B. and Williamson, M. "Alternative Essences of Intelligence". In: Proceedings of the Fifteenth National Conference on Artificial Intelligence, 1998. Menlo Park, CA. pp. 961--967. Google ScholarDigital Library
- Dreyfus, H. L. What Computers still can't do. A Critique of Artificial Reason. MIT Press, 1992. Cambridge, MA. Google ScholarDigital Library
- Larsson, S. "Dialogue Systems: Simulations or Interfaces?" In: Gardent & Gaiffe Ed., Proceedings of the ninth workshop on the semantics and pragmatics of dialogue, DIALOR. June 9--11, 2005. Nancy, France. Available (04/02/2012) at: http://dialor05.loria.fr/Papers/06-larsson_final.pdfGoogle Scholar
- Bettini, C., Brdiczka, O., Henricksen, K., Indulska, J., Nicklas, D., Ranganathan, A. and Riboni,D. "A survey of context modelling and reasoning techniques"," In: Pervasive and Mobile Computing. April 2010. Vol. 6, No.2. p.p.161--180. http://dx.doi.org/10.1016/j.pmcj.2009.06.002 Google ScholarDigital Library
- Rousseau, C., Bellik, Y., Vernier, F. and Bazalgette, D. "A Framework for the intelligent multimodal presentation of information" In: Signal Processing, Dec. 2006, Vol.86. No.12. pp.3696--3713. doi:10.1016/j.sigpro.2006.02.041 Google ScholarDigital Library
- Scherp, A., Franz, T., Saathoff, C. and Staab, S. "F---A Model of Events based on the Foundational Ontology DOLCE+DnS Ultralite" In: Proceedings of the fifth international conference on Knowledge capture -K-CAP09. ACM, New York, NY, USA, p.p. 137--144. http://doi.acm.org/10.1145/1597735.1597760 Google ScholarDigital Library
- Troncy, R., Fialho, A., Hardman, L. and Saathoff, C. "Experiencing Events through User-Generated Media" In: Proceedings of the International Workshop on Consuming Linked Data - COLD'10, ISWC'10. Vol. 665, Shanghai, China, November 7--11, 2010. Available (06/02/1012) at: http://www.eurecom.fr/~troncy/Publications/Google Scholar
- Guarino, N., "Toward a Formal Evaluation of Ontology Quality". IEEE intelligent Systems, 2004. 19(4): 78--79. Guarino, N., and Musen, M. Focusing on ContentGoogle Scholar
- Arijon, D. Grammaire du langage filmé. Editions Dujarric, 1999.Google Scholar
- Chamness, D. Hollywood Guide to Film Budgeting and Script Breakdown. Stanley J Brooks Co; 5 Revised edition (August 1988)Google Scholar
- Boisson, B. Histoire de la mise en scène théâtrale de 1800 à nos jours. Presses Universitaires de France (Octobre 2010)Google Scholar
- Rodriguez, B. H. (Ed). Dahl, D., Tumuluri, R., Wiechno, P. and Ashimura, K. Registration & Discovery of Multimodal Modality Components in Multimodal Systems: Use Cases and Requirements. W3C Working Group Note 5 July 2012. Available at: http://www.w3.org/TR/mmi-discovery/Google Scholar
- Schoenberg, A. Fundamentals of Musical Composition. Faber & Faber (March 15, 1999)Google Scholar
- The detailed MMI implementation report of these components is available at: http://www.w3.org/2002/mmi/2012/mmi-arch-ir/Google Scholar
- Sowa, J. F. Knowledge Representation: Logical, Philosophical, and Computational Foundations, Brooks Cole Publishing Co., Pacific Grove, CA, 1999. Google ScholarDigital Library
Index Terms
- Soa2mSituation: an interaction situation model for the multimodal web
Recommendations
Discovery and registration of components in multimodal systems distributed on the IoT
One of the major gaps in the current HTML5 web platform, is the lack of interoperable means for a multimodal application to discover services and applications available in a given space and network for example, in smart houses or in applications for the ...
Multimodal instantiation of assistance services
iiWAS '10: Proceedings of the 12th International Conference on Information Integration and Web-based Applications & ServicesOur research focuses in a multimodal model of services for the dynamic composition of interactive features in multimedia. These services primarily do complex multimedia compositions in pervasive semantics systems. We propose a new protocol to enhance ...
Human-computer interaction in next generation ambient intelligent environments
Special issue on knowledge-based environments and services in human-computer interactionIn this article we describe our approach towards the specification and realization of human-computer interaction within Next Generation Ambient Intelligent Environments (NGAIE). These environments are populated with numerous devices and multiple ...
Comments