Estêvão Bissoli Saleme
Celso Alberto Saibel Santos
ABSTRACT
MulSeMedia is related to the combination of traditional media (e.g. text, image and video) with other objects that aim to stimulate other human senses, such as mechanoreceptors, chemoreceptors and thermoreceptors. Existing solutions embed the control of actuators in the applications, thus limiting their reutilization in other types of applications or different media players. This work presents PlaySEM, a platform that brings a new approach for simulating and rendering sensory effects that operates independently of any Media Player, and that is compatible with the MPEG-V standard, while taking into account reutilization requirement. Regarding this architecture conjectures are tested focusing on the decoupled operation of the renderer.
- G. Ghinea, C. Timmerer, W. Lin, and S. R. Gulliver, "Mulsemedia: State of the art, perspectives, and challenges," ACM Trans. Multimedia Comput. Commun. Appl., vol. 11, pp. 17:1--17:23, Oct. 2014. Google Scholar
Digital Library
- M. Preda, "MPEG-V: a standard for multissensorial and immersive experiences," in MPEG-V Awareness Event, (Daegu, Korea), 2011.Google Scholar
- S. Möller and A. Raake, eds., Quality of Experience: Advanced Concepts, Applications and Methods. Cham: Springer, 2014. Google ScholarDigital Library
- S. K. Kim and J. J. Han, "Text of white paper on MPEG-V," Tech. Rep. ISO/IEC JTC 1/SC 29/WG 11 W14187, San Jose, USA, 2014.Google Scholar
- H. Y. Cho, "Event-Based control of 4D effects using MPEG RoSE," Master's thesis, School of Mechanical, Aerospace and S. Engineering. Korea Adv. Inst. of Science and Technology., South Korea, 2010.Google Scholar
- C. A. S. Santos, E. B. Saleme, and J. C. S. Andrade, "A systematic review of data exchange formats in advanced interaction environments," IJMUE - Int. Journal of Multimedia and Ubiquitous Engineering, vol. 10, pp. 123--140, May 2015.Google ScholarCross Ref
- M. Waltl, B. Rainer, C. Timmerer, and H. Hellwagner, "An end-to-end tool chain for sensory experience based on mpeg-v.," Sig. Proc.: Image Comm., vol. 28, no. 2, pp. 136--150, 2013. Google ScholarDigital Library
- S. K. Kim and Y. S. Joo, "Sensible media simulation in an automobile application and human responses to sensory effects," ETRI Journal, vol. 35, pp. 1001--1010, Dec. 2014.Google ScholarCross Ref
- Z. Yuan, T. Bi, G. Muntean, and G. Ghinea, "Perceived synchronization of mulsemedia services," IEEE Transactions on Multimedia, vol. 17, no. 7, pp. 957--966, 2015.Google ScholarDigital Library
Index Terms
- PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V
Recommendations
Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment
Multisensory experiences have been increasingly applied in Human-Computer Interaction (HCI). In recent years, it is commonplace to notice the development of haptic, olfactory, and even gustatory displays to create more immersive experiences. Companies ...
Mulsemedia: State of the Art, Perspectives, and Challenges
Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and ApplicationsMulsemedia—multiple sensorial media—captures a wide variety of research efforts and applications. This article presents a historic perspective on mulsemedia work and reviews current developments in the area. These take place across the traditional ...
A user perspective of olfaction-enhanced mulsemedia
MEDES '10: Proceedings of the International Conference on Management of Emergent Digital EcoSystemsThe focus of this paper is on olfaction-enhanced multimedia applications, that is, combining computer generated smell with other media to enrich the users' experience and perception of a multimedia application. Within the general context of mulsemedia --...
Comments