short-paper

PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V

Authors:

Estêvão Bissoli Saleme,

Celso Alberto Saibel SantosAuthors Info & Claims

WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web

Pages 145 - 148

https://doi.org/10.1145/2820426.2820450

Published: 27 October 2015 Publication History

Get Access

Abstract

MulSeMedia is related to the combination of traditional media (e.g. text, image and video) with other objects that aim to stimulate other human senses, such as mechanoreceptors, chemoreceptors and thermoreceptors. Existing solutions embed the control of actuators in the applications, thus limiting their reutilization in other types of applications or different media players. This work presents PlaySEM, a platform that brings a new approach for simulating and rendering sensory effects that operates independently of any Media Player, and that is compatible with the MPEG-V standard, while taking into account reutilization requirement. Regarding this architecture conjectures are tested focusing on the decoupled operation of the renderer.

References

[1]

G. Ghinea, C. Timmerer, W. Lin, and S. R. Gulliver, "Mulsemedia: State of the art, perspectives, and challenges," ACM Trans. Multimedia Comput. Commun. Appl., vol. 11, pp. 17:1--17:23, Oct. 2014.

Digital Library

Google Scholar

[2]

M. Preda, "MPEG-V: a standard for multissensorial and immersive experiences," in MPEG-V Awareness Event, (Daegu, Korea), 2011.

Google Scholar

[3]

S. Möller and A. Raake, eds., Quality of Experience: Advanced Concepts, Applications and Methods. Cham: Springer, 2014.

Digital Library

Google Scholar

[4]

S. K. Kim and J. J. Han, "Text of white paper on MPEG-V," Tech. Rep. ISO/IEC JTC 1/SC 29/WG 11 W14187, San Jose, USA, 2014.

Google Scholar

[5]

H. Y. Cho, "Event-Based control of 4D effects using MPEG RoSE," Master's thesis, School of Mechanical, Aerospace and S. Engineering. Korea Adv. Inst. of Science and Technology., South Korea, 2010.

Google Scholar

[6]

C. A. S. Santos, E. B. Saleme, and J. C. S. Andrade, "A systematic review of data exchange formats in advanced interaction environments," IJMUE - Int. Journal of Multimedia and Ubiquitous Engineering, vol. 10, pp. 123--140, May 2015.

Crossref

Google Scholar

[7]

M. Waltl, B. Rainer, C. Timmerer, and H. Hellwagner, "An end-to-end tool chain for sensory experience based on mpeg-v.," Sig. Proc.: Image Comm., vol. 28, no. 2, pp. 136--150, 2013.

Digital Library

Google Scholar

[8]

S. K. Kim and Y. S. Joo, "Sensible media simulation in an automobile application and human responses to sensory effects," ETRI Journal, vol. 35, pp. 1001--1010, Dec. 2014.

Crossref

Google Scholar

[9]

Z. Yuan, T. Bi, G. Muntean, and G. Ghinea, "Perceived synchronization of mulsemedia services," IEEE Transactions on Multimedia, vol. 17, no. 7, pp. 957--966, 2015.

Digital Library

Google Scholar

Cited By

View all

Orawetz JMühlberg FFreitag GKammer D(2024)Mulsemedia Recording of Real World Places for Reproduction in Replicable Immersive EnvironmentsProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656752(1-3)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656752
Mühlberg FVogt SOrawetz JFreitag GReichelt D(2024)Multisensory Simulations for Smart Personal Protective Equipment2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE62247.2024.10796735(764-769)Online publication date: 21-Oct-2024
https://doi.org/10.1109/MetroXRAINE62247.2024.10796735
Murugan Mda Silveira ASubashini PGhinea GSantos C(2024)Technology-Enhanced Mulsemedia Learning (TEML) Through Design for Learners with Dyslexia for Enhancing the Quality of Experience (QoE)Envisioning the Future of Education Through Design10.1007/978-981-97-0076-9_10(221-243)Online publication date: 11-Apr-2024
https://doi.org/10.1007/978-981-97-0076-9_10
Show More Cited By

Index Terms

PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment

Multisensory experiences have been increasingly applied in Human-Computer Interaction (HCI). In recent years, it is commonplace to notice the development of haptic, olfactory, and even gustatory displays to create more immersive experiences. Companies ...
Mulsemedia: State of the Art, Perspectives, and Challenges
Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and Applications

Mulsemedia—multiple sensorial media—captures a wide variety of research efforts and applications. This article presents a historic perspective on mulsemedia work and reviews current developments in the area. These take place across the traditional ...
A user perspective of olfaction-enhanced mulsemedia
MEDES '10: Proceedings of the International Conference on Management of Emergent Digital EcoSystems

The focus of this paper is on olfaction-enhanced multimedia applications, that is, combining computer generated smell with other media to enrich the users' experience and perception of a multimedia application. Within the general context of mulsemedia --...

Comments

Information & Contributors

Information

Published In

WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web

October 2015

266 pages

ISBN:9781450339599

DOI:10.1145/2820426

General Chairs:
Marco Antônio Pinheiro de Cristo
UFAM, Brazil
,
David Fernandes de Oliveira
UFAM, Brazil
,
Program Chairs:
Adriano C. Machado Pereira
UFMG, Brazil
,
Fabricio Benevenuto
UFMG, Brazil
,
Marcelo Moreno
UFJF, Brazil
,
Valter Roesler
UFRGS, Brazil

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

Webmedia '15

Sponsor:

CYTED
SBC
FAPEAM
CNPq
CGIBR
CAPES

Webmedia '15: 21st Brazilian Symposium on Multimedia and the Web

October 27 - 30, 2015

Manaus, Brazil

Acceptance Rates

WebMedia '15 Paper Acceptance Rate 21 of 61 submissions, 34%;

Overall Acceptance Rate 270 of 873 submissions, 31%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
223
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Orawetz JMühlberg FFreitag GKammer D(2024)Mulsemedia Recording of Real World Places for Reproduction in Replicable Immersive EnvironmentsProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656752(1-3)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656752
Mühlberg FVogt SOrawetz JFreitag GReichelt D(2024)Multisensory Simulations for Smart Personal Protective Equipment2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE62247.2024.10796735(764-769)Online publication date: 21-Oct-2024
https://doi.org/10.1109/MetroXRAINE62247.2024.10796735
Murugan Mda Silveira ASubashini PGhinea GSantos C(2024)Technology-Enhanced Mulsemedia Learning (TEML) Through Design for Learners with Dyslexia for Enhancing the Quality of Experience (QoE)Envisioning the Future of Education Through Design10.1007/978-981-97-0076-9_10(221-243)Online publication date: 11-Apr-2024
https://doi.org/10.1007/978-981-97-0076-9_10
Jalal LPuddu RMartini MPopescu VMurroni M(2023)A QoE Model for Mulsemedia TV in a Smart Home EnvironmentIEEE Transactions on Broadcasting10.1109/TBC.2022.321767669:1(179-190)Online publication date: Mar-2023
https://doi.org/10.1109/TBC.2022.3217676
Rodrigues Rda Silva Jr. JBrandão Ddos Santos J(2022)An Approach for Sensory Effects Dispersion Simulation with Computational Fluid DynamicsProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3556999(368-376)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3556999
Marfil DBoronat FGonzalez JSapena A(2022)Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV ScenariosIEEE Access10.1109/ACCESS.2022.319417010(79071-79089)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3194170
Rodrigues ESaleme ESantos CPereira Ada Rocha L(2021)A Haptic System for Switching Wind Temperatures Based on Ultrasonic Vibrations, Peltier Elements, and Electrical Resistances for Multisensory ApplicationsProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479638(73-80)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3470482.3479638
Jost CDebloos JArchambault DLe Pévédic BSagot JSohier RAlbert Tijus CTruck IUzan G(2021)PRIM Project: Playing and Recording with Interactivity and MultisensorialityProceedings of the 2021 ACM International Conference on Interactive Media Experiences10.1145/3452918.3465487(223-227)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3452918.3465487
Okuno HNetto SGuedes G(2020)Multisensorial Audiobooks2020 XV Conferencia Latinoamericana de Tecnologias de Aprendizaje (LACLO)10.1109/LACLO50806.2020.9381171(1-6)Online publication date: 19-Oct-2020
https://doi.org/10.1109/LACLO50806.2020.9381171
Jalal LMurroni M(2020)On the Impact of Single and Multiple Effects on Quality of Experience for Multisensorial TV in Smart Home2020 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB49480.2020.9379734(1-6)Online publication date: 27-Oct-2020
https://doi.org/10.1109/BMSB49480.2020.9379734
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment

Mulsemedia: State of the Art, Perspectives, and Challenges

A user perspective of olfaction-enhanced mulsemedia

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations