skip to main content
10.1145/3470482.3479638acmconferencesArticle/Chapter ViewAbstractPublication PageswebmediaConference Proceedingsconference-collections
research-article

A Haptic System for Switching Wind Temperatures Based on Ultrasonic Vibrations, Peltier Elements, and Electrical Resistances for Multisensory Applications

Published: 05 November 2021 Publication History

Abstract

Adding sensory effects to applications has proven to increase users' quality of experience (QoE). As immersive technologies advance in the fields of entertainment, education, training, and so forth, more fine-grained functions are craved by users to have truly captivating and (nearly) realistic experiences. These new functions, in turn, push forward both the industry and academia on developing solutions to overcome the current limitations. This is indeed the particular case of multimedia systems enriched with thermal wind sensations. Whilst both wind and thermal effects have been included separately in such systems, the lack of wind at a low or high temperature has been noticed by users. It is not trivial building, controlling, and working with devices at different temperatures hit by wind at the same time. This is exacerbated by the fact that different technologies are used to this end. In this paper, we introduce a haptic system that allows the creation and delivery of hot and cold airflow synchronised with audiovisual content. The system combines the vaporisation of cooled water by Peltier plates for cold wind and hair dryers for warm wind steered by wind fans. To assess our system, we analysed the time our devices take to deliver these effects considering different starting temperatures in the environment. Furthermore, we annotated three videos with hot wind, cold wind, and both effects respectively to observe the feasibility of having those effects integrated with audiovisual content. Our findings suggest recommendations for the appropriate triggering of these types of sensory effects combined with multimedia content taking into account our setup.

References

[1]
R. Abreu, D. Mattos, J. A. F. dos Santos, and D. C. Muchaluat-Saade. 2019. Semi-Automatic Synchronization of Sensory Effects in Mulsemedia Authoring Tools. In Proc. of the 25th Brazilian Symposium on Multimedia and the Web (Rio de Janeiro, Brazil) (WebMedia '19). ACM, 201--208.
[2]
J. Brooks, S. Nagels, and P. Lopes. 2020. Trigeminal-Based Temperature Illusions. In Proc. of the CHI Conf. on Human Factors in Comp. Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--12.
[3]
S. Cardin, D. Thalmann, and F. Vexo. 2007. Head Mounted Wind. Proc. of the 20th annual conf. on Computer Anim. and Social Agents (CASA2007) (2007), 101--108.
[4]
I. Comşa, E. B. Saleme, A. Covaci, G. M. Assres, R. Trestian, C. A. S. Santos, and G. Ghinea. 2020. Do I Smell Coffee? The Tale of a 360° Mulsemedia Experience. IEEE MultiMedia 27, 1 (2020), 27--36. https://doi.org/10.1109/MMUL.2019.2954405
[5]
A. Covaci, R. Trestian, E. B. Saleme, I-S. Comsa, G. Assres, C. A. S. Santos, and G. Ghinea. 2019. 360° Mulsemedia: A Way to Improve Subjective QoE in 360° Videos. In Proceedings of the 27th ACM International Conference on Multimedia (Nice, France) (MM '19). Association for Computing Machinery, New York, NY, USA, 2378--2386. https://doi.org/10.1145/3343031.3350954
[6]
M. Feng, R. W. Lindeman, H. Abdel-Moati, and J. C. Lindeman. 2015. Haptic ChairIO: A system to study the effect of wind and floor vibration feedback on spatial orientation in VEs. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 149--150. https://doi.org/10.1109/3dui.2015.7131744
[7]
A. L. V. Guedes, R. G. Azevedo, P. Frossard, S. Colcher, and S. D. J. Barbosa. 2019. Subjective Evaluation of 360-degree Sensory Experiences. In 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP). IEEE, 1--6.
[8]
P-H. Han, Y-S. Chen, C-E. Hsieh, H-C. Wang, and Y-P. Hung. 2019. Hapmosphere: Simulating the Weathers for Walking Around in Immersive Environment with Haptics Feedback. In 2019 IEEE World Haptics Conference (WHC). IEEE.
[9]
P-H. Han, Y-S. Chen, K-C. Lee, H-C. Wang, C-E. Hsieh, J-C. Hsiao, C-H. Chou, and Y-P. Hung. 2018. Haptic around. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. ACM.
[10]
L. A. Jones and M. Berris. 2002. The psychophysics of temperature perception and thermal-interface design. In Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002. 137--142.
[11]
P. Ke, K-N. Keng, S.Jiang, S. Cai, Z. Rong, and K. Zhu. 2019. Embodied Weather: Promoting Public Understanding of Extreme Weather Through Immersive Multi-Sensory Virtual Reality. In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry. ACM.
[12]
S. Kim, Y-K. Row, and T-J. Nam. 2018. Thermal Interaction with a Voice-based Intelligent Agent. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3170427.3188656
[13]
T. Moon and G. J. Kim. 2004. Design and evaluation of a wind display for virtual reality. In Proceedings of the ACM symposium on Virtual reality software and technology - VRST '04. ACM Press. https://doi.org/10.1145/1077534.1077558
[14]
M. Nakajima, Y. Makino, and H. Shinoda. 2020. Remote Cooling Sensation Presentation Controlling Mist in Midair. In 2020 IEEE/SICE International Symposium on System Integration (SII). IEEE. https://doi.org/10.1109/sii46433.2020.9025959
[15]
D. Narciso, M. Melo, J. Vasconcelos-Raposo, and M. Bessa. 2020. The Impact of Olfactory and Wind Stimuli on 360 Videos Using Head-mounted Displays. ACM Transactions on Applied Perception 17, 1 (March 2020), 1--13.
[16]
Philips. 2015. Philips amBX Gaming PC peripherals SGC5103BD Premium kit. https://philips.to/35tvRzF. Online; accessed 10-September-2019.
[17]
B. Rainer, M. Waltl, E. Cheng, M. Shujau, C. Timmerer, S. Davis, I. Burnett, C. Ritz, and H. Hellwagner. 2012. Investigating the impact of sensory effects on the Quality of Experience and emotional response in web videos. In 2012 Fourth International Workshop on Quality of Multimedia Experience. IEEE. https://doi.org/10.1109/qomex.2012.6263842
[18]
M. Rheiner. 2014. Birdly an attempt to fly. In ACM SIGGRAPH 2014 Emerging Technologies on - SIGGRAPH '14. ACM Press.
[19]
E. B. Saleme. 2019. A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems. Ph.D. Dissertation. Federal University of Espírito Santo.
[20]
E. B. Saleme, A. Covaci, G. Mesfin, C. A. S. Santos, and G. Ghinea. 2019. Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment. ACM Comput. Surv. 52, 3, Article 58 (June 2019), 29 pages. https://doi.org/10.1145/3319853
[21]
E. B. Saleme and C. A. S. Santos. 2015. PlaySEM: A Platform for Rendering MulSeMedia Compatible with MPEG-V. In Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (Manaus, Brazil) (WebMedia '15). Association for Computing Machinery, New York, NY, USA, 145--148.
[22]
E. B. Saleme, C. A. S. Santos, R. A. Falbo, G. Ghinea, and F. Andres. 2019. MulseOnto: a Reference Ontology to Support the Design of Mulsemedia Systems. Journal of Universal Computer Science 25, 13 (dec 2019), 1761--1786.
[23]
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2019. A Mulsemedia Framework for Delivering Sensory Effects to Heterogeneous Systems. Multimedia Syst. 25, 4 (Aug. 2019), 421--447. https://doi.org/10.1007/s00530-019-00618-8
[24]
E. Shaw, T. Roper, T. Nilsson, G. Lawson, S. V.G. Cobb, and D. Miller. 2019. The Heat is On. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press.
[25]
D. Tolley, T. N. T. Nguyen, A. Tang, N. Ranasinghe, K. Kawauchi, and C. C. Yen. 2019. WindyWall. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM.
[26]
M. Waltl, B. Rainer, C. Timmerer, and H. Hellwagner. 2013. An end-to-end tool chain for Sensory Experience based on MPEG-V. Signal Processing: Image Comm. 28, 2 (Feb. 2013), 136--150. https://doi.org/10.1016/j.image.2012.10.009
[27]
M. Waltl, C. Timmerer, B. Rainer, and H. Hellwagner. 2012. Sensory effect dataset and test setups. In 4th Int. Workshop on Quality of Multimedia Experience. IEEE.
[28]
A. Wilberz, D. Leschtschow, C. Trepkowski, J. Maiero, E. Kruijff, and B. Riecke. 2020. FaceHaptics: Robot Arm based Versatile Facial Haptics for Immersive Environments. In Proc. of the CHI Conf. on Human Factors in Comp. Sys. ACM.
[29]
G. Wilson, M. Halvey, S. A. Brewster, and S. A. Hughes. 2011. Some like It Hot: Thermal Feedback for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 2555--2564.
[30]
J. Xu, Y. Kuroda, S. Yoshimoto, and O. Oshiro. 2019. Non-contact Cold Thermal Display by Controlling Low-temperature Air Flow Generated with Vortex Tube. In 2019 IEEE World Haptics Conference (WHC). IEEE.

Cited By

View all
  • (2024)MEMS-Based Microheater With Virtual Reality for Enhanced Thermal Feedback in Medical ApplicationsIEEE Access10.1109/ACCESS.2024.344138812(125966-125975)Online publication date: 2024
  • (2023)Generating Haptic Motion Effects for Multiple Articulated Bodies for Improved 4D Experiences: A Camera Space ApproachProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580727(1-17)Online publication date: 19-Apr-2023
  • (2023)Pseudo-Wind Perception Induced by Cross-Modal Reproduction of Thermal, Vibrotactile, Visual, and Auditory StimuliIEEE Access10.1109/ACCESS.2023.323631011(4781-4793)Online publication date: 2023

Index Terms

  1. A Haptic System for Switching Wind Temperatures Based on Ultrasonic Vibrations, Peltier Elements, and Electrical Resistances for Multisensory Applications

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WebMedia '21: Proceedings of the Brazilian Symposium on Multimedia and the Web
      November 2021
      271 pages
      ISBN:9781450386098
      DOI:10.1145/3470482
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      In-Cooperation

      • SBC: Brazilian Computer Society
      • CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
      • CAPES: Brazilian Higher Education Funding Council

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 November 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Temperature
      2. cold wind
      3. haptics
      4. hot wind
      5. mulsemedia
      6. simulation

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      WebMedia '21
      Sponsor:
      WebMedia '21: Brazilian Symposium on Multimedia and the Web
      November 5 - 12, 2021
      Minas Gerais, Belo Horizonte, Brazil

      Acceptance Rates

      WebMedia '21 Paper Acceptance Rate 24 of 75 submissions, 32%;
      Overall Acceptance Rate 270 of 873 submissions, 31%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)37
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 18 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)MEMS-Based Microheater With Virtual Reality for Enhanced Thermal Feedback in Medical ApplicationsIEEE Access10.1109/ACCESS.2024.344138812(125966-125975)Online publication date: 2024
      • (2023)Generating Haptic Motion Effects for Multiple Articulated Bodies for Improved 4D Experiences: A Camera Space ApproachProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580727(1-17)Online publication date: 19-Apr-2023
      • (2023)Pseudo-Wind Perception Induced by Cross-Modal Reproduction of Thermal, Vibrotactile, Visual, and Auditory StimuliIEEE Access10.1109/ACCESS.2023.323631011(4781-4793)Online publication date: 2023
      • (2023)Thermal and wind devices for multisensory human-computer interaction: an overviewMultimedia Tools and Applications10.1007/s11042-023-14672-y82:22(34485-34512)Online publication date: 7-Mar-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media