Skip to main content

Advertisement

SpringerLink
Log in

ReminiScentia: shaping olfactory interaction in a personal space for multisensory stimulation therapy

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Recently, multimodal interfaces are incorporating smell as an additional means of interaction. Devices called olfactory displays have been designed to improve applications with various objectives, such as notifying or alerting through scents, increasing immersion in virtual or augmented reality applications, or learning and enhancement of mental functions. Based on the potential of olfactory memory to evoke memories and emotions to benefit health and well-being, we propose ReminiScentia as an olfactory display to generate and deliver scents. This work presents an evaluation of the effectiveness of ReminiScentia in evoking brain responses similar to those generated by manually delivered scents. To achieve this, we monitored the hemodynamic responses during manual and ReminiScentia olfactory stimulation over the prefrontal cortex (PFC) by using a functional near-infrared spectroscopy (fNIRS) device in 33 healthy subjects. Among the results, it was found that when ReminiScentia was used to deliver the olfactory stimuli, there is no statistically significant difference in the magnitude of concentration changes of OxyHb in the PFC between manual deliver and ReminiScentia (Wilcoxon: p > 0.05). The effectiveness of the use of ReminiScentia has allowed us not only its application for the evocation of memories in a multisensory therapy but also to propose an olfactory interaction design space where olfactory stimuli are used to provide feedback or instructions in multisensory stimulation activities that could support the training of higher mental functions such as memory and learning in patients with cognitive disabilities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Aoyama S, Toshima T, Saito Y, Konishi N, Motoshige K, Ishikawa N, Nakamura K, Kobayashi M (2010) Maternal breast milk odour induces frontal lobe activation in neonates: a NIRS study. Early Hum Dev 86(9):541–545. https://doi.org/10.1016/j.earlhumdev.2010.07.003

    Article  Google Scholar 

  2. Azuma K, Uchiyama I, Takano H, Tanigawa M, Azuma M, Bamba I, Yoshikawa T (2013) Changes in cerebral blood flow during olfactory stimulation in patients with multiple chemical sensitivity: a multi-channel near-infrared spectroscopic study. PLoS One 8:11. https://doi.org/10.1371/journal.pone.0080567

    Article  Google Scholar 

  3. Baillon S, van Diepen E, Prettyman R (2002) Multi-sensory therapy in psychiatric care. Adv Psychiatr Treat 8(6):444–450. https://doi.org/10.1192/apt.8.6.444

    Article  Google Scholar 

  4. Bartocci M et al (2000) Activation of olfactory cortex in newborn infants after odor stimulation: a functional near-infrared spectroscopy study. Pediatr Res 48(1):18–23. https://doi.org/10.1203/00006450-200007000-00006

    Article  Google Scholar 

  5. Borromeo S, Hernandez-Tamames JA, Luna G, Machado F, Malpica N, Toledano A (2010) Objective assessment of olfactory function using functional magnetic resonance imaging (fMRI). IEEE Trans Instrum Meas 59(10):2602–2608. https://doi.org/10.1109/TIM.2010.2057531

    Article  Google Scholar 

  6. Braddock D, University of C.S. and C.I. for C.D et al (2004) Emerging technologies and cognitive disability. J Spec Educ Technol 4:49–56. https://doi.org/10.1177/016264340401900406

    Article  Google Scholar 

  7. Buck LB (1992) A novel multigene family may encode odorant receptors. Soc Gen Physiol Ser 47:39–51

    Google Scholar 

  8. Casillas R et al (2017) Evaluation of a multisensory stimulation tool: effect of auditory, olfactory and visual stimuli for scenario identification and memory evocation. En: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-319-67585-5_35

  9. Dean A et al (2017) Design and analysis of experiments, vol 48. Springer International Publishing, pp 335–344. https://doi.org/10.1016/j.npep.2014.09.004

  10. Delgado-Ballester E, Munuera-Alemán JL (2005) Does brand trust matter to brand equity? J Prod Brand Manag 14(3):187–196. https://doi.org/10.1108/10610420510601058

    Article  Google Scholar 

  11. Dmitrenko D et al (2017) Ospace: towards a systematic exploration of olfactory interaction spaces. Proc. 2017 ACM Int. Conf. Interact. Surfaces Spaces, ISS 2017. pp 171–180. https://doi.org/10.1145/3132272.3134121

  12. Dobbelstein D et al (2017) Demonstration of inscent: a wearable olfactory display as an amplification for mobile notifications. UbiComp/ISWC 2017 - Adjun. Proc. 2017 ACM Int. Jt. Conf. Pervasive Ubiquitous Comput. Proc. 2017 ACM Int. Symp Wearable Comput pp 229–232. https://doi.org/10.1145/3123024.3123185

  13. Ghinea G, Ademoye OA (2011) Olfaction-enhanced multimedia: perspectives and challenges. Multimed Tools Appl 55(3):601–626. https://doi.org/10.1007/s11042-010-0581-4

    Article  Google Scholar 

  14. Harada H, Tanaka M, Kato T (2006) Brain olfactory activation measured by near-infrared spectroscopy in humans. J Laryngol Otol 120(8):638–643. https://doi.org/10.1017/S002221510600123X

    Article  Google Scholar 

  15. Hoshi Y, Kobayashi N, Tamura M (2001) Interpretation of near-infrared spectroscopy signals: a study with a newly developed perfused rat brain model. J Appl Physiol 90(5):1657–1662. https://doi.org/10.1152/jappl.2001.90.5.1657

    Article  Google Scholar 

  16. Irani F, Platek SM, Bunce S, Ruocco AC, Chute D (2007) Functional near infrared spectroscopy (fNIRS): an emerging neuroimaging technology with important applications for the study of brain disorders. Clin Neuropsychol 21(1):9–37. https://doi.org/10.1080/13854040600910018

    Article  Google Scholar 

  17. Ishimaru T et al (2004) Near-infrared spectroscopy of the adult human olfactory cortex. Acta Oto-Laryngologica Suppl 124(553):95–98. https://doi.org/10.1080/03655230410017751

    Article  Google Scholar 

  18. Kaye JN (2001) Symbolic olfactory display. Massachusetts Institute of Technology

  19. Kessels RPC, van Zandvoort MJE, Postma A, Kappelle LJ, de Haan EHF (2000) The Corsi block-tapping task: standardization and normative data. Appl Neuropsychol 7(4):252–258. https://doi.org/10.1207/S15324826AN0704_8

    Article  Google Scholar 

  20. Lloyd-Fox S, Blasi A, Elwell CE (2010) Illuminating the developing brain: the past, present and future of functional near infrared spectroscopy. Neurosci Biobehav Rev 34(3):269–284. https://doi.org/10.1016/j.neubiorev.2009.07.008

    Article  Google Scholar 

  21. Maharjan A et al (2018) Improvement of olfactory function with high frequency non-invasive auricular electrostimulation in healthy humans. Front Neurosci 12:1–14. https://doi.org/10.3389/fnins.2018.00225

    Article  Google Scholar 

  22. Malnic B, Hirono J, Sato T, Buck LB (1999) Combinatorial receptor codes for odors. Cell. 96(5):713–723. https://doi.org/10.1016/S0092-8674(00)80581-4

    Article  Google Scholar 

  23. Matsukura H, Yoneda T, Ishida H (2013) Smelling screen: development and evaluation of an olfactory display system for presenting a virtual odor source. IEEE Trans Vis Comput Graph 19(4):606–615. https://doi.org/10.1109/TVCG.2013.40

    Article  Google Scholar 

  24. Metatla O et al (2019) “Like popcorn”: Crossmodal correspondences between scents, 3D shapes and emotions in children. Conf. Hum. Factors Comput. Syst. - Proc. pp 1–13. https://doi.org/10.1145/3290605.3300689

  25. Murray N, Lee B, Qiao Y, Muntean GM (2016) Olfaction-enhanced multimedia: a survey of application domains, displays, and research challenges. ACM Comput Surv 48:4–34. https://doi.org/10.1145/2816454

    Article  Google Scholar 

  26. Nakamoto T, Otaguro S, Kinoshita M, Nagahama M, Ohinishi K, Ishida T (2008) Cooking up an interactive olfactory game display. IEEE Comput Graph Appl 28(1):75–78. https://doi.org/10.1109/MCG.2008.3

    Article  Google Scholar 

  27. Narumi T et al (2011) Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction. Conf. Hum. Factors Comput. Syst. - Proc. pp 93–102. https://doi.org/10.1145/1978942.1978957

  28. Obrig H (2014) NIRS in clinical neurology - a “promising” tool? Neuroimage. 85:535–546. https://doi.org/10.1016/j.neuroimage.2013.03.045

    Article  Google Scholar 

  29. Olofsson JK, Niedenthal S, Ehrndal M, Zakrzewska M, Wartel A, Larsson M (2017) Beyond smell-O-vision: possibilities for smell-based digital media. Simul Gaming 48(4):455–479. https://doi.org/10.1177/1046878117702184

    Article  Google Scholar 

  30. Ranasinghe N et al (2018) A demonstration of season traveller: multisensory narration for enhancing the virtual reality experience. Conf. Hum. Factors Comput. Syst. - Proc. 2018-April, pp 1–13. https://doi.org/10.1145/3170427.3186513

  31. Sardo JDP et al (2018) Portable device for touch, taste and smell sensations in augmented reality experiences. INCREaSE 2:305–320. https://doi.org/10.1007/978-3-319-70272-8_26

    Article  Google Scholar 

  32. Seah SA et al (2014) SensaBubble: a chrono-sensory mid-air display of sight and smell. Conf. Hum. Factors Comput. Syst. - Proc. pp 2863–2872. https://doi.org/10.1145/2556288.2557087

  33. Sirapracha J, Tocquer G (2012) Branding and customer experience in the wireless telecommunication industry. Int J Trade Econ Financ 3(2):103–108. https://doi.org/10.7763/ijtef.2012.v3.181

    Article  Google Scholar 

  34. Temkin BD (2010) Mapping the customer journey best practices for using an important customer experience tool. Forrester 20

  35. Tsujii H et al (2007) Clinical results of carbon ion radiotherapy at NIRS. J Radiat Res 48(SUPPL. A):4–9. https://doi.org/10.1269/jrr.48.A1

    Article  Google Scholar 

  36. Vlaskamp C, de Geeter KI, Huijsmans LM, Smit IH (2003) Passive activities: the effectiveness of multisensory environments on the level of activity of individuals with profound multiple disabilities. J Appl Res Intellect Disabil 16(2):135–143. https://doi.org/10.1046/j.1468-3148.2003.00156.x

    Article  Google Scholar 

  37. Wartenburger I, Steinbrink J, Telkemeyer S, Friedrich M, Friederici AD, Obrig H (2007) The processing of prosody: evidence of interhemispheric specialization at the age of four. Neuroimage. 34(1):416–425. https://doi.org/10.1016/j.neuroimage.2006.09.009

    Article  Google Scholar 

  38. Yanagida Y (2012) A survey of olfactory displays: making and delivering scents. Proc. IEEE Sensors. pp 1013–1016. https://doi.org/10.1109/ICSENS.2012.6411380

  39. Yoshitani K, Ohnishi Y (2008) The clinical validity of the absolute value of near infrared spectroscopy. J Anesth 22(4):502–504. https://doi.org/10.1007/s00540-008-0671-x

    Article  Google Scholar 

  40. Zatorre RJ et al (1992) Functional localization and lateralization of human olfactory cortex. Nature. 359:710–713

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank participants in this evaluation and CONACYT for scholarship number 445764 provided to the first author.

Funding

This research was partially funded by UABC under grant 0239 of the 21a Convocatoria Interna de Apoyo a Proyectos de Investigación and Proyecto TecNM under grant 7683.20-P.

Author information

Authors and Affiliations

  1. Facultad de Ciencias, Universidad Autónoma de Baja California, Ensenada, Mexico

    Raúl Casillas-Figueroa, Alberto L. Morán & Victoria Meza-Kubo

  2. Tecnológico Nacional de México/I. T. de Ensenada, Ensenada, Mexico

    Cristina Ramírez-Fernández

  3. Departamento de Psicología, Instituto Tecnológico de Sonora, Ciudad Obregón, Sonora, Mexico

    Christian Acosta-Quiroz

  4. Instituto Nacional de Astrofísica, Óptica y Electrónica, Tonantzintla, Puebla, Mexico

    Felipe Orihuela-Espina

  5. Engineering Technology Dept., University of Houston, Houston, USA

    Samuel Montero-Hernandez

Authors
  1. Raúl Casillas-Figueroa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alberto L. Morán
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Victoria Meza-Kubo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cristina Ramírez-Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christian Acosta-Quiroz
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Felipe Orihuela-Espina
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Samuel Montero-Hernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Victoria Meza-Kubo.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures followed were in accordance with the Ethical Code of the Research Ethical Comitee of Universidad Autónoma de Baja California. Consent to participate Participants signed informed consent forms for being included in the study, and their identity was preserved.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Casillas-Figueroa, R., Morán, A.L., Meza-Kubo, V. et al. ReminiScentia: shaping olfactory interaction in a personal space for multisensory stimulation therapy. Pers Ubiquit Comput 26, 1337–1353 (2022). https://doi.org/10.1007/s00779-020-01468-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-020-01468-2

Keywords

Search

Navigation