Luke Franzke
ABSTRACT
In the last two decades, there have been several proposals for Intraoral Computer Interfaces (ICI), with demonstrations of novel technologies mostly aimed at assistive devices or in hand-free scenarios. This paper demonstrates a case study for wearable ICIs that allows users to train their tongue muscles with gamified myofunctional therapy: a method that can reduce snoring and mild sleep apnea. This demonstrates a novel application of ICIs together with new design and technological solutions for fabricating such devices. We also discuss the various challenges associated with the design of ICIs and ICI based interactions to lay the groundwork for future research, prototypes and a broader exploration of ICI application areas.
Supplemental Material
- Aiken, C.A. and Becker, K.A. 2022. Utilising an internal focus of attention during preparation and an external focus during execution may facilitate motor learning. European journal of sport science: EJSS: official journal of the European College of Sport Science. (Mar. 2022), 1–8. DOI:https://doi.org/10.1080/17461391.2022.2042604.Google Scholar
Cross Ref
- AlGhanim, N., Comondore, V.R., Fleetham, J., Marra, C.A. and Ayas, N.T. 2008. The economic impact of obstructive sleep apnea. Lung. 186, 1 (Jan. 2008), 7–12. DOI:https://doi.org/10.1007/s00408-007-9055-5.Google ScholarCross Ref
- Bach-y-Rita and Kaczmarek. 2003. A tongue-based tactile display for portrayal of environmental characteristics. Virtual and adaptive environmentsGoogle Scholar
- Bach-y-Rita, Kaczmarek and Meier. 1998. The tongue as a man-machine interface: Proceeding of the 1998 international symposium on information theory and its applications.Google Scholar
- Bach-y-Rita, P., Collins, C.C., Saunders, F.A., White, B. and Scadden, L. 1969. Vision substitution by tactile image projection. Nature. 221, 5184 (Mar. 1969), 963–964. DOI:https://doi.org/10.1038/221963a0.Google ScholarCross Ref
- Bach-y-Rita, P., Kaczmarek, K.A., Tyler, M.E. and Garcia-Lara, J. 1998. Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. Journal of rehabilitation research and development. 35, 4 (Oct. 1998), 427–430.Google Scholar
- Bach-y-Rita, P. and Tyler, M.E. 2000. Tongue man-machine interface. Studies in health technology and informatics. 70, (2000), 17–19.Google Scholar
- Baltzan, M.A., Elkholi, O. and Wolkove, N. 2009. Evidence of interrelated side effects with reduced compliance in patients treated with nasal continuous positive airway pressure. Sleep medicine. 10, 2 (Feb. 2009), 198–205. DOI:https://doi.org/10.1016/j.sleep.2007.12.005.Google ScholarCross Ref
- Borsoi, L., Armeni, P., Donin, G., Costa, F. and Ferini-Strambi, L. 2022. The invisible costs of obstructive sleep apnea (OSA): Systematic review and cost-of-illness analysis. PloS one. 17, 5 (May 2022), e0268677. DOI:https://doi.org/10.1371/journal.pone.0268677.Google ScholarCross Ref
- Caltenco, H.A., Breidegard, B. and Struijk, L.N.S.A. 2014. On the tip of the tongue: learning typing and pointing with an intra-oral computer interface. Disability and rehabilitation. Assistive technology. 9, 4 (Jul. 2014), 307–317. DOI:https://doi.org/10.3109/17483107.2013.823629.Google ScholarCross Ref
- Canadian Agency for Drugs and Technologies in Health (CADTH) 2010. Oral appliances for treatment of snoring and obstructive sleep apnea: a review of clinical effectiveness. CADTH technology overviews. 1, 1 (Mar. 2010), e0107.Google Scholar
- Cascón, P. 2019. ChewIt: An Intraoral Interface for Discreet Interactions.Google Scholar
- Chacin, A.C. 2012. Play-A-Grill: Music To Your Teeth. NIME.Google Scholar
- Chen, V., Xu, X., Li, R., Shi, Y., Patel, S. and Wang, Y. 2021. Understanding the Design Space of Mouth Microgestures. Designing Interactive Systems Conference 2021 (New York, NY, USA, Jun. 2021), 1068–1081.Google Scholar
- Coleman, J. A. 2003. Pathophisiology of snoring and obstructive sleep apnea. Snoring and obstructive sleep apnea. 3th ed.Google Scholar
- Cooper, A. 1996. Goal-directed Design. InContext Enterprises Incorporated.Google Scholar
- Djajadiningrat, T., Overbeeke, K. and Wensveen, S. 2002. But how, Donald, tell us how? Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS ’02.Google Scholar
- de Felício, C.M., da Silva Dias, F.V. and Trawitzki, L.V.V. 2018. Obstructive sleep apnea: focus on myofunctional therapy. Nature and science of sleep. 10, (Sep. 2018), 271–286. DOI:https://doi.org/10.2147/NSS.S141132.Google ScholarCross Ref
- Feng, Y. and Wang, X. 2019. Ultrasound Tongue Image Classification using Transfer Learning. Proceedings of the 2019 2nd International Conference on Digital Medicine and Image Processing (New York, NY, USA, Nov. 2019), 38–42.Google ScholarDigital Library
- Georgalas, C. 2011. The role of the nose in snoring and obstructive sleep apnoea: an update. European archives of oto-rhino-laryngology: official journal of the European Federation of Oto-Rhino-Laryngological Societies : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery. 268, 9 (Sep. 2011), 1365–1373. DOI:https://doi.org/10.1007/s00405-010-1469-7.Google ScholarCross Ref
- Google trends: https://trends.google.com/trends/explore?date=all&q=sleep%20quality. Accessed: 2022-10-12.Google Scholar
- Hori, K., Ono, T., Tamine, K.-I., Kondo, J., Hamanaka, S., Maeda, Y., Dong, J. and Hatsuda, M. 2009. Newly developed sensor sheet for measuring tongue pressure during swallowing. Journal of prosthodontic research. 53, 1 (Jan. 2009), 28–32. DOI:https://doi.org/10.1016/j.jpor.2008.08.008.Google ScholarCross Ref
- Huo, X., Park, H. and Ghovanloo, M. 2012. Dual-mode tongue drive system: using speech and tongue motion to improve computer access for people with disabilities. Proceedings of the conference on Wireless Health (New York, NY, USA, Oct. 2012), 1–8.Google ScholarDigital Library
- Ieto, V., Kayamori, F., Montes, M.I., Hirata, R.P., Gregório, M.G., Alencar, A.M., Drager, L.F., Genta, P.R. and Lorenzi-Filho, G. 2015. Effects of Oropharyngeal Exercises on Snoring: A Randomized Trial. Chest. 148, 3 (Sep. 2015), 683–691. DOI:https://doi.org/10.1378/chest.14-2953.Google ScholarCross Ref
- Kaczmarek, K.A. 2011. The tongue display unit (TDU) for electrotactile spatiotemporal pattern presentation. Scientia Iranica. Transactions D, Computer science & engineering, electrical engineering. 18, 6 (Dec. 2011), 1476–1485. DOI:https://doi.org/10.1016/j.scient.2011.08.020.Google ScholarCross Ref
- Kencana, A.P. and Heng, J. 2007. Experiment on a novel user input for computer interface utilizing tongue input for severely disabled. Proceedings of the 1st international convention on Rehabilitation engineering & assistive technology: in conjunction with 1st Tan Tock Seng Hospital Neurorehabilitation Meeting (New York, NY, USA, Apr. 2007), 114–117.Google Scholar
- Kielhofner, G., Marotzki, U. and Mentrup, C. 2005. Model of Human Occupation (MOHO): Grundlagen für die Praxis. Springer Berlin Heidelberg.Google Scholar
- Kim, J., Hegland, K., Vann, W., Berry, R. and Davenport, P.W. 2019. Measurement of maximum tongue protrusion force (MTPF) in healthy young adults. Physiological reports. 7, 13 (Jul. 2019), e14175. DOI:https://doi.org/10.14814/phy2.14175.Google ScholarCross Ref
- Lauga, E., Pipe, C.J. and Le Révérend, B. 2016. Sensing in the Mouth: A Model for Filiform Papillae as Strain Amplifiers. Frontiers in Physics.Google Scholar
- Lee Electropalatography. Manual of clinical phonetics. DOI:https://doi.org/10.4324/9780429320903-25/electropalatography-alice-lee.Google ScholarCross Ref
- Li, Z., Robucci, R., Banerjee, N. and Patel, C. 2015. Tongue-n-cheek: non-contact tongue gesture recognition. Proceedings of the 14th International Conference on Information Processing in Sensor Networks (New York, NY, USA, Apr. 2015), 95–105.Google ScholarDigital Library
- Lontis, E.R., Bentsen, B., Gaihede, M. and Andreasen Struijk, L.N.S. 2016. Sensor Activation for Wheelchair Driving in Confined Spaces with a Tongue Controlled Oral Interface. Proceedings of the international Convention on Rehabilitation Engineering & Assistive Technology (Midview City, SGP, Jul. 2016), 1–4.Google Scholar
- Maeyama, T. and Plattig, K.-H. 1989. Minimal two-point discrimination in human tongue and palate. American Journal of Otolaryngology.Google Scholar
- Maia, A.V., Furlan, R.M.M.M., Moraes, K.O., Amaral, M.S., Medeiros, A.M. de and Motta, A.R. 2019. Tongue strength rehabilitation using biofeedback: a case report. CoDAS. 31, 5 (Oct. 2019), e20180163. DOI:https://doi.org/10.1590/2317-1782/20182018163.Google ScholarCross Ref
- Miyashita, H. 2020. Norimaki Synthesizer: Taste Display Using Ion Electrophoresis in Five Gels. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems.Google Scholar
- Nam, H.Y. and DiSalvo, C. 2010. Tongue music: the sound of a kiss. CHI ’10 Extended Abstracts on Human Factors in Computing Systems (New York, NY, USA, Apr. 2010), 4805–4808.Google Scholar
- Narumi, T. 2016. Multi-sensorial virtual reality and augmented human food interaction. Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction.Google ScholarDigital Library
- Ono, T., Hori, K., Tamine, K.-I. and Maeda, Y. 2009. Evaluation of tongue motor biomechanics during swallowing—From oral feeding models to quantitative sensing methods. The Japanese dental science review. 45, 2 (Sep. 2009), 65–74. DOI:https://doi.org/10.1016/j.jdsr.2009.03.005.Google ScholarCross Ref
- Gimpel, H., Nissen, M., & Görlitz, R. 2013. Quantifying the Quantified Self: A study on the motivation of patients to track their own health: https://core.ac.uk/download/pdf/301361222.pdf. Accessed: 2022-10-12.Google Scholar
- Ranasinghe, N. and Do, E.Y.-L. 2016. Virtual Sweet. Proceedings of the 29th Annual Symposium on User Interface Software and Technology.Google Scholar
- Ranasinghe, N., Jain, P., Karwita, S. and Do, E.Y.-L. 2017. Virtual Lemonade. Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction.Google Scholar
- Richardson, M.L., Lloyd-Esenkaya, T., Petrini, K. and Proulx, M.J. 2020. Reading with the Tongue: Individual Differences Affect the Perception of Ambiguous Stimuli with the BrainPort. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2020), 1–10.Google ScholarDigital Library
- Sakurai, S., Aoyama, K., Miyamoto, N., Mizukami, M., Furukawa, M., Maeda, T. and Ando, H. 2016. Mechanism of inhibitory effect of cathodal current tongue stimulation on five basic tastes. 2016 IEEE Virtual Reality (VR).Google Scholar
- Salem, C. and Zhai, S. 1997. An isometric tongue pointing device. Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (New York, NY, USA, Mar. 1997), 538–539.Google ScholarDigital Library
- Saponas, T.S., Kelly, D., Parviz, B.A. and Tan, D.S. 2009. Optically sensing tongue gestures for computer input. Proceedings of the 22nd annual ACM symposium on User interface software and technology (New York, NY, USA, Oct. 2009), 177–180.Google ScholarDigital Library
- Shao, Y., Hayward, V. and Visell, Y. 2016. Spatial patterns of cutaneous vibration during whole-hand haptic interactions. Proceedings of the National Academy of Sciences of the United States of America. 113, 15 (Apr. 2016), 4188–4193. DOI:https://doi.org/10.1073/pnas.1520866113.Google ScholarCross Ref
- Shen, V., Shultz, C. and Harrison, C. 2022. Mouth Haptics in VR using a Headset Ultrasound Phased Array. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2022), 1–14.Google Scholar
- Shepherd, G.M. 2015. Neuroenology: how the brain creates the taste of wine. Flavour. 4, 1 (Mar. 2015), 1–5. DOI:https://doi.org/10.1186/s13411-014-0030-9.Google ScholarCross Ref
- Slyper, R., Lehman, J., Forlizzi, J. and Hodgins, J. 2011. A tongue input device for creating conversations. Proceedings of the 24th annual ACM symposium on User interface software and technology (New York, NY, USA, Oct. 2011), 117–126.Google ScholarDigital Library
- Van Boven, R.W. and Johnson, K.O. 1994. The limit of tactile spatial resolution in humans: grating orientation discrimination at the lip, tongue, and finger. Neurology. 44, 12 (Dec. 1994), 2361–2366. DOI:https://doi.org/10.1212/wnl.44.12.2361.Google ScholarCross Ref
- Website: https://snoregym.com/about-snoregym/". Accessed: 2022-10-12.Google Scholar
- Young, T., Palta, M., Dempsey, J., Peppard, P.E., Nieto, F.J. and Hla, K.M. 2009. Burden of sleep apnea: rationale, design, and major findings of the Wisconsin Sleep Cohort study. WMJ: official publication of the State Medical Society of Wisconsin. 108, 5 (Aug. 2009), 246–249.Google Scholar
- Zhang, Q., Gollakota, S., Taskar, B. and Rao, R.P.N. 2014. Non-intrusive tongue machine interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2014), 2555–2558.Google ScholarDigital Library
Index Terms
- TOFI: Designing Intraoral Computer Interfaces for Gamified Myofunctional Therapy
Recommendations
Interfaces as specifications in the MIDAS user interface development systems
This paper describes an evolving User Interface Development System called MIDAS (for Merging Interface Development with Application Specification) which allows interface/systems designers to develop an application-specific user interface interactively, ...
A novel programmable waveform generator for ultrasound therapy machine using FPGA
Proceedings of the 15th WSEAS international conference on SystemsThe current ultrasound therapy machines are implementing continuous waveform, which in fact, is not an optimum technique for therapy treatment process. Apparently, pulse waveform appearing as a more effectively way of signal generation in terms of its ...
A Prototype Design for Gamified Blood Donation App Using Blockchain Technology, IPFS and NFTs
SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor SystemsDonating blood is a common practice that has a positive effect on the lives of several individuals. Daily, the number of people in urgent need of blood continues to rise substantially. It is often challenging to find a suitable donor in case of ...
Comments