Abstract
Underwater environments are still providing significant challenges for diver communication and interaction. Smartphones and tablets have the potential to provide great assistance for divers under water and even allow them to utilize augmented and mixed reality, but the housing solutions limit their capabilities. In particular, interaction with them cannot harness a touch screen medium. This paper presents a novel way of providing textual input in underwater environments. The concept is utilizing orientation sensors allowing for tilting a smartphone to input textual information. Three different titling configurations of keyboards were implemented and evaluated on land and in a swimming pool in a user study that involved 17 healthy volunteers and assessed their performance in two different conditions reflecting two typical diving poses. Results clearly demonstrate the benefit of this technique and suggest more effective configurations. A following discussion derives general recommendations for implementing similar methods that use tilting to interact with devices under water.





Similar content being viewed by others
References
Bellarbi A, Domingues C, Otmane S, Benbelkacem S, Dinis A (2013) Augmented reality for underwater activities with the use of the DOLPHYN. In: 2013 10th IEEE international conference on networking, sensing and control (ICNSC). IEEE, pp 409–412. https://doi.org/10.1109/ICNSC.2013.6548773
Castellucci SJ, MacKenzie IS, Misra M, Pandey L, Arif AS (2019) TiltWriter: design and evaluation of a no-touch tilt-based text entry method for handheld devices. In: Proceedings of the 18th international conference on mobile and ubiquitous multimedia, MUM ’19. https://doi.org/10.1145/3365610.3365629. Association for Computing Machinery, New York
Čejka J, Zsíros A, Liarokapis F (2020) A hybrid augmented reality guide for underwater cultural heritage sites. Personal and Ubiquitous Computing. https://doi.org/10.1007/s00779-019-01354-6
Chiarella D, Bibuli M, Bruzzone G, Caccia M, Ranieri A, Zereik E, Marconi L, Cutugno P (2018) A novel gesture-based language for underwater human-robot interaction. J Marine Sci Eng 6(3):1–19. https://doi.org/10.3390/jmse6030091. https://www.mdpi.com/2077-1312/6/3/91
Council RST (2019) Minimum course content for common hand signals for scuba diving. Retrieved 15 Aug 2019 from http://wrstc.com/downloads/12%20-%20Common%20Hand%20Signals.pdf
DeMarco KJ, West ME, Howard AM (2014) Underwater human-robot communication: a case study with human divers. In: 2014 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 3738–3743. https://doi.org/10.1109/SMC.2014.6974512
Easydive: Diveshot (2019). Retrieved September 8, 2019 from https://www.easydive.it/en/underwater-housing/smartphone/diveshot.384.html
Felemban E, Shaikh F, Qureshi U, Sheikh A, Qaisar S (2015) Underwater sensor network applications: a comprehensive survey. International Journal of Distributed Sensor Networks. https://doi.org/10.1155/2015/896832. https://journals.sagepub.com/doi/full/10.1155/2015/896832
Fitton D, MacKenzie IS, Read JC, Horton M (2013) Exploring tilt-based text input for mobile devices with teenagers. In: Proceedings of the 27th international BCS human computer interaction conference, BCS-HCI ’13. British Computer Society, Swinton, pp 25:1–25:6. http://dl.acm.org/citation.cfm?id=2578048.2578082
Gong J, Xu Z, Guo Q, Seyed T, Chen XA, Bi X, Yang XD (2018) WrisText: one-handed text entry on smartwatch using wrist gestures. In: Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18. ACM, New York, pp 181:1–181:14. https://doi.org/10.1145/3173574.3173755
Gupta A, Ji C, Yeo HS, Quigley A, Vogel D (2019) RotoSwype: word-gesture typing using a ring. In: Proceedings of the 2019 CHI conference on human factors in computing systems, CHI ’19. ACM, New York, pp 1–12. https://doi.org/10.1145/3290605.3300244
Hollien H, Rothman H (2013) Underwater research, chap. Diver Communication, pp. 1–78. Elsevier
Hong J, Heo S, Isokoski P, Lee G (2015) SplitBoard: a simple split soft keyboard for wristwatch-sized touch screens. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, CHI ’15. ACM, New York, pp 1233–1236. https://doi.org/10.1145/2702123.2702273
iDive (2019) iDive housing. Retrieved 15 August 2019 from http://idivehousing.com/
Jones E, Alexander J, Andreou A, Irani P, Subramanian S (2010) GesText: accelerometer-based gestural text-entry systems. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’10. ACM, New York, pp 2173–2182. https://doi.org/10.1145/1753326.1753655
Ljubic S, Kukec M, Glavinic V (2013) Tilt-based support for multimodal text entry on touchscreen smartphones: Using pitch and roll. In: Proceedings of the 7th international conference on universal access in human-computer interaction: applications and services for quality of life - volume Part III, UAHCI’13. Springer, Berlin, pp 651–660. https://doi.org/10.1007/978-3-642-39194-1_75
MacKenzie S (2002) Mobile text entry using three keys. In: Proceedings of the second nordic conference on human-computer interaction, NordiCHI ’02. Association for Computing Machinery, New York, pp 27–34. https://doi.org/10.1145/572020.572025
Menix M, Misković N, Vukić Z (2014) Interpretation of divers’ symbolic language by using hidden Markov models. In: 2014 37th international convention on information and communication technology, electronics and microelectronics (MIPRO). IEEE, pp 976–981. https://doi.org/10.1109/MIPRO.2014.6859710
Mital MEG, Villaruel HV, Dadios EP (2018) Neural network implementation of divers sign language recognition based on eight Hu-moment parameters. In: 2018 2nd international conference on informatics and computational sciences (ICICos), pp 1–6. https://doi.org/10.1109/ICICOS.2018.8621642
Oney S, Harrison C, Ogan A, Wiese J (2013) ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’13. ACM, New York, pp 2799–2802. https://doi.org/10.1145/2470654.2481387
Oppermann L, Blum L, Shekow M (2016) Playing on AREEF: evaluation of an underwater augmented reality game for kids. In: Proceedings of the 18th international conference on human-computer interaction with mobile devices and services, MobileHCI ’16. ACM, New York, pp 330–340. https://doi.org/10.1145/2935334.2935368
Partridge K, Chatterjee S, Sazawal V, Borriello G, Want R (2002) TiltType: accelerometer-supported text entry for very small devices. In: Proceedings of the 15th annual ACM symposium on user interface software and technology, UIST ’02. ACM, New York, pp 201–204. https://doi.org/10.1145/571985.572013
Patrón P., Petillot YR (2008) The underwater environment: a challenge for planning. In: Proceedings of the 27th workshop of the uk planning and scheduling special interest group
Rahman M, Gustafson S, Irani P, Subramanian S (2009) Tilt techniques: investigating the dexterity of wrist-based input. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’09. ACM, New York, pp 1943–1952. https://doi.org/10.1145/1518701.1518997
Rekimoto J (1996) Tilting operations for small screen interfaces. In: Proceedings of the 9th annual ACM symposium on user interface software and technology, UIST ’96. ACM, New York, pp 167–168. ACM, New York, pp 167–168. https://doi.org/10.1145/237091.237115
Schechner Y, Karpel N (2004) Clear underwater vision. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition. IEEE. https://doi.org/10.1109/CVPR.2004.1315078
Tcha-Tokey K, Christmann O, Loup-Escande E, Richir S (2016) Proposition and validation of a questionnaire to measure the user experience in immersive virtual environments. The International Journal of Virtual Reality 16:33–48
Teather RJ, MacKenzie IS (2014) Position vs. velocity control for tilt-based interaction. In: Proceedings of graphics interface 2014, GI 2014. Canadian Information Processing Society, Toronto, pp 51–58
Walmsley WS, Snelgrove WX, Truong KN (2014) Disambiguation of imprecise input with one-dimensional rotational text entry. ACM Trans Comput-Hum Interact 21(1):4:1–4:40. https://doi.org/10.1145/2542544
Wigdor D, Balakrishnan R (2003) TiltText: using tilt for text input to mobile phones. In: Proceedings of the 16th annual ACM symposium on user interface software and technology, UIST ’03. ACM, New York, pp 81–90. https://doi.org/10.1145/964696.964705
Yeo HS, Phang XS, Castellucci SJ, Kristensson PO, Quigley A (2017) Investigating tilt-based gesture keyboard entry for single-handed text entry on large devices. In: Proceedings of the 2017 CHI conference on human factors in computing systems, CHI ’17. ACM, New York, pp 4194–4202. https://doi.org/10.1145/3025453.3025520
Acknowledgements
We would like to thank all participants involved in our user study for their time and patience.
Funding
This research is a part of the i-MareCulture project (Advanced VR, iMmersive Serious Games and Augmented REality as Tools to Raise Awareness and Access to European Underwater CULTURal heritagE, Digital Heritage) that has received funding from the European Unions Horizon 2020 research and innovation program under Grant Agreement No. 727153. This research was also partially supported by the project that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 739578 (RISE Call: H2020-WIDESPREAD-01-2016-2017-TeamingPhase2) and the Government of the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development.
Author information
Authors and Affiliations
Contributions
Conceptualization, J.Č., J.Ch., F.L.; Data curation, J.Č., J.Ch.; Formal analysis, J.Č.; Funding acquisition, F.L.; Investigation, J.Č.; Methodology, J.Č.; Project administration, F.L.; Resources, J.Č.; Software, J.Č.; Supervision, F.L.; Validation, J.Č.; Visualization, J.Č.; Writing – original draft, J.Č.; Writing – review & editing, J.Č., J.Ch., F.L.;
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Code availability
Not applicable.
Availability of data and material
Data of the tests and user feedback are attached to the manuscript as supplementary materials in electronic form.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Čejka, J., Chmelík, J. & Liarokapis, F. Exploring tilting methods for typing under water. Multimed Tools Appl 80, 31085–31103 (2021). https://doi.org/10.1007/s11042-020-09305-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09305-7