Patrizia Marti
Oronzo Parlangeli
ABSTRACT
Mid-air haptic technology allows designers to build touchless interfaces incorporating tactile feedback. In the present study, 17 students of the University of Siena were engaged in an experiment where they had to recognize shapes (a circle, a square, or a point) presented one at a time as mid-air haptic stimuli. The task was to discriminate if a stimulus (e.g. round stimulus on the palm of the hand) was compatible with an image (e.g. a circle) or a word (e.g. “circle”) displayed on a screen. The results indicate that only the “point” stimulus can lead to appreciable recognition performance, both in terms of accuracy and in relation to the time needed for the identification. No learning-based performance improvements were found. These results suggest that the haptic feedback provided by the mid-air technology used in the experiment is informative but difficult to discriminate and therefore it should be carefully designed in particular when associated to tasks requiring accuracy and speed of recognition.
- Philip Kortum (Ed.). 2008. HCI Beyond the GUI: design for haptic, speech, olfactory and other nontraditional interfaces. Elsevier, Burlington, MA.Google Scholar
- Heather Culbertson, Samuel B. Schorr and Allison M. Okamura. 2018. Haptics: The present and future of artificial touch sensation. Annual Review of Control, Robotics, and Autonomous Systems, 1, 385-409. DOI: 10.1146/annurev-control-060117-105043Google ScholarCross Ref
- Dangxiao Wang, Kouhei Ohnishi and Weiliang Xu. 2020. Multimodal haptic display for virtual reality: A survey. IEEE Transactions on Industrial Electronics, 67, 1, 610-623. DOI: 10.1109/TIE.2019.2920602Google ScholarCross Ref
- Walter Talamonti, Louis Tijerina, Mike Blommer, Radhakrishnan Swaminathan, Reates Curry and R. Darin. 2017. Mirage events & driver haptic steering alerts in a motion-base driving simulator: a method for selecting an optimal HMI. Applied ergonomics, 65, pp. 90-104. DOI: 10.1016/j.apergo.2017.05.009Google Scholar
- Patrizia Marti, Iolanda Iacono and Michele Tittarelli. 2018. Experiencing sound through interactive jewellery and fashion accessories. In Congress of the International Ergonomics Association, August 26-30, 2018, Florence, Italy. Springer, 1382-1391. DOI: 10.1007/978-3-319-96071-5_140Google Scholar
- Patrizia Marti and Annamaria Recupero. 2019. Is Deafness a Disability? Designing Hearing Aids Beyond Functionality. In Proceedings of the 2019 Conference on Creativity and Cognition, June 23-26, 2019, San Diego, California. ACM, New York, NY, 133-143. DOI: 10.1145/3325480.3325491Google ScholarDigital Library
- Georgios Korres and Mohamad Eid. 2016. Haptogram: Ultrasonic point-cloud tactile stimulation. IEEE Access, 4, 7758-7769. DOI: 10.1109/ACCESS.2016.2608835Google ScholarCross Ref
- Benjamin Long, Sue Ann Seah, Tom Carter and Sriram Subramanian. 2014. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics, 33, 6, 1-10. DOI: 10.1145/2661229.2661257Google ScholarDigital Library
- Davide Rocchesso, Francesco Saverio Cannizzaro, Giovanni Capizzi and Francesco Landolina. 2019. Accessing and selecting menu items by in-air touch. In Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the next interaction, September 23-25, 2019, Padua, Italy. ACM, New York, NY, 1-9. DOI: 10.1145/3351995.3352053Google ScholarDigital Library
- Isa Rutten, William Frier, Lawrence Van den Bogaert and Davis Geerts. 2019. Invisible Touch: How Identifiable are Mid-Air Haptic Shapes?. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, May 4-9, 2019, Glasgow, Scotland. ACM, New York, NY, 1-6. DOI: 10.1145/3290607.3313004Google ScholarDigital Library
- Susan Lederman and Roberta L. Klatzky. 2009. Haptic perception: A tutorial. Attention, Perception, & Psychophysics, 71, 7, 1439-1459. DOI: 10.3758/APP.71.7.1439Google ScholarCross Ref
- Sergio Roncato, Stefano Guidi, Oronzo Parlangeli and Luca Battaglini. 2016. Illusory streaks from corners and their perceptual integration. Frontiers in Psychology, 7, 959, 1-14. DOI: 10.3389/fpsyg.2016.00959Google Scholar
- Tally McCormick Miller, Timo Torsten Schmidt, Felix Blankenburg and Friedemann Pulvermüller. 2018. Verbal labels facilitate tactile perceptions. Cognition, 171, 172-179. DOI: 10.1016/j.cognition.2017.10.010Google ScholarCross Ref
- Irvin Rock and Jack Victor. 1964. Vision and touch: An experimentally created conflict between the two senses. Science, 143, 594–596. DOI: 10.1126/science.143.3606.594Google ScholarCross Ref
- Charles Spence, Michael E.R. Nicholls and Jon Driver. 2001. The cost of expecting events in the wrong sensory modality. Perception & Psychophysics, 63, pp.330-336. DOI: 10.3758/BF03194473Google ScholarCross Ref
- Marc O. Ernst and Martin S. Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 6870), 429-433. DOI: 10.1038/415429aGoogle Scholar
- Dale J. Barr, Roger Levy, Christoph Scheepers and Harry J. Tily. 2013. Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68, 3, 255-278. DOI:10.1016/j.jml.2012.11.001Google ScholarCross Ref
- Oronzo Parlangeli and Sergio Roncato. 2010. Draughtsmen at work. Perception, 39, 255-259. DOI: 10.1068/p6500Google ScholarCross Ref
- Stefano Guidi, Oronzo Parlangeli, Sandro Bettella and Sergio Roncato. 2011. Features of the selectivity for contrast polarity in contour integration revealed by a novel tilt illusion. Perception, 40, 1357-1375. DOI: 10.1068/p6897Google ScholarCross Ref
- John Smythies. 1996. A note on the concept of the visual field in neurology, psychology, and visual neuroscience. Perception, 25, 369-371. DOI: 10.1068/p250369Google ScholarCross Ref
- Brian Wandell, Serge O. Dumoulin and Alyssa A. Brewer. 2007. Visual field maps in human cortex. Neuron, 56, 366-383. DOI: 10.1016/j.neuron.2007.10.012Google ScholarCross Ref
- Patrick Haggard and Giulia Giovagnoli. 2011. Spatial patterns in tactile perception: Is there a tactile field? Acta Psychologica, 137, 1, 65-75. DOI: 10.1016/j.actpsy.2011.03.001Google ScholarCross Ref
- Oculus Blog, 2019, Introducing Hand Tracking on Oculus Quest—Bringing Your Real Hands into VR. Retrieved July 6, 2020 from https://www.oculus.com/blog/introducing-hand-tracking-on-oculus-quest-bringing-your-real-hands-into-vr/Google Scholar
- David R. Large, Kyle Harrington, Gary Burnett and Orestis Georgiou. 2019. Feel the noise: Mid-air ultrasound haptics as a novel human-vehicle interaction paradigm. Applied ergonomics, 81, 102909. DOI: 10.1016/j.apergo.2019.102909Google Scholar
- Touching virtual objects in mid-air: a study on shape recognition
Recommendations
Mid-Air Haptics and Displays: Systems for Un-instrumented Mid-air Interactions
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsA fundamental shift is underway in how we interact with our computers and devices. Touchless sensing products are being launched across consumer electronics, home, automotive and healthcare industries. Recent advances in haptics and display technologies ...
Agency in Mid-air Interfaces
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsTouchless interfaces allow users to view, control and manipulate digital content without physically touching an interface. They are being explored in a wide range of application scenarios from medical surgery to car dashboard controllers. One aspect of ...
Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionIn this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of ...
Comments