Abstract
Creating tactile patterns on the body via a spatial arrangement of many tactile actuators offers many opportunities and presents a challenge, as the design space is enormous. This paper presents a VR interface that enables designers to rapidly prototype complex tactile interfaces. It allows for painting strokes on a modeled body part and translates these strokes into continuous tactile patterns using an interpolation algorithm. The presented VR approach avoids several problems of traditional 2D editors. It realizes spatial 3D input using VR controllers with natural mapping and intuitive spatial movements. To evaluate this approach in detail, we conducted a user study and iteratively improved the system. The study participants gave predominantly positive feedback on the presented VR interface (SUS score 79.7, AttrakDiff “desirable”). The final system is released alongside this paper as an open-source Unity project for various tactile hardware.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
http://attrakdiff.de/index-en.html – accessed September 04, 2020.
- 2.
https://www.valvesoftware.com/en/index/controllers – accessed August 20, 2020.
- 3.
VRTactileDraw open-source release: https://github.com/obkaul/VRTactileDraw.
References
Alger, M.: Visual Design Methods for Virtual Reality. Personal Website (September), 98 (2015). http://aperturesciencellc.com/vr/VisualDesignMethodsforVR_MikeAlger.pdf
Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean. J. Usability Stud. 4(3), 114–123 (2009)
BHaptics: bHaptics Tactot (2020). https://www.bhaptics.com/tactsuit/
Bloomfield, A., Badler, N.I.: A Low cost tactor suit for vibrotactile feedback a low cost tactor suit for vibrotactile feedback. Technical reports (CIS) (January), 7 (2003)
Brooke, J.: SUS : a Retrospective. J. Usability Stud. 8(2), 29–40 (2013)
Cuartielles, D., Göransson, A., Olsson, T., Stenslie, S.: Developing visual editors for high-resolution haptic patterns. In: The Seventh International Workshop on Haptic and Audio Interaction Design, pp. 42–44 (2012). http://www.forskningsdatabasen.dk/en/catalog/2389362226
Danieau, F., Guillotel, P., Dumas, O., Lopez, T., Leroy, B., Mollet, N.: HFX studio: haptic editor for full-body immersive experiences. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST (2018). https://doi.org/10.1145/3281505.3281518
de Jesus Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Designing a vibrotactile head-mounted display for spatial awareness in 3d spaces. IEEE Trans. Vis. Comput. Graphics 23(4), 1409–1417 (2017). https://doi.org/10.1109/TVCG.2017.2657238, http://ieeexplore.ieee.org/document/7829406/
Deering, M.F.: HoloSketch: a virtual reality sketching / animation tool. ACM Trans. Comput.-Hum. Interact. (TOCHI) 2(3), 220–238 (1995). https://doi.org/10.1145/210079.210087
Delazio, A., Nakagaki, K., Lehman, J.F., Klatzky, R.L., Sample, A.P., Hudson, S.E.: Force jacket: pneumatically-actuated jacket for embodied haptic experiences. In: Conference on Human Factors in Computing Systems - Proceedings 2018-April, pp. 1–12 (2018). https://doi.org/10.1145/3173574.3173894
Dobrzynski, M.K., Mejri, S., Wischmann, S., Floreano, D.: Quantifying information transfer through a head-attached vibrotactile display: principles for design and control. IEEE Trans. Biomed. Eng. 59(7), 2011–2018 (2012). https://doi.org/10.1109/TBME.2012.2196433, http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6189750
Dünser, A., Steinbügl, K., Kaufmann, H., Glück, J.: Virtual andaugmented reality as spatial ability training tools. In: ACM InternationalConference Proceeding Seriesvol. 158, pp. 125–132 (2006). https://doi.org/10.1145/1152760.1152776
Enriquez, M.J., MacLean, K.E.: The hapticon editor: A tool in support of haptic communication research. In: Proceedings - 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS 2003, pp. 356–362. IEEE Computer Society (2003). https://doi.org/10.1109/HAPTIC.2003.1191310, http://ieeexplore.ieee.org/document/1191310/
Erp, J.B.F.V., Veen, H.A.H.C.V.: A Multi-purpose tactile vest for astronauts in the international space station. In: Proceedings of Eurohaptics, pp. 405–408 (2003)
Flores, G., Kurniawan, S., Manduchi, R., Martinson, E., Morales, L.M., Sisbot, E.A.: Vibrotactile guidance for wayfinding of blind walkers. IEEE Trans. Haptics 8(3), 306–317 (2015). https://doi.org/10.1109/TOH.2015.2409980
Geldard, F.A.: Adventures in tactile literacy. Am. Psychol. 12(3), 115–124 (1957). https://doi.org/10.1037/h0040416, http://content.apa.org/journals/amp/12/3/115
Google LLC: Tilt Brush by Google (2016). https://www.tiltbrush.com/
Green-Armytage, P.: A colour alphabet and the limits of colour coding. JAIC - J. Int. Colour Assoc. 5, 1–23 (2010). https://www.aic-color.org/resources/Documents/jaic_v5_06.pdf
Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität, pp. 187–196. Vieweg+Teubner Verlag (2003). https://doi.org/10.1007/978-3-322-80058-9_19, http://link.springer.com/10.1007/978-3-322-80058-9_19
Hong, K., Lee, J., Choi, S.: Demonstration-based vibrotactile pattern authoring. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction - TEI 2013, p. 219. ACM Press, New York, USA (2013). https://doi.org/10.1145/2460625.2460660
Huang, D.Y., et al.: VibroPlay: aaorind three-dimensional spatial-temporal tactile effects with direct manipulation. In: SA 2016 - SIGGRAPH ASIA 2016 Emerging Technologies (2016). https://doi.org/10.1145/2988240.2988250
Israr, A., Poupyrev, I.: Tactile brush. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI 2011, p. 2019. ACM Press, New York, USA (May 2011). https://doi.org/10.1145/1978942.1979235
Jones, L.A., Sarter, N.B.: Tactile displays: guidance for their design and application. Hum. Factors 50(1), 90–111 (2008). https://doi.org/10.1518/001872008X250638, http://journals.sagepub.com/doi/10.1518/001872008X250638
Kaul, O.B., Hansing, L., Rohs, M.: 3DTactileDraw: a tactile pattern design interface for complex arrangements of actuators. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems - CHI EA 2019, pp. 1–6. ACM Press, New York, USA (2019). https://doi.org/10.1145/3290607.3313030
Kaul, O.B., Rohs, M.: HapticHead: 3d guidance and target acquisition through a vibrotactile grid. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA 2016, pp. 2533–2539. ACM Press, New York, USA (May 2016). https://doi.org/10.1145/2851581.2892355
Kaul, O.B., Rohs, M.: HapticHead: a spherical vibrotactile grid around the head for 3d guidance in virtual and augmented reality. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI 2017, pp. 3729–3740. ACM Press, New York, USA (2017). https://doi.org/10.1145/3025453.3025684
Kaul, O.B., Rohs, M., Simon, B., Demir, K.C., Ferry, K.: Vibrotactile funneling illusion and localization performance on the head. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems - CHI 2020, pp. 1–13. Association for Computing Machinery (ACM), Honolulu, Hawaii, USA (April 2020). https://doi.org/10.1145/3313831.3376335
Koch, M., Von Luck, K., Schwarzer, J., Draheim, S.: The novelty effect in large display deployments-experiences and lessons-learned for evaluating prototypes. In: ECSCW 2018 - Proceedings of the 16th European Conference on Computer Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET) (2018). https://dl.eusset.eu/handle/20.500.12015/3115
Konishi, Y., et al.: Synesthesia suit. In: Hasegawa, S., Konyo, M., Kyung, K.-U., Nojima, T., Kajimoto, H. (eds.) AsiaHaptics 2016. LNEE, vol. 432, pp. 499–503. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-4157-0_84
LaViola Jr, J.J.: A discussion of cybersickness in virtual environments. ACM SIGCHI Bull. 32(1), 47–56 (2000). https://doi.org/10.1145/333329.333344, http://portal.acm.org/citation.cfm?doid=333329.333344
Lin, J.J.W., Abi-Rached, H., Kim, D.H., Parker, D.E., Furness, T.A.: A “natural” independent visual background reduced simulator sickness. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 46, no. 26, pp. 2124–2128 (2002). https://doi.org/10.1177/154193120204602605, http://journals.sagepub.com/doi/10.1177/154193120204602605
Lindeman, R.W., Page, R., Yanagida, Y., Sibert, J.L.: Towards full-body haptic feedback: the design and deployment of a spatialized vibrotactile feedback system. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST, pp. 146–149 (2004)
Paneels, S., Anastassova, M., Strachan, S., Van, S.P., Sivacoumarane, S., Bolzmacher, C.: What’s around me Multi-actuator haptic feedback on the wrist. In: 2013 World Haptics Conference, WHC 2013, pp. 407–412 (2013)
Pielot, M., Krull, O., Boll, S.: Where is my team? Supporting situation awareness with tactile displays. In: Proceedings of the 28th international conference on Human factors in computing systems - CHI 2010, p. 1705. ACM Press, New York, USA (April 2010). https://doi.org/10.1145/1753326.1753581
Precision Microdrives: Precision Microdrives 312–101 (2017). https://www.precisionmicrodrives.com/product/312-101-12mm-vibration-motor-3mm-type
Ryu, J., Choi, S.: posVibEditor: graphical authoring tool of vibrotactile patterns. In: 2008 IEEE International Workshop on Haptic Audio visual Environments and Games, pp. 120–125. IEEE (Oct 2008). https://doi.org/10.1109/HAVE.2008.4685310, http://ieeexplore.ieee.org/document/4685310/
Sauro, J.: A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices. Measuring Usability LLC, Denver (2011)
Schneider, O.S., Israr, A., MacLean, K.E.: Tactile animation by direct manipulation of grid displays. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST 2015, pp. 21–30. ACM Press, New York, USA (2015). https://doi.org/10.1145/2807442.2807470
Schneider, O.S., Maclean, K.E.: Improvising design with a haptic instrument. In: IEEE Haptics Symposium, HAPTICS, pp. 327–332 (2014). https://doi.org/10.1109/HAPTICS.2014.6775476
Schneider, O.S., MacLean, K.E.: Studying design process and example use with Macaron, a web-based vibrotactile effect editor. In: IEEE Haptics Symposium, HAPTICS 2016-April, pp. 52–58 (2016). https://doi.org/10.1109/HAPTICS.2016.7463155
Schrapel, M., Loewen, S., Rohs, M.: MultiWave: A Fully Customizable Mobile Function Generator For Haptic Feedback In VR. Contest (2019)
Seifi, H., Anthonypillai, C., MacLean, K.E.: End-user customization of affective tactile messages: a qualitative examination of tool parameters. In: 2014 IEEE Haptics Symposium (HAPTICS), pp. 251–256. IEEE (Feb 2014). https://doi.org/10.1109/HAPTICS.2014.6775463, http://ieeexplore.ieee.org/document/6775463/
Sherman, W.R., Craig, A.B.: Understanding virtual reality : interface, application, and design (2018). https://books.google.de/books?hl=en&lr=&id=D-OcBAAAQBAJ
Swindells, C., Pietarinen, S., Viitanen, A.: Medium fidelity rapid prototyping of vibrotactile haptic, audio and video effects. In: IEEE Haptics Symposium, HAPTICS, pp. 515–521 (2014). https://doi.org/10.1109/HAPTICS.2014.6775509
Tsukada, K., Yasumura, M.: ActiveBelt: belt-type wearable tactile display for directional navigation, vol. 3205 (2004). http://link.springer.com/chapter/10.1007/978-3-540-30119-6_23
Unity Technologies: Unity - Manual: VR overview (2019). https://docs.unity3d.com/Manual/VROverview.html
Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.C.: The Think Aloud Method: A Practical Approach to Modelling Cognitive Processes. London: AcademicPress, Cambridge (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material 1 (mp4 164818 KB)
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Kaul, O.B., Domin, A., Rohs, M., Simon, B., Schrapel, M. (2021). VRTactileDraw: A Virtual Reality Tactile Pattern Designer for Complex Spatial Arrangements of Actuators. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12936. Springer, Cham. https://doi.org/10.1007/978-3-030-85607-6_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-85607-6_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85606-9
Online ISBN: 978-3-030-85607-6
eBook Packages: Computer ScienceComputer Science (R0)