Abstract
This paper presents a tactile visualization system incorporating touch feedback to a mobile AR system realized on a handheld device. This system enables, for the first time, interactive haptic feedback though mobile and wearable interfaces. To demonstrate the proposed concept, an interactive scenario that helps a visually impaired user to recognize specific pictograms has been constructed. This system allows users to tactually recognize flat pictograms situated in the real world. Furthermore, it also opens the door to a wide range of applications which could be based on wearable tactile interaction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., Pentland, A.: Augmented Reality through Wearable Computing. Presence 6(4), 386–398 (1997)
Feiner, S., MacIntyre, B., Hoellerer, T.: Wearing it out: First steps toward mobile augmented reality systems. In: Proc. ISMR 1999. Int. Symp. on Mixed Reality, pp. 363–377 (1999)
Sato, K., Ban, Y., Chihara, K.: MR Aided Engineering: Inspection Support Systems Integrating Virtual Instruments and Process Control. In: Mixed Reality, pp. 347–362 (1999)
McGarrity, E., Genc, Y., Tuceryan, M., Owen, C., Navab, N.: Taking ar into large scale industrial environments: Navigation and information access with mobile computers. In: Proc. ISAR 2001. IEEE and ACM Int. Symp. on Augmented Reality, pp. 179–180. IEEE Computer Society Press, Los Alamitos (2001)
Klinker, G., Creighton, O., Dutoit, A.H., Kobylinski, R., Vilsmeier, C., Brügge, B.: Augmented maintenance of powerplants: a prototyping case study of a mobile AR system. In: Proc. ISAR 2001. IEEE and ACM Int. Symp. on Augmented Reality, pp. 124–133. IEEE Computer Society Press, Los Alamitos (2001)
Loomis, J., Golledge, R., Klatzky, R.: Personal Guidance System for the Visually Impaired Using GPS, GIS, and VR technologies. In: Proc. of Conf. on Virtual Reality System and Persons with Disabilities (1993)
Petrie, H., Johnson, V., Strothotte, T., Fritz, S., Michel, R., Raab, A.: MoBIC: Designing a Travel Aid for Blind and Elderly People. Journal of Navigation 49(1), 45–52 (1996)
Furmanski, C., Azuma, R., Daily, M.: Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information. In: Proc. ISMAR 2002. IEEE and ACM Int. Symp. on Mixed and Augmented Reality, pp. 215–224. IEEE Computer Society Press, Los Alamitos (2002)
Feiner, S., MacIntyre, B., Hollerer, T., Webster, A.: A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In: Proc. of the First IEEE Int. Symp. on Wearable Computers, pp. 74–81. IEEE Computer Society Press, Los Alamitos (1997)
Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. In: Proc. of ACM CHI 2000, ACM Press, New York (2000)
Fenier, S.: Augmented Reality: A New Way of Seeing. Scientific American 286(4), 48–55 (2002)
Hollerer, T., Pavlik, J.V., Feiner, S.: Situated documentaries: Embedding multimedia presentations in the real world. In: Proc. of The Third Int. Symp. on Wearable Computers, pp. 79–86 (1999)
Vlahakis, V., Ioannidis, N., Karigiannis, J., Tsotros, M., Gounaris, M., Stricker, D., Gleue, T., Daehne, P., Almeida, L.: Archeoguide: An Augmented Reality Guide for Archaeological Sites. IEEE Computer Graphics and Applications 22(5), 52–60 (2002)
Rekimoto, J., Ayatsuka, Y., Hayashi, K.: Augment-able reality: Situated communication through physical and digital spaces. In: Proc. ISWC 1998. Second Int. Symp. on Wearable Computers, pp. 68–75 (1998)
Baillot, Y., Brown, D., Julier, S.: Authoring of physical models using mobile computers. In: Proc. ISWC 2001. Fifth IEEE Int. Symp. on Wearable Computers, pp. 39–46. IEEE Computer Society Press, Los Alamitos (2001)
Piekarski, W., Thomas,B.: Tinmith-Metro: New outdoor techniques for creating city 16models with an augmented reality wearable computer. In: Proc. ISWC 2001. Fifth IEEE Int. Symp. on Wearable Computers, pp. 31-38, 2001.
Thomas, B., Close, B., Donoghue, J., Squires, J., De Bondi, P., Morris, M., Piekarski, W.: ARQuake: An outdoor/indoor augmented reality first person application. In: ISWC 2000. Fourth Int. Symp. on Wearable Computers, pp. 139–146 (2000)
Starner, T., Leibe, B., Singletary, B., Pair, J.: MIND-WARPING: towards creating a compelling collaborative augmented reality game. In: Proc. IUI 2000. Int. Conf. on Intelligent User Interfaces, pp. 256–259 (2000)
Fuchs, H., Livingston, M.A., Raskar, R., Colucci, D., Keller, K., State, A., Crawford, J.R., Radeacher, P., Drake, S.H., Meyer, A.: Augmented reality visualization for laparoscopic surgery. In: Proc. of the First Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 934–943 (1998)
Salisbury, K., Barbagli, F., Conti, F.: Haptic Rendering: Introductory Concepts. IEEE Computer Graphics and Applications 24(2), 24–32 (2004)
Fritz, J.P., Way, T.P., Barner, K.E.: Haptic Representation of Scientific Data for Visually Impaired or Blind Persons. In: Proc. Annual Technology and Persons with Disabilities Conference (1996)
Fritz, J.P., Barner, K.E.: Design of a Haptic Visualization System for People with Visual Impairments. IEEE Transactions on Rehabilitation Engineering 7(3), 372–384 (1999)
Suthakorn, J., Lee, S., Zhou, Y., Thomas, R., Choudhury, S., Chirikjian, G.S.: Comprehensive Access to Printed Materials. Proc. of IEEE ICRA 4, 3589–3594 (2002)
Yu, W., Guffie, K., Brewster, S.A.: Image to Haptic Data Conversion: A First Step to Improving Blind People’s Accessibility to Printed Graphs. In: Int. Conf. on Eurohaptics 2001, pp. 87–89 (2001)
Morris, D., Joshi, N.: Alternative Vision: A Haptic and Auditory Assistive Device. In: Proc. ACM SIGCHI Extended Abstracts, pp. 966–967. ACM Press, New York (2003)
Tan, H.Z., Gray, R., Young, J.J., Traylor, R.: A Haptic Back Display for Attentional and Directional Cueing. Haptics-e 3 (2003), http://www.haptics-e.org
van Erp, J., van Veen, H.: A Multi-purpose Tactile Vest for Astronauts in the International Space Station. In: Int. Conf. Eurohaptics 2003, pp. 405–408 (2003)
Tan, H.Z., Pentland, A.: Tactual Display for Wearable Computing. In: Proc. Symp. on Wearable Computers, pp. 84–89 (1997)
Yanagida, Y., Kakia, M., Lindeman, R.W., Kume, Y., Tetsutani, N.: Vibrotactile Letter Reading using a Low-Resolution Tactor Array. In: Proc. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 400–406 (2004)
Loomis, J.: Tactile letter recognition under different Modes of stimulus presentation. Perception & Psychophysics 16(2), 401–408 (1974)
Yanagida, Y., Kakita, M., Lindeman, R.W., Kume, Y., Tetsutani, N.: Vibrotactile Letter Reading Using a Low-Resolution Tactor Array. In: Proc. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 400–406 (2004)
Yang, U., Jang, Y., Kim, G.J.: Designing a Vibro-Tactile Wear for Colse Range Interaction for VR-based Motion Training In: ICAT 2002. Int. Conf. on Artificial Reality and Telexistence, pp. 4–9 (2002)
Lee, B.C., Lee, J., Cha, J., Seo, C., Ryu, J.: Immersive Live Sports Experience with Vibrotactile Sensation. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 1042–1045. Springer, Heidelberg (2005)
OpenGL|ES, http://www.zeuscmd.com/
ARToolkt Plus, http://studierstube.icg.tu-graz.ac.at/
Micro-controller, ATmega128, http://www.atmel.com
iPAQ hx 4700, PDA, http://www.hp.com
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, BC., Park, H., Lee, J., Ryu, J. (2007). Tactile Visualization with Mobile AR on a Handheld Device. In: Oakley, I., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2007. Lecture Notes in Computer Science, vol 4813. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76702-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-76702-2_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76701-5
Online ISBN: 978-3-540-76702-2
eBook Packages: Computer ScienceComputer Science (R0)