Skip to main content
SpringerLink
Log in

Tactile Visualization with Mobile AR on a Handheld Device

  • Conference paper
Book cover Haptic and Audio Interaction Design (HAID 2007)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4813))

Included in the following conference series:

Abstract

This paper presents a tactile visualization system incorporating touch feedback to a mobile AR system realized on a handheld device. This system enables, for the first time, interactive haptic feedback though mobile and wearable interfaces. To demonstrate the proposed concept, an interactive scenario that helps a visually impaired user to recognize specific pictograms has been constructed. This system allows users to tactually recognize flat pictograms situated in the real world. Furthermore, it also opens the door to a wide range of applications which could be based on wearable tactile interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., Pentland, A.: Augmented Reality through Wearable Computing. Presence 6(4), 386–398 (1997)

    Google Scholar 

  2. Feiner, S., MacIntyre, B., Hoellerer, T.: Wearing it out: First steps toward mobile augmented reality systems. In: Proc. ISMR 1999. Int. Symp. on Mixed Reality, pp. 363–377 (1999)

    Google Scholar 

  3. Sato, K., Ban, Y., Chihara, K.: MR Aided Engineering: Inspection Support Systems Integrating Virtual Instruments and Process Control. In: Mixed Reality, pp. 347–362 (1999)

    Google Scholar 

  4. McGarrity, E., Genc, Y., Tuceryan, M., Owen, C., Navab, N.: Taking ar into large scale industrial environments: Navigation and information access with mobile computers. In: Proc. ISAR 2001. IEEE and ACM Int. Symp. on Augmented Reality, pp. 179–180. IEEE Computer Society Press, Los Alamitos (2001)

    Google Scholar 

  5. Klinker, G., Creighton, O., Dutoit, A.H., Kobylinski, R., Vilsmeier, C., Brügge, B.: Augmented maintenance of powerplants: a prototyping case study of a mobile AR system. In: Proc. ISAR 2001. IEEE and ACM Int. Symp. on Augmented Reality, pp. 124–133. IEEE Computer Society Press, Los Alamitos (2001)

    Google Scholar 

  6. Loomis, J., Golledge, R., Klatzky, R.: Personal Guidance System for the Visually Impaired Using GPS, GIS, and VR technologies. In: Proc. of Conf. on Virtual Reality System and Persons with Disabilities (1993)

    Google Scholar 

  7. Petrie, H., Johnson, V., Strothotte, T., Fritz, S., Michel, R., Raab, A.: MoBIC: Designing a Travel Aid for Blind and Elderly People. Journal of Navigation 49(1), 45–52 (1996)

    Article  Google Scholar 

  8. Furmanski, C., Azuma, R., Daily, M.: Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information. In: Proc. ISMAR 2002. IEEE and ACM Int. Symp. on Mixed and Augmented Reality, pp. 215–224. IEEE Computer Society Press, Los Alamitos (2002)

    Google Scholar 

  9. Feiner, S., MacIntyre, B., Hollerer, T., Webster, A.: A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In: Proc. of the First IEEE Int. Symp. on Wearable Computers, pp. 74–81. IEEE Computer Society Press, Los Alamitos (1997)

    Chapter  Google Scholar 

  10. Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. In: Proc. of ACM CHI 2000, ACM Press, New York (2000)

    Google Scholar 

  11. Fenier, S.: Augmented Reality: A New Way of Seeing. Scientific American 286(4), 48–55 (2002)

    Article  Google Scholar 

  12. Hollerer, T., Pavlik, J.V., Feiner, S.: Situated documentaries: Embedding multimedia presentations in the real world. In: Proc. of The Third Int. Symp. on Wearable Computers, pp. 79–86 (1999)

    Google Scholar 

  13. Vlahakis, V., Ioannidis, N., Karigiannis, J., Tsotros, M., Gounaris, M., Stricker, D., Gleue, T., Daehne, P., Almeida, L.: Archeoguide: An Augmented Reality Guide for Archaeological Sites. IEEE Computer Graphics and Applications 22(5), 52–60 (2002)

    Article  Google Scholar 

  14. Rekimoto, J., Ayatsuka, Y., Hayashi, K.: Augment-able reality: Situated communication through physical and digital spaces. In: Proc. ISWC 1998. Second Int. Symp. on Wearable Computers, pp. 68–75 (1998)

    Google Scholar 

  15. Baillot, Y., Brown, D., Julier, S.: Authoring of physical models using mobile computers. In: Proc. ISWC 2001. Fifth IEEE Int. Symp. on Wearable Computers, pp. 39–46. IEEE Computer Society Press, Los Alamitos (2001)

    Google Scholar 

  16. Piekarski, W., Thomas,B.: Tinmith-Metro: New outdoor techniques for creating city 16models with an augmented reality wearable computer. In: Proc. ISWC 2001. Fifth IEEE Int. Symp. on Wearable Computers, pp. 31-38, 2001.

    Google Scholar 

  17. Thomas, B., Close, B., Donoghue, J., Squires, J., De Bondi, P., Morris, M., Piekarski, W.: ARQuake: An outdoor/indoor augmented reality first person application. In: ISWC 2000. Fourth Int. Symp. on Wearable Computers, pp. 139–146 (2000)

    Google Scholar 

  18. Starner, T., Leibe, B., Singletary, B., Pair, J.: MIND-WARPING: towards creating a compelling collaborative augmented reality game. In: Proc. IUI 2000. Int. Conf. on Intelligent User Interfaces, pp. 256–259 (2000)

    Google Scholar 

  19. Fuchs, H., Livingston, M.A., Raskar, R., Colucci, D., Keller, K., State, A., Crawford, J.R., Radeacher, P., Drake, S.H., Meyer, A.: Augmented reality visualization for laparoscopic surgery. In: Proc. of the First Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 934–943 (1998)

    Google Scholar 

  20. Salisbury, K., Barbagli, F., Conti, F.: Haptic Rendering: Introductory Concepts. IEEE Computer Graphics and Applications 24(2), 24–32 (2004)

    Article  Google Scholar 

  21. Fritz, J.P., Way, T.P., Barner, K.E.: Haptic Representation of Scientific Data for Visually Impaired or Blind Persons. In: Proc. Annual Technology and Persons with Disabilities Conference (1996)

    Google Scholar 

  22. Fritz, J.P., Barner, K.E.: Design of a Haptic Visualization System for People with Visual Impairments. IEEE Transactions on Rehabilitation Engineering 7(3), 372–384 (1999)

    Article  Google Scholar 

  23. Suthakorn, J., Lee, S., Zhou, Y., Thomas, R., Choudhury, S., Chirikjian, G.S.: Comprehensive Access to Printed Materials. Proc. of IEEE ICRA 4, 3589–3594 (2002)

    Google Scholar 

  24. Yu, W., Guffie, K., Brewster, S.A.: Image to Haptic Data Conversion: A First Step to Improving Blind People’s Accessibility to Printed Graphs. In: Int. Conf. on Eurohaptics 2001, pp. 87–89 (2001)

    Google Scholar 

  25. Morris, D., Joshi, N.: Alternative Vision: A Haptic and Auditory Assistive Device. In: Proc. ACM SIGCHI Extended Abstracts, pp. 966–967. ACM Press, New York (2003)

    Google Scholar 

  26. Tan, H.Z., Gray, R., Young, J.J., Traylor, R.: A Haptic Back Display for Attentional and Directional Cueing. Haptics-e 3 (2003), http://www.haptics-e.org

  27. van Erp, J., van Veen, H.: A Multi-purpose Tactile Vest for Astronauts in the International Space Station. In: Int. Conf. Eurohaptics 2003, pp. 405–408 (2003)

    Google Scholar 

  28. Tan, H.Z., Pentland, A.: Tactual Display for Wearable Computing. In: Proc. Symp. on Wearable Computers, pp. 84–89 (1997)

    Google Scholar 

  29. Yanagida, Y., Kakia, M., Lindeman, R.W., Kume, Y., Tetsutani, N.: Vibrotactile Letter Reading using a Low-Resolution Tactor Array. In: Proc. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 400–406 (2004)

    Google Scholar 

  30. Loomis, J.: Tactile letter recognition under different Modes of stimulus presentation. Perception & Psychophysics 16(2), 401–408 (1974)

    Google Scholar 

  31. Yanagida, Y., Kakita, M., Lindeman, R.W., Kume, Y., Tetsutani, N.: Vibrotactile Letter Reading Using a Low-Resolution Tactor Array. In: Proc. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 400–406 (2004)

    Google Scholar 

  32. Yang, U., Jang, Y., Kim, G.J.: Designing a Vibro-Tactile Wear for Colse Range Interaction for VR-based Motion Training In: ICAT 2002. Int. Conf. on Artificial Reality and Telexistence, pp. 4–9 (2002)

    Google Scholar 

  33. Lee, B.C., Lee, J., Cha, J., Seo, C., Ryu, J.: Immersive Live Sports Experience with Vibrotactile Sensation. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 1042–1045. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  34. OpenGL|ES, http://www.zeuscmd.com/

  35. ARToolkt Plus, http://studierstube.icg.tu-graz.ac.at/

  36. Micro-controller, ATmega128, http://www.atmel.com

  37. iPAQ hx 4700, PDA, http://www.hp.com

Download references

Author information

Authors and Affiliations

  1. Human-Machine-Computer Interface Lab., Dept. Mechatronics, Gwangju Institute of Science and Technology, Gwangju, Korea

    Beom-Chan Lee, Hyeshin Park, Junhun Lee & Jeha Ryu

Authors
  1. Beom-Chan Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyeshin Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junhun Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeha Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Ian Oakley Stephen Brewster

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lee, BC., Park, H., Lee, J., Ryu, J. (2007). Tactile Visualization with Mobile AR on a Handheld Device. In: Oakley, I., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2007. Lecture Notes in Computer Science, vol 4813. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76702-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-76702-2_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76701-5

  • Online ISBN: 978-3-540-76702-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation