Skip to main content

Mobile Magic Hand:Camera Phone Based Interaction Using Visual Code and Optical Flow

  • Conference paper
Human-Computer Interaction. Interaction Platforms and Techniques (HCI 2007)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4551))

Included in the following conference series:

  • 3463 Accesses

Abstract

We propose the “Mobile Magic Hand” interface; it is an extension of our previous visual code-based interface system. Once the user acquires the visual code of interest, the user can then manipulate the related virtual object/system without having to keep the camera centered on the visual code. Our new interface does this analyzing the optical flow as captured by the camera. For example, consider a visual code that represents a 3D object, such as a dial. After selecting the code, the user can freely rotate and/or move the virtual object without having to keep the camera pointed at the code. This interface is much more user friendly and is more intuitive since the user’s hand gestures can be more relaxed, more natural, and more extensive. In this paper, we describe “Mobile Magic Hand” , some applications, and a preliminary user study of a prototype system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hansen, T.R., Eriksson, E., Lykke-Olesen, A.: Mixed Interaction Space - Expanding the Interaction Space with Mobile Devices. In: People and Computers XIX - The Bigger Picture, Proceedings of British HCI, Springer, Heidelberg (2005)

    Google Scholar 

  2. Rohs, M., Zweifel, P.A.: Conceptual Framework for Camera Phone-based Interaction Techniques. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 171–189. Springer, Heidelberg (2005)

    Google Scholar 

  3. Yoshida, Y., Satou, T., Miyaoku, K., Higashino, S.: Reacher Interface for Intuitive Information Navigation. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 1091–1095. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  4. Rekimoto, J., Nagao, K.: The world through the computer:Computer augmented interaction with real world environments. In: Proceedings of the 8th annual ACM symposium on User interface software and technology, pp. 29–36 (1995)

    Google Scholar 

  5. Lucas, B.D., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision. In: International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)

    Google Scholar 

  6. Wigdor, D., Balakrishnan, R.: TiltText: using tilt for text input to mobile phones. In: Proceedings of the 16th annual ACM symposium on User interface software and technology, pp. 81–90 (2003)

    Google Scholar 

  7. Siio, I., Masui, T., Fukuchi, K.: Real-world interaction using the FieldMouse. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 113–119 (1999)

    Google Scholar 

  8. Wang, J., Canny, J.: TinyMotion: Camera Phone Based Interaction Methods. In: Conference on Human Factors in Computing Systems CHI 2006, extended abstracts on Human factors in computing systems, pp. 339–344 (2006)

    Google Scholar 

  9. QRCode, http://www.qrcode.com/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Julie A. Jacko

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yoshida, Y., Miyaoku, K., Satou, T. (2007). Mobile Magic Hand:Camera Phone Based Interaction Using Visual Code and Optical Flow. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Platforms and Techniques. HCI 2007. Lecture Notes in Computer Science, vol 4551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73107-8_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73107-8_58

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73106-1

  • Online ISBN: 978-3-540-73107-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics