Skip to main content

FingerMouse – A Button Size Visual Hand Tracking and Segmentation Device

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3894))

Abstract

In this paper, we present a button-sized (43mm×18mm) visual input system for wearable computers, the FingerMouse. It is a fully integrated camera and vision processing system, with a specifically designed ASIC computing images at 20GOp/s consuming 78mW. Worn on the body, it captures the user’s hand and processes in real-time its coordinates as well as a 1-bit image of the hand segmented from the background. This paper describes the architecture of the FingerMouse and compares it to other implementations.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Starner, T., Weaver, J., Pentland, A.: A wearable computer based american sign language recognizer. In: First International Symposium on Wearable Computers (Digest of Papers, 1997)

    Google Scholar 

  2. Crowley, J.L., Coutaz, J., Bérard, F.: Perceptual user interfaces: things that see. Commun. ACM 43(3), 54 (2000)

    Article  Google Scholar 

  3. Card, S.K., Newell, A., Moran, T.P.: The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Inc., Mahwah (1983)

    Google Scholar 

  4. Habili, N., Lim, C.C., Moini, A.: Segmentation of the face and hands in sign language video sequences using color and motion cues. IEEE Transactions on Circuits and Systems for Video Technology (2004)

    Google Scholar 

  5. Gandy, M., Starner, T., Auxier, J., Ashbrook, D.: The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In: ISWC 2000: Proceedings of the 4th IEEE International Symposium on Wearable Computers, Washington, DC, USA, p. 87. IEEE Computer Society Press, Los Alamitos (2000)

    Google Scholar 

  6. de la Hamette, P., von Waldkirch, M., Tröster, G.: Laser triangulation as a means of robust visual input for wearable computers. In: ISWC 2004, pp. 18–20. IEEE Computer Society, Los Alamitos (2004)

    Google Scholar 

  7. Blake, A., Isard, M.: Active Contours, 1st edn. Springer, Heidelberg (1998)

    Book  Google Scholar 

  8. Grewal, M.S., Andrews, A.S.: Kalman Filtering: Theory and Practice. Prentice-Hall, Englewood Cliffs (1993)

    MATH  Google Scholar 

  9. Blake, A., Curwen, R., Andrew, Z.: A framework for spatio-temporal control in the tracking of visual contours. International Journal of Computer Vision (1993)

    Google Scholar 

  10. de la Hamette, P., Lukowicz, P., Tröster, G., Svoboda, T.: Fingermouse: A wearable hand tracking system. In: Adjunct Proceedings of the 4th International Conference on Ubiquitous Computing (2002)

    Google Scholar 

  11. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)

    Book  MATH  Google Scholar 

  12. Faugeras, O.: Three-dimensional computer vision: a geometric viewpoint, 3rd edn. MIT Press, Cambridge (1999)

    Google Scholar 

  13. Egnal, G., Wildes, R.P.: Detecting binocular half-occlusions: empirical comparisons of five approaches. IEEE Transactions on Pattern Analysis and Machine Intelligence (2002)

    Google Scholar 

  14. Porter, R.B., Bergmann, N.W.: A generic implementation framework for fpga based stereo matching. IEEE TENCON (1997)

    Google Scholar 

  15. Woodfill, J., Herzen, B.V.: Real-time stereo vision on the parts reconfigurable computer. In: The 5th Annual IEEE Symposium on FPGAs for Custom Computing Machines (1997)

    Google Scholar 

  16. Corke, P., Dunn, P.: Frame-rate stereopsis using non-parametric transforms and programmable logic. In: IEEE International Conference on Robotics and Automation (1999)

    Google Scholar 

  17. Kanade, T., Yoshida, A., Oda, K., Kano, H., Tanaka, M.: A stereo machine for video-rate dense depth mapping and its new applications. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1996)

    Google Scholar 

  18. Konolige, K.: Small vision systems: Hardware and implementation. In: Eighth International Symposium on Robotics (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

de la Hamette, P., Tröster, G. (2006). FingerMouse – A Button Size Visual Hand Tracking and Segmentation Device. In: Grass, W., Sick, B., Waldschmidt, K. (eds) Architecture of Computing Systems - ARCS 2006. ARCS 2006. Lecture Notes in Computer Science, vol 3894. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11682127_3

Download citation

  • DOI: https://doi.org/10.1007/11682127_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-32765-3

  • Online ISBN: 978-3-540-32766-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics