Skip to main content

A Real-Time Vision-Based Framework for Human-Robot Interaction

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7066))

Abstract

Building human-friendly robots which are able to interact and cooperate with humans has been an active research field in recent years. A major challenge in this field is to develop robots that can interact and cooperate with humans by understanding human communication modalities. Nonetheless, human face is a dynamic object and has a high degree of variability in its appearance, which makes face detection a difficult problem. In this paper, we present a real-time vision-based framework to detect human face and analysis of the human face direction in window area to interact with robot. A cascade of feature detectors trained with boosting technique has been employed. Experimental results using servo motors connect to SD21 and PIC16F887A microcontroller; and the MIABOT Pro have validated our approach. Our future work is to build an intelligent wheelchair whose motion can be controlled by the user’s face direction.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barth, A., Herpers, R.: Robust Head Detection and Tracking in Cluttered Workshop Environments using GMM. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 442–450. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  2. Yang, J., Waibel, A.: A real-time face tracker. In: Proceedings of WACV 1996 (1996)

    Google Scholar 

  3. Bakx, I., van Turnhout, K., Terken, J.: Facial orientation during multi-party interaction with information kiosks. In: Proceedings of the Interact 2003 (2003)

    Google Scholar 

  4. Kubota, N., Shimomura, Y.: Human-friendly networked partner robots toward sophisticated services for a community. In: Proceedings of the SICE-ICASE International Joint Conference, pp. 4861–4866 (2006)

    Google Scholar 

  5. Li, F.-F., Fergus, R., Perona, P.: One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 594–611 (2006)

    Article  Google Scholar 

  6. Liu, C.: A bayesian discriminating features method for face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 725–740 (2003)

    Article  Google Scholar 

  7. Matsumoto, Y., Heinzmann, J., Zelinsky, A.: The essential components of human-friendly robot systems. In: International Conference on Field and Service Robotics, pp. 43–51 (1999)

    Google Scholar 

  8. Oliver, N., Pentland, A., Brard, F.: Lafter: A real-time face and lips tracker with facial expression recognition. Pattern Recognition 33, 1369–1382 (2000)

    Article  Google Scholar 

  9. Sakai, T., Nagao, M., Kanade, T.: Computer analysis and classification of photographs of human faces. In: Proc. First USA-JAPAN Computer Conference, pp. 55–62 (1972)

    Google Scholar 

  10. Viola, P., Jones, M.: Robust real-time face detection. International Journal Computer Vision 57(2), 137–154 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lam, M.C., Prabuwono, A.S., Arshad, H., Chan, C.S. (2011). A Real-Time Vision-Based Framework for Human-Robot Interaction. In: Badioze Zaman, H., et al. Visual Informatics: Sustaining Research and Innovations. IVIC 2011. Lecture Notes in Computer Science, vol 7066. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25191-7_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25191-7_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25190-0

  • Online ISBN: 978-3-642-25191-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics