Skip to main content

Fusion of Vision and Inertial Sensors for Position-Based Visual Servoing of a Robot Manipulator

  • Conference paper
  • 3475 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7995))

Abstract

This paper presents a new technique to combine measurements from both a vision system and an inertial sensor mounted on a robot tip when the robot moves towards an object. The proposed scheme is designed based on a combination of the relative pose (position and orientation) of vision system with information of the inertial sensor (acceleration and angular velocity) to get final relative pose. In addition, a Kalman filter is used to handle asynchronous information from those sensors. The proposed scheme not only can increase the robustness of the pose estimation but also can smooth the velocity control of robot. A computer simulation results are shown to verify the effectiveness of the proposed algorithm.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Corke, P., Lobo, J., Dias, J.: An Introduction to Inertial and Visual Sensing. The International Journal of Robotics Research 26, 519 (2007)

    Article  Google Scholar 

  2. Chaumette, F., Hutchinson, S.: Visual Servo Control. Part I: Basic Approaches. IEEE Robotics & Automation Magazine (December 2006)

    Google Scholar 

  3. Wilson, W.J., Hulls, C.W., Bell, G.S.: Relative End-Effector Control Using Cartesian Position Based Visual Servoing. IEEE Transactions on Robotics and Automation 12(5) (October 1996)

    Google Scholar 

  4. Janabi-Sharifi, F.V., Marey, M.: A Kalman-Filter-Based Method for Pose Estimation in Visual Servoing. IEEE Transactions on Robotics 26(5) (October 2010)

    Google Scholar 

  5. Kragic, D., Christensen, H.I.: Measurement Errors in Visual Servoing. In: International Conference on Robotics & Automation (April 2004)

    Google Scholar 

  6. Deng, L., Wilson, W.J., Janabi-Sharifi, F.: Characteristics of Robot Visual Servoing Methods And Target Model Estimation. In: Proceedings of the 2002 IEEE International Symposium on Intelligent Control, Vancouver, Canada (2002)

    Google Scholar 

  7. Comport, A., Pressigout, M., Marchand, E., Chaumette, F.: A visual servoing control law that is robust to image outliers. In: Proceedings of the 2003 IEEE/RSJ Conference on Intelligent Robots and Systems, Las Vegas (2003)

    Google Scholar 

  8. Gans, N.R., Hutchinson, S.A.: An Asymptotically Stable Switched System Visual Controller for Eye in Hand Robots. In: Proceedings of the 2003 IEEE/RSJ Conference on Intelligent Robots and Systems, Las Vegas (2003)

    Google Scholar 

  9. Suh, Y.S.: Orientation Estimation Using a Quaternion-Based Indirect Kalman Filter with Adaptive Estimation of External Acceleration. IEEE Transactions on Instrumentation and Measurement 59(12) (2010)

    Google Scholar 

  10. Nguyen, H.Q.P., Kang, H.J., Suh, Y.S., Ro, Y.S.: A Visual-Inertial Servoing Method for Tracking Object with Two Landmarks and an Inertial Measurement Unit. International Journal of Control, Automation and System 19(2), 317–327 (2011)

    Article  Google Scholar 

  11. Nguyen, H.Q.P., Kang, H.J., Suh, Y.S., Elle, O.J.: A Platform Stabilization Algorithm Based on Feed-forward Visual-Inertial Servoing. International Journal of Precision Engineering and Manufacturing 13(4), 517–526 (2012)

    Article  Google Scholar 

  12. Craig, J.J.: Introduction to Robotics Mechanics and Control, 3rd edn.

    Google Scholar 

  13. Chai, L., Hoff, W.A., Vincent, T.: 3-D Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented Reality

    Google Scholar 

  14. Armesto, L., Chroust, S., Vincze, M., Tornero, J.: Multi-rate Fusion with Vision And Inertial Sensors. In: International Conference on Robotics & Automation (2004)

    Google Scholar 

  15. Rebbinder, H., Ghosh, B.: Multi-rate Fusion with Vision And Inertial Data. In: International Conference on Multi-Sensor Fusion and Integration for Intelligent Systems (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Duc, T.M., Kang, HJ. (2013). Fusion of Vision and Inertial Sensors for Position-Based Visual Servoing of a Robot Manipulator. In: Huang, DS., Bevilacqua, V., Figueroa, J.C., Premaratne, P. (eds) Intelligent Computing Theories. ICIC 2013. Lecture Notes in Computer Science, vol 7995. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39479-9_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-39479-9_63

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-39478-2

  • Online ISBN: 978-3-642-39479-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics