Skip to main content

Visual Servoing Control Based on Reconstructed 3D Features

  • Conference paper
  • First Online:
  • 2626 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11744))

Abstract

Image-based visual servoing (IBVS) is an automatic control technique which uses image information to control the camera moving to a desired location. To solve the problems of unsmooth trajectories and slow convergence rate caused by classical IBVS during the servo process, a visual servoing method based on reconstructed three-dimensional features is proposed. First, the camera pose was estimated, to obtain the depth information of the target by solving the Perspective-Four-Point (P4P) problem. Then, the new three-dimensional features for visual servoing is constructed. Finally, the visual servoing model is established based on classical IBVS control structure in terms of cuboid. Simulation results show that the proposes method has higher convergence speed and smoother convergence trajectories compared with the classical IBVS method.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Weiss, L.E., Sanderson, A.C., Neuman, C.P.: Dynamic sensor-based control of robots with visual feedback. IEEE J. Robot. Autom. 3(5), 404–417 (1987)

    Article  Google Scholar 

  2. Chaumette, F., Hutchinson, S., Corke, P.: Visual servoing. In: Khatib, O., Siciliano, B. (eds.) Handbook of Robotics, 2nd edn, pp. 841–866. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32552-1_34

    Chapter  Google Scholar 

  3. Chaumette, F.: Potential problems of stability and convergence in image-based and position-based visual servoing. In: Kriegman, D., Hager, G., Morse, A.S. (eds.) The Confluence of Vision and Control. LNCIS, vol. 237, pp. 66–78. Springer, London (1998). https://doi.org/10.1007/BFb0109663

    Chapter  Google Scholar 

  4. Malis, E., Chaumette, F., Boudet, S.: 2 1/2 D visual servoing. IEEE Trans. Robot. Autom. 15(2), 238–250 (1999)

    Article  Google Scholar 

  5. Chaumette, F.: Image moments: a general and useful set of features for visual servoing. IEEE Trans. Robot. Autom. 20(4), 713–723 (2004)

    Article  Google Scholar 

  6. Malis, E., Chaumette, F.: 2 1/2 D visual servoing with respect to unknown objects through a new estimation scheme of camera displacement. Int. J. Comput. Vis. 37(1), 79–97 (2000)

    Article  Google Scholar 

  7. Tahri, O., Chaumette, F.: Point-based and region-based image moments for visual servoing of planar objects. IEEE Trans. Robot. 21(6), 1116–1127 (2005)

    Article  Google Scholar 

  8. Liu, Y.-H., Wang, H., Chen, W., Zhou, D.: Adaptive visual servoing using common image features with unknown geometric parameters. Automatica 49(8), 2453–2460 (2013)

    Article  MathSciNet  Google Scholar 

  9. De, X., Jinyan, L., Wang, P., Zhang, Z., Liang, Z.: Partially decoupled image-based visual servoing using different sensitive features. IEEE Trans. Syst. Man Cybern. Syst. 47(8), 2233–2243 (2017)

    Article  Google Scholar 

  10. Shen, T., Chesi, G.: Visual servoing path-planning with spheres. In: 9th International Conference on Informatics in Control, Automation and Robotics, Italy, Rome, pp. 22–30 (2012)

    Google Scholar 

  11. Shen, T., Chesi, G.: Following a straight line in visual servoing with elliptical projections. In: 13th International Conference on Informatics in Control, Automation and Robotics, Lisbon, Portugal, pp. 47–56 (2016)

    Google Scholar 

  12. Shen, T., Chesi, G.: Visual servoing path-planning with elliptical projections. In: Andrade-Cetto, J., Felipe, J., Ferrier, J.-L. (eds.) Informatics in Control Automation and Robotics. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-55011-4_2

    Chapter  Google Scholar 

  13. Shen, T., Yang, J., Cai, Y., Li, D., Chesi, G.: Visual servoing with cylinders: reaching the desired location following a straight line. In: 2017 36th Chinese Control Conference (CCC), pp. 11183–11188. IEEE (2017)

    Google Scholar 

  14. Zhang, G., Jixiang, D., Wang, T.: Study on model-based visual servoing with reconstructed 2D features. J. Syst. Simul. 28(6), 1255–1260 (2016)

    Google Scholar 

  15. Shen, T., Chesi, G.: Visual servoing path-planning for cameras obeying the unified model. Adv. Robot. 26(8–9), 843–860 (2012)

    Google Scholar 

  16. Gao, X.-S., Hou, X.-R., Tang, J., Cheng, H.-F.: Complete solution classification for the perspective-three-point problem. IEEE Trans. Pattern Anal. Mach. Intell. 25(8), 930–943 (2003)

    Article  Google Scholar 

  17. Chaumette, F., Hutchinson, S.: Visual servo control, Part I: basic approaches. IEEE Robot. Autom. Mag. 13(4), 82–90 (2006)

    Article  Google Scholar 

  18. Tahri, O., Mezouar, Y., Chaumette, F., Araujo, H.: Visual servoing and pose estimation with cameras obeying the unified model. In: Chesi, G., Hashimotos, K. (eds.) Visual Servoing via Advanced Numerical Methods. Lecture Notes in Control and Information Sciences, vol. 401, pp. 231–252. Springer, Verlag (2010). https://doi.org/10.1007/978-1-84996-089-2_13

    Chapter  Google Scholar 

  19. Chaumette, F.: De la perception à l’action: l’asservissement visuel; de l’action à la perception: la vision active. Habilitation à diriger les recherches, Université de Rennes 1, January 1998

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China under Grant 2018YFB1309000 and by the National Natural Science Foundation of China under Grant 61803152.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Degang Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xu, D., Zhou, L., Lei, Y., Shen, T. (2019). Visual Servoing Control Based on Reconstructed 3D Features. In: Yu, H., Liu, J., Liu, L., Ju, Z., Liu, Y., Zhou, D. (eds) Intelligent Robotics and Applications. ICIRA 2019. Lecture Notes in Computer Science(), vol 11744. Springer, Cham. https://doi.org/10.1007/978-3-030-27541-9_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-27541-9_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-27540-2

  • Online ISBN: 978-3-030-27541-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics