Skip to main content
SpringerLink
Log in

Virtual manipulator-based binocular stereo vision positioning system and errors modelling

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

There is a bottleneck of mobile robots positioning technologies for uncertain goals in complex field environment. Owing to the disturbance of the environment, the objects are hard to be located precisely by robot manipulator. Aiming at the positioning problem, binocular stereo vision system and positioning principle of the picking manipulator in virtual environment (VE) were proposed and expatiated upon; in addition, the manipulator positioning model was built in VE, and the manipulator positioning simulation system was developed by Microsoft Visual C++ 6.0; and the binocular stereo vision system platform with a three-coordinate guideway positioning was constructed for test; what’s more the error sources of vision positioning system was analyzed, and the camera system error was established; the mathematical model of experimental error and the camera calibration matching error were also found; with the developed robot manipulator positioning simulation software and vision system hardware, an experimental platform of positioning system was constructed, and using the platform, the stereo vision data was mapped to the manipulator and was guiding the accurate positioning in VE. Finally, experiment of positioning error compensation was carried out. Results of simulation in VE and the experiment showed that the vision positioning method was feasible for positioning in the field environment; it can be applied to control robot operation and to correct the positioning errors in real-time, especially to the long-range precision modelling and error compensation of robots.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Amir S., Eran K., Amnon D. et al.: Toward elevated agrobotics: development of a scaled-down prototype for visually guided date palm tree sprayer. J. Field Robot. 26(6–7), 572–590 (2009) (ISSN:15564959)

    Google Scholar 

  2. Cheng X.N.: The Path Optimization Control of Robotic Arm Based on the Visual Feedback [D]. Zhejiang University, Hangzhou (2007)

    Google Scholar 

  3. Chen D.R.: Research on Key Technology of the Structure of Robot with Six DOF [D]. Harbin Engineering University, Harbin (2006)

    Google Scholar 

  4. Dai P.: Vision based control schemes of robotic manipulators. J. Cent. South Inst. Min. Metall. 25(6), 747–751 (1996) (ISSN: 1672–7207)

    Google Scholar 

  5. Dongseok, R., Chang-Soon, H., et al.: Wearable haptic-based multi-modal teleoperation of field mobile manipulator for explosive ordnance disposal. In: Proceeding of 2005 IEEE International Workshop on Safety, Security and Rescue Robots, pp 75–80, ISBN-10:07803 8945 X, Kobe Japan, June 2005, IEEE, Piscataway, NJ, USA (2005)

  6. Van Henten E.J., Van Tuij B.A.J. et al.: An autonomous robot for de-leafing cucumber plants grown in a high-wire cultivation system. Biosyst. Eng. 94(3), 317–323 (2006) (ISSN: 15375110)

    Article  Google Scholar 

  7. Gao H.W., Wu C.D., Li B., Zhang G.W.: Research of plane localization for virtual robot arm based on stereo vision. J. Syst. Simul. 19(14), 3245–3247 (2007) (ISSN:1004- 731X)

    Google Scholar 

  8. Trevelyan J., Kang S., Hamel W.: Robotics in hazardous applications. In: Siciliano, B., Khatib, O. (eds) Springer Handbook of Robotics, pp. 1101–1126. Springer, Berlin (2008) [ISBN:978-3-540-23957-4 (Print) 978-3-540-30301-5 (Online), Netherlands]

    Chapter  Google Scholar 

  9. Xiong, J.T., Zou, X.J., Zou, H.X., et al.: Research of positioning system for virtual manipulator based on visual error compensation. In: 2009 2nd International Conference on Power Electronics and Intelligent Transportation System (PEITS 2009), pp. 316–319, ISBN-13:978-1-4244-4544-8, Shenzhen, China, Dec. 2009, IEEE, Piscataway, NJ, USA (2009)

  10. Lu J.: The Association Positioning of Picking-machine and Vision based on Virtual Design [D]. South China Agriculature University, Guangzhou (2009)

    Google Scholar 

  11. Van Willigenburg L.G. et al.: On-line near minimum-time path planning and control of an industrial robot for picking fruits. Comput. Electron. Agric. 44(3), 223–237 (2004) (ISSN:0168– 1699)

    Article  Google Scholar 

  12. Bajracharya M., DiCicco M., Backes P., Nickels K.: Visual end-effector position error compensation for planetary robotics. J. Field Robot. 24(5), 399–420 (2007) (ISSN:15564959)

    Article  Google Scholar 

  13. Muscato G., Prestifilippo M. et al.: A prototype of an orange picking robot: past history, the new robot and experimental results. Indust. Robot 32(2), 128–138 (2005)

    Article  Google Scholar 

  14. Neagoe M., Gogu G., Diaconescu D.: High degree accuracy modelling and calibration of serial robots with large errors. In: Talabă, D., Roche, T. (eds) Product Engineering, pp. 397–408. Springer, Netherlands (2004) [ISBN:978-1-4020-2932-5 (Print) 978-1-4020-2933-2 (Online)]

    Google Scholar 

  15. Jain R., Schunck B.G., Kasturi R.: Machine Vision. China Machine Press, China (2003) (ISBN:7-111-12643-2)

    Google Scholar 

  16. Scarfe, A.J., Flemmer, R.C., et al.: Development of an Autonomous Kiwifruit Picking Robot. In: 2009 4th International Conference on Autonomous Robots and Agents, pp. 380–384 (2009)

  17. Hayashi S., Ganno K., Ishii Y. et al.: Robotic Harvesting System for Eggplants. JATQ, 2002(36(3), 163–168 (2002) (ISSN:0021-3551)

    Google Scholar 

  18. Song J., Sun X.Y. et al.: Design and experiment of opening picking robot for eggplant. Nongye Jixie Xuebao/Trans. Chin. Soc. Agricult. Mach. 40(1), 143–147 (2009)

    Google Scholar 

  19. Barnard S.T., Fischler M.A.: Computational stereo. ACM Comput. Surv. 14(4), 553–572 (1982) (ISSN:0360-0300)

    Article  Google Scholar 

  20. Cho S.I. et al.: An development of a three-degrees-of-freedom robot for harvesting lettuce using machine vision and fuzzy logic control. Biosyst. Eng. 82(2), 143–149 (2002) (ISSN:1537-5110)

    Article  Google Scholar 

  21. Pedersen S.M., Fountas S., Have H., Blackmore B.S.: Agricultural robots—system analysis and economic feasibility. precision agriculture 7(4), 295–308 (2006) [ISSN:1385-2256 (Print) 1573-1618 (Online)]

    Article  Google Scholar 

  22. Bräunl T.: Embedded robotics: mobile robot design and applications with embedded systems. Springer, Berlin (2008) (ISBN:978-3-540-70533-8)

    MATH  Google Scholar 

  23. Wang H.J, Zou X.J, Zou D.J. et al.: Study on location simulation for picking manipulator in virtual environment based on information fusion of multi-sensor. Key Eng. Mater. 392(394), 596–600 (2009) (ISSN:1013-9826)

    Article  Google Scholar 

  24. Wang, H.J., Zou, X.J., Chen, J.X., et al.: Structure design and multi-domain modeling for a picking banana manipulator. In: 2009 International Conference on Manufacturing Science and Engineering, ICMSE 2009, pp. 3560–3564, ISSN:10226680, Zhuhai, China, Dec. 2009, Trans Tech Publications, P.O. Box 1254, Clausthal-Zellerfeld, D-38670, Germany (2009)

  25. Xu F., Zhang L.B., Ji S.M. et al.: Advances in realization and application of vision sensing system of agricultural robot. Trans. Chin. Soc. Agricult. Eng. 18(4), 180–184 (2002)

    Google Scholar 

  26. Zou X.J., Zou H.X., Lu J. et al.: Research on manipulator positioning based on stereo vision in virtual environment. Key Eng. Mater. 392(−394), 200–204 (2009) (ISSN:1013-9826)

    Article  Google Scholar 

  27. Zou X.J., Luo X.W., Lu J. et al.: Modelling for behavior and simulation of agriculture mobile robot in virtual environment. J. Syst. Simul. 18(2), 551–554 (2006) (ISSN:1004-731X.0.2006-S2-157)

    Google Scholar 

  28. Zou, X.J., Lu, J., et al.: Experimental Platform of Machine and Vision Corelation Positioning [P]. China: ZL200810027369.6, 2008-09-17

  29. Xiong, Y.L.: Basic Robot Technology. Huazhong University of Science and Technology Press (1996) ISBN: 756091305, China

  30. Qian, Z., Wang, Y.Z., Liu, G.L.: Measurement Error Analysis and Data Processing. Beijing University of Aeronautics and Astronautics Press (2008) ISBN:7811242997, China

  31. Zhang T.Z., Lin B.L., Gao R.: Object extraction for the vision system of fruit picking robot. J. China Agricult. Univ. 9(2), 68–72 (2004)

    Google Scholar 

  32. Zhang T.Z., Xu L.M.: Great prospects of vegetable automatic grafting robot technology. Robot Tech. Appl. 2, 14–15 (2001)

    Google Scholar 

  33. Zheng J.: Object location and motion analysis based on two-camera visual system [D]. Yanshan University, Qinhuang (2006)

    Google Scholar 

  34. Zhu Q.: Research and Application on Binocular Vision System of the Mobile Robot [D]. Harbin Engineering University, Harbin (2007)

    Google Scholar 

  35. Zou, H.X., Zou, X.J., Chen, Y.L., et al.: Real-time simulation system of virtual picking manipulator based on parametric design. In: Proceedings of Intelligent Robotics and Applications—Second International Conference, ICIRA 2009, pp. 1205–1210, ISSN:03029743, Singapore, Singapore, (2009), Springer, Tiergartenstrasse 17, Heidelberg, 69121, Germany

  36. Zou, H.X., Zou, X.J., Chen, Y.L., et al.: Research on virtual design and simulation system for manipulators of multi-degree of freedom. In: 2009 International Conference on Manufacturing Science and Engineering, ICMSE 2009, pp. 3475–3478, ISSN:10226680, Zhuhai, China, (2009), Trans Tech Publications, P.O. Box 1254, Clausthal-Zellerfeld, D-38670, Germany

  37. Zou, X.J., Lu, J., Luo, X.W. et al.: Extracting behavior knowledge and modeling based on virtual agricultural mobile robot. Advances in Artificial Reality and Tele-Existence. In: 16th International Conference. Proceedings, pp. 28–37, ISBN-10:3 540 49776 5, Hangzhou, China, (2006) © Springer, Berlin

  38. Zou X.J., Jin S., Chen Y. et al.: Modelica-based modeling research of picking manipulator motion control process. J. Simul. Syst. 21(18), 5882–5885 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Key Laboratory of Key Technology on Agricultural Machine and Equipment, South China Agricultural University, Ministry of Education, Guangzhou, China

    Xiangjun Zou, Haixin Zou & Jun Lu

Authors
  1. Xiangjun Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haixin Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiangjun Zou.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zou, X., Zou, H. & Lu, J. Virtual manipulator-based binocular stereo vision positioning system and errors modelling. Machine Vision and Applications 23, 43–63 (2012). https://doi.org/10.1007/s00138-010-0291-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-010-0291-y

Keywords

Search

Navigation