Skip to main content
Springer Nature Link
Log in

Implementation of a following wheel robot featuring stereoscopic vision

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper describes how two cameras were used to implement stereoscopic visual imaging through a robot vision system. Image processing was applied to construct a real-time stereoscopic image tracking system for use in robots. The target object was sought by image preprocessing. The deviation of the target object from the optical center of the two cameras was measured to calculate the stereoscopic image depth of the target object, and the target object was instantly locked for real-time tracking. This system consists of two parts. The first part uses depth calculation to determine the distance between the target object and robot platform and applies image processing to simplify the image. The deviation angles of the left and right images are subsequently measured to calculate the target object distance. The second part uses real-time image tracking so that the platform can lock the image of the target object into an overlapping image. Proportional–integral–derivative (PID) feedback controls the robot movement and instantly obtains the target object and offset direction. The signal is exported to dc servo motors to drive the rotation of the two cameras and the movement of the platform. The image of the target object is locked in the image center of the stereoscopic visual system for real-time tracking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Ang K, Chong G, Li Y (2005) PID control system analysis, design, and technology. IEEE T Contr Syst 13(4):559–576

    Article  Google Scholar 

  2. Barnard ST, Thompson WB (1980) Disparity analysis of images. IEEE Trans Pattern Anal Mach Intell 2:330–340

    Google Scholar 

  3. Christensen HI (1993) A low-cost robot camera head. Int J Pattern Recognit Artif Intell 7(1):69–87

    Article  Google Scholar 

  4. Han SH, Seo W, Yoon K, Lee MH (1999) Real-time control of an industrial robot using image-based visual servoing. Proc 1999 IEEE/RSJ Int Conf Intell Robots Syst: 1762–1796

  5. Kase H, Maru N, Nishikawa A, Yamada S, Miyazaki F (1993) Visual servoing of the manipulator using the stereo vision. Proc 1993 IEEE/IECON Int Conf Indust: 1791–1796

  6. Li ZH (2010) The study and implementation of embedded image system to achieve the distance estimation. Master’s Thesis, Department of Computer Science, National Taipei University of Education

  7. Li MX (2011) Path tracking and obstacle avoidance for a wheeled mobile robot. Master’s Thesis, Department of Electrical Engineering, National Central University

  8. Liang P, Chang Y, Hackwood S (1989) Adaptive self-calibration of vision-based robot systems. IEEE Trans Syst, Man, Cybern 19(4):811–824

    Article  Google Scholar 

  9. Lu MC, Wang WY, Chu CY (2006) Image-based distance and area measuring systems. IEEE Sens J 6(2):495–503

    Article  Google Scholar 

  10. Okuyama Y (2007) PID control for nonlinear discretized systems. SICE Ann Conf: 116–119

  11. Ren YF (2008) The development of DSP-based real-time stereo vision system and application of movung object estimating. Master’s Thesis, Department of Mechanical Engineering, National Taiwan University of Science and Technology

  12. Shish SM, Tsai CC, Huang HC, Wang MY, Lee CC (2008) Autonomous navigation of an indoor tour guide robot. IEEE Int Conf Adv Robot Social Impacts: 23–25

  13. Tirumalai A, Schunck B, Jain R (1992) Dynamic stereo with self-calibration. IEEE Trans Pattern Anal Mach Intell 14:1184–1189

    Article  Google Scholar 

  14. Wei SH (2010) A study of people counting adjustment for multiple cameras with overlapped field of view. Master’s Thesis, Department of Computer Science and Engineering, Tatung University

  15. Wei LX, Wang X, Wang HR, Wang PG (2004) Adaptive backstepping fuzzy control for X-Y table with friction. Proc Third Int Conf Mach Learn Cybernet 2:683–686

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, National Taipei University of Education, Taipei, Taiwan

    Jia-Shing Sheu & Wei-Hsiu Tsai

Authors
  1. Jia-Shing Sheu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Wei-Hsiu Tsai
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Jia-Shing Sheu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sheu, JS., Tsai, WH. Implementation of a following wheel robot featuring stereoscopic vision. Multimed Tools Appl 76, 25161–25177 (2017). https://doi.org/10.1007/s11042-016-4297-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4297-y

Keywords