Skip to main content
Log in

Towards semi-autonomous operation of under-actuated underwater vehicles: sensor fusion, on-line identification and visual servo control

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

In this paper we propose a framework for semi-autonomous operation of an under-actuated underwater vehicle. The contributions of this paper are twofold: The first contribution is a visual servoing control scheme that is designed to provide a human operator the capability to steer the vehicle without loosing the target from the vision system’s field of view. It is shown that the under-actuated degree of freedom is input-to-state stable (ISS) and a shaping of the user input with stability guarantees is implemented. The resulting control scheme has formally guaranteed stability and convergence properties. The second contribution is an asynchronous Modified Dual Unscented Kalman Filter (MDUKF) for the on-line state and parameter estimation of the vehicle by fusing data from a Laser Vision System (LVS) and an Inertial Measurement Unit (IMU). The MDUKF has been developed in order to experimentally verify the performance of the proposed visual servoing control scheme.

Experimental results of the visual servoing control scheme integrated with the asynchronous MDUKF indicate the feasibility and applicability of the proposed control scheme. Experiments have been carried out on a small under-actuated Remotely Operated Vehicle (ROV) in a test tank.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aicardi, M., Casalino, G., Bicchi, A., & Balestrino, A. (1995). Steering of unicycle-like vehicles via Lyapunov techniques. IEEE Robotics and Automation Magazine, 27–35.

  • Armesto, L., Chroust, S., Vincze, M., & Tornero, J. (2004). Multi-rate fusion with vision and inertial sensors. In Proceedings of IEEE conference on robotics and automation (pp. 193–199).

    Google Scholar 

  • Astolfi, A. (1995). Exponential stabilization of nonholonomic systems via discontinuous control. In Proceedings of IFAC symposium on nonlinear control system design.

    Google Scholar 

  • Bhattacharya, S., Murrieta, R., & Hutchinson, S. (2007). Optimal paths for landmark-based navigation by differential-drive vehicles with field-of-view constraints. IEEE Transactions on Robotics, 47–59.

  • Caccia, M., Indiveri, G., & Veruggio, G. (2000). Modeling and identification of open frame variable configuration unmanned underwater vehicles. IEEE Journal of Oceanic Engineering, 227–240.

  • de Wit, C., & Sordalen, C. (1992) Exponential stabilization of mobile robots with nonholonomic constraints. IEEE Transactions on Automatic Control.

  • der Merwe, R. V., & Wan, E. (2001). The square-root unscented Kalman filter for state and parameter-estimation. In IEEE international conference on acoustics, speech, and signal processing (pp. 3461–3464).

  • Fong, T., Thorpe, C., & Baur, C. (2001). Advanced interfaces for vehicle teleoperation: Collaborative control, sensor fusion displays and remote driving tools. Autonomous Robots, 77–85.

  • Forsyth, D., & Ponce, J. (2003). Computer vision, a modern approach. New York: Prentice Hall.

    Google Scholar 

  • Fossen, T. (1994). Guidance and control of ocean vehicles. New York: Wiley.

    Google Scholar 

  • Julier, S., & Uhlmann, J. (1997). A new extension of the Kalman filter to nonlinear systems. In Proceedings of the int. symp. aerospace/defense sensing, simul. and controls.

    Google Scholar 

  • Karras, G., & Kyriakopoulos, K. (2008). Visual servo control of an underwater vehicle using a laser vision system. In Proceedings of IEEE/RSJ intelligent robots and systems (pp. 4116–4122).

    Google Scholar 

  • Karras, G., Panagou, D., & Kyriakopoulos, K. (2006). Target-referenced localization of an underwater vehicle using a laser-based vision system. In MTS/IEEE OCEANS.

    Google Scholar 

  • Karras, G., Loizou, S., & Kyriakopoulos, K. (2009). Semi-autonomous teleoperation of a non-holonomic underwater vehicle using a laser vision system: A visual-servoing switching control approach. In Proceedings of the 17th Mediterranean conference on control and automation.

    Google Scholar 

  • Karras, G., Loizou, S., & Kyriakopoulos, K. (2010). A visual-servoing scheme for semi-autonomous operation of an underwater robotic vehicle using an imu and a laser vision system. In Proceedings of IEEE international conference on robotics and automation.

    Google Scholar 

  • Kass, M., Witkin, A., & Terzopoulos, D. (1987). Snakes: Active contour models. International Journal of Computer Vision, 321–331.

  • Ljung, L. (1987). System identification, theory for the user. New York: Prentice Hall.

    MATH  Google Scholar 

  • Lots, J., Lane, D., Trucco, E., & Chaumette, F. (2001). A 2d visual servoing for underwater vehicle station keeping. In Proceedings of IEEE international conference on robotics and automation (pp. 2767–2772).

    Google Scholar 

  • Luo, J., & Tsiotras, P. (1998). Exponentially convergent control laws for nonholonomic systems in power form. System and Control Letters.

  • Mezouar, Y., & Chaumette, F. (2000). Path planning in image space for robust visual servoing. In Proceedings of IEEE international conference on robotics and automation (pp. 2759–2764).

    Google Scholar 

  • Murrieri, P., Fontanelli, D., & Bicchi, A. (2004). A hybrid-control approach to the parking problem of a wheeled vehicle using limited view-angle visual feedback. The International Journal of Robotics Research, 437–448.

  • Negahdaripour, S., & Firoozfam, P. (2006). An rov stereovision system for ship-hull inspection. IEEE Journal of Oceanic Engineering, 551–564.

  • Panagou, D., Karras, G., & Kyriakopoulos, K. (2008). Towards the stabilization of an underactuated underwater vehicle in the presence of unknown disturbances. In MTS/IEEE OCEANS.

    Google Scholar 

  • Repoulias, F., & Papadopoulos, E. (2007). Planar trajectory planning and tracking control design for underactuated auvs. Ocean Engineering, 1650–1667.

  • Ridao, P., Tiano, A., El-Fakdi, A., Carreras, M., & Zirilli, A. (2004). On the identification of non-linear models of unmanned underwater vehicles. Control Engineering Practice, 12, 1483–1499.

    Article  Google Scholar 

  • Silpa-Anan, C., Brinsmead, T., Abdallah, S., & Zelinsky, A. (2001). Preliminary experiments in visual servo control for autonomous underwater vehicle. In Proceedings of IEEE/RSJ intelligent robots and systems (pp. 1824–1829).

    Google Scholar 

  • Slotine, J., & Li, W. (1991). Applied non linear control. New York: Prentice Hall.

    Google Scholar 

  • Smallwood, D., & Whitcomb, L. (2003). Adaptive identification of dynamically positioned underwater robotic vehicles. IEEE Transactions on Control Systems Technology, 505–515.

  • SNAME (1950). The society of naval architects and marine engineers. nomenclature for treating the motion of a submerged body through a fluid (Technical and Research Bulletin No 1–5). URL http://www.sname.org.

  • Sontag, E., & Wang, Y. (1995). On characterizations of the input-to-state stability property. System and Control Letters, 351–359.

  • Thuilot, B., Martinet, P., Cordesses, L., & Gallice, J. (2002). Position based visual servoing: keeping the object in the field of vision. In Proceedings of IEEE international conference on robotics and automation (pp. 1624–1629).

    Google Scholar 

  • van de Ven, P., Johansen, T., Sorensen, A., Flanagan, C., & Toal, D. (2007). Neural network augmented identification of underwater vehicle models. Control Engineering Practice, 15, 715–725.

    Article  Google Scholar 

  • VanDyke, M., Schwartz, J., & Hall, C. (2004). Unscented Kalman filtering for spacecraft attitude state and parameter estimation. Advances in the Astronautical Sciences, 217–228.

  • Wang, W., & Clark, C. (2006). OCEANS 2006—Asia Pacific. In Modeling and simulation of the VideoRay Pro III underwater vehicle (pp. 1–7).

    Google Scholar 

  • Wang, X., Seeta, G., Lau, M., Low, E., & Tan, K. (2000). Exploiting force feedback in pilot training and control of an underwater robotics vehicle: an implementation in labview. In Proceedings of MTS/IEEE OCEANS (pp. 2037–2042).

    Google Scholar 

  • Woolsey, C., & Techy, L. (2009). Cross-track control of a slender, underactuated auv using potential shaping. Ocean Engineering, 82–91.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to George C. Karras.

Additional information

Portions of this paper have appeared in Karras et al. (2009, 2010).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Karras, G.C., Loizou, S.G. & Kyriakopoulos, K.J. Towards semi-autonomous operation of under-actuated underwater vehicles: sensor fusion, on-line identification and visual servo control. Auton Robot 31, 67–86 (2011). https://doi.org/10.1007/s10514-011-9231-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-011-9231-6

Keywords

Navigation