Skip to main content
SpringerLink
Log in

Robot Formations Using a Single Camera and Entropy-based Segmentation

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

This work presents a new problem along with our new algorithm for a multi-robot formation with minimally controlled conditions. For multi-robot cooperation, there have traditionally been prevailing assumptions in order to collect the necessary information. These assumptions include the existence of communication systems among the robots or the use of specialized sensors such as laser scanners or omnidirectional cameras. However, they are not always valid, especially in emergency situations or with miniature robots. We, therefore, need to deal with the conditions that have received less attention in research regarding a multi-robot formation. There are several challenges: (1) less information is available than the well-known formation algorithms assume, (2) following strategies for deformable shapes in a formation with only local information available are needed, and (3) target segmentation without any markers is required. This work presents a formation algorithm based on a visual tracking algorithm, including how to process the image measurements provided by a single monocular camera. Through several experiments with real robots (developed at the University of Minnesota), we show that the proposed algorithms work well with minimal sensing information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Article 27 August 2016

References

  1. Cowan, N., Shakernia, O., Vidal, R., Sastry, S.: Vision-based follow-the-leader. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 27–31 (2003)

  2. Das, A.K., Fierro, R., Kumar, V., Ostrowski, J.P., Spletzer, J., Taylor, C.J.: A vision-based formation control framework. IEEE Trans. Robot. Autom. 18(5), 813–825 (2002)

    Article  Google Scholar 

  3. Desai, J.P., Ostrowski, J., Kumar, V.: Controlling formations of multiple mobile robots. In: Proc. of the 1998 IEEE Int. Conf. on Robotics & Automation, pp. 2864–2869 (1998)

  4. Du, Y., Papanikolopoulos, N.: Real-time vehicle following through a novel symmetry-based approach. In: IEEE Int. Conf. on Robotics & Automation, pp. 3160–3165 (1997)

  5. Jung, B., Sukhatme, G.S.: Tracking multiple moving targets using a camera and laser rangefinder. Institute for Robotics and Intelligent Systems (IRIS) Technical Report 01-397, University of Southern California (2001)

  6. Ko, J., Klein, D.J., Fox, D., Haehnel, D.: GP-UKF: Unscented Kalman filters with Gaussian process prediction and observation. In: IEEE/RSJ Int. Conf. on Intelligent Robotics and Systems, pp. 1901–1907 (2007)

  7. Lawton, J.R.T., Beard, R.W., Young, B.J.: A decentralized approach to formation maneuvers. IEEE Trans. Robot. Autom. 19(6), 933–941 (2003)

    Article  Google Scholar 

  8. Lemay, M., Michaud, F., Litourneau, D., Valin, J.M.: Autonomous initialization of robot formations. In: Proc. of the 2004 IEEE Int. Conf. on Robotics & Automation, pp. 3018–3023 (2004)

  9. Liu, S., Tan, D., Liu, G.: Vision-based formation control of mobile robots. J. Control Theory Appl. 3, 173–180 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  10. Mariottini, G.L., Morbidi, F., Prattichizzo, D., Pappas, G.J., Daniilidis, K.: Leader-follower formations: uncalibrated vision-based localization and control. In: IEEE Int. Conf. on Robotics and Automation, pp. 2403–2408 (2007)

  11. Min, H.J., Drenner, A., Papanikolopoulos, N.: Vision-based leader-follower formations with limited information. In: Int. Conf. on Robotics and Automation (2009)

  12. Min, H.J., Papanikolopoulos, N.: Entropy-based motion segmentation from a moving platform. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (2009)

  13. Morbidi, F., Mariottini, G.L., Prattichizzo, D.: Vision-based range estimation via immersion and invariance for robot formation control. In: IEEE Int. Conf. on Robotics and Automation, pp. 504–509 (2008)

  14. Moshtagh, N., Michael, N., Jadbabaie, A., Daniilidis, K.: Vision-based, distributed control laws for motion coordination of nonholonomic robots. IEEE Trans. Robot. 25, 851–860 (2009)

    Article  Google Scholar 

  15. Orqueda, O.A., Fierro, R.: Robust vision-based nonlinear formation control. In: American Control Conference, pp. 6–11 (2006)

  16. Renaud, P., Cervera, E., Martiner, P.: Towards a reliable vision-based mobile robot formation control. In: IEEE Int. Conf. on Intelligent Robots and Systems, pp. 3176–3181 (2004)

  17. Talukder, A., Goldberg, S., Matthies, L., Ansar, A.: Real-time detection of moving objects in a dynamic scene from moving robotic vehicles. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 1308–1313 (2003)

  18. Tanner, H.G., Kumar, A.: Towards decentralization of multi-robot navigation functions. In: Proc. of the 2005 IEEE Int. Conf. on Robotics and Automation, pp. 4132–4137 (2005)

  19. Tanner, H.G., Pappas, G.J., Kumar, V.: Leader-to-formation stability. IEEE Trans. Robot. Autom. 20(3), 443–455 (2004)

    Article  Google Scholar 

  20. Vidal, R., Shakernia, O., Sastry, S.: Following the flock: distributed formation control with omnidirectional vision-based motion segmentation and visual servoing. IEEE Robot. Autom. Mag. 11, 14–20 (2004)

    Article  Google Scholar 

  21. Walter, M., Anderson, M., Burt, I., Papanikolopoulos, N.: The design and evolution of the eROSI robot. In: IEEE Int. Conf. on Robotics and Automation, pp. 2984–2989 (2007)

  22. Zhou, X.S., Zhou, K.X., Roumeliotis, S.I.: Optimized motion strategies for localization in leader-follower formations. In: IEEE/RSJ Int. Conf. on Intelligent Robotics and Systems (2011)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, 55455, USA

    Hyeun Jeong Min & Nikolaos Papanikolopoulos

Authors
  1. Hyeun Jeong Min
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nikolaos Papanikolopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nikolaos Papanikolopoulos.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Min, H.J., Papanikolopoulos, N. Robot Formations Using a Single Camera and Entropy-based Segmentation. J Intell Robot Syst 68, 21–41 (2012). https://doi.org/10.1007/s10846-012-9668-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-012-9668-7

Keywords

Search

Navigation