Skip to main content

Optimal Control of Multi-agent Persistent Monitoring Systems with Performance Constraints

  • Chapter
Control of Cyber-Physical Systems

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 449))

Abstract

We present an optimal control framework for persistent monitoring problems where the objective is to control the movement of multiple cooperating agents to minimize an uncertainty metric in a given mission space, while seeking to maintain some upper bound constraints on uncertainty values. In a one-dimensional mission space, we show that the optimal solution is for each agent to move at maximal speed from one switching point to the next, possibly waiting some time at each point before reversing its direction. Thus, the solution is reduced to a simpler parametric optimization problem: determining a sequence of switching locations and associated waiting times at these switching points for each agent. This amounts to a hybrid system which we analyze using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through a gradient-based algorithm.We also show that the solution is robust with respect to the uncertainty model used.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Rekleitis, I., Lee-Shue, V., New, A., Choset, H.: Limited communication, multi-robot team based coverage. In: IEEE Intl. Conf. on Robotics and Automation, vol. 4, pp. 3462–3468 (2004)

    Google Scholar 

  2. Cortes, J., Martinez, S., Karatas, T., Bullo, F.: Coverage control for mobile sensing networks. IEEE Trans. on Robotics and Automation 20(2), 243–255 (2004)

    Article  Google Scholar 

  3. Girard, A., Howell, A., Hedrick, J.: Border patrol and surveillance missions using multiple unmanned air vehicles. In: 43rd IEEE Conf. Decision and Control, vol. 1, pp. 620–625 (2005)

    Google Scholar 

  4. Grocholsky, B., Keller, J., Kumar, V., Pappas, G.: Cooperative air and ground surveillance. IEEE Robotics & Automation Magazine 13(3), 16–25 (2006)

    Article  Google Scholar 

  5. Smith, R., Mac Schwager, S., Rus, D., Sukhatme, G.: Persistent ocean monitoring with underwater gliders: Towards accurate reconstruction of dynamic ocean processes. In: IEEE Conf. on Robotics and Automation, pp. 1517–1524 (2011)

    Google Scholar 

  6. Paley, D., Zhang, F., Leonard, N.: Cooperative control for ocean sampling: The glider coordinated control system. IEEE Trans. on Control Systems Technology 16(4), 735–744 (2008)

    Article  Google Scholar 

  7. Smith, S.L., Schwager, M., Rus, D.: Persistent monitoring of changing environments using robots with limited range sensing. In: IEEE International Conf. Robotics and Automation, pp. 5448–5455 (2011)

    Google Scholar 

  8. Nigam, N., Kroo, I.: Persistent surveillance using multiple unmanned air vehicles. In: IEEE Aerospace Conf., pp. 1–14 (2008)

    Google Scholar 

  9. Hokayem, P., Stipanovic, D., Spong, M.: On persistent coverage control. In: 46th IEEE Conf. Decision and Control, pp. 6130–6135 (2008)

    Google Scholar 

  10. Elmaliach, Y., Agmon, N., Kaminka, G.: Multi-robot area patrol under frequency constraints. In: IEEE Intl. Conf. on Robotics and Automation, pp. 385–390 (2007)

    Google Scholar 

  11. Cassandras, C.G., Ding, X.C., Lin, X.: An optimal control approach for the persistent monitoring problem. In: Proc. of 50th IEEE Conf. Decision and Control, pp. 2907–2912 (2011)

    Google Scholar 

  12. Pasqualetti, F., Franchi, A., Bullo, F.: On cooperative patrolling: Optimal trajectories, complexity analysis, and approximation algorithms. IEEE Transactions on Robotics 28, 592–606 (2012)

    Article  Google Scholar 

  13. Spindler, M., Pasqualetti, F., Bullo, F.: Distributed multi-camera synchronization for smart-intruder detection. In: American Control Conference, pp. 5120–5125 (2012)

    Google Scholar 

  14. Cassandras, C.G., Lin, X., Ding, X.C.: An optimal control approach to the multi-agent persistent monitoring problem. IEEE Trans. on Automatic Control 58(4), 947–961 (2013)

    Article  Google Scholar 

  15. Cassandras, C.G., Wardi, Y., Panayiotou, C.G., Yao, C.: Perturbation analysis and optimization of stochastic hybrid systems. European Journal of Control 16(6), 642–664 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  16. Wardi, Y., Adams, R., Melamed, B.: A unified approach to infinitesimal perturbation analysis in stochastic flow models: the single-stage case. IEEE Trans. on Automatic Control 55(1), 89–103 (2009)

    Article  MathSciNet  Google Scholar 

  17. Bryson, A., Ho, Y.: Applied optimal control. Wiley, N.Y (1975)

    Google Scholar 

  18. Xu, X., Antsaklis, P.: Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans. on Automatic Control 49(1), 2–16 (2004)

    Article  MathSciNet  Google Scholar 

  19. Yao, C., Cassandras, C.G.: Perturbation analysis of stochastic hybrid systems and applications to resource contention games. Frontiers of Electr. and Electr. Engin. in China 6(3), 453–467 (2011)

    Article  Google Scholar 

  20. Cassandras, C.G., Lygeros, J.E.: Stochastic hybrid systems. Taylor and Francis (2007)

    Google Scholar 

  21. Polak, E.: Optimization: algorithms and consistent approximations. Springer (1997)

    Google Scholar 

  22. Lin, X., Cassandras, C.G.: An optimal control approach to the multi-agent persistent monitoring problem in two-dimensional spaces. In: 52nd IEEE Conf. Decision and Control (submitted, 2013), http://arxiv.org/submit/694747/view

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christos G. Cassandras .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Cassandras, C.G., Lin, X. (2013). Optimal Control of Multi-agent Persistent Monitoring Systems with Performance Constraints. In: Tarraf, D. (eds) Control of Cyber-Physical Systems. Lecture Notes in Control and Information Sciences, vol 449. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-01159-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-01159-2_15

  • Publisher Name: Springer, Heidelberg

  • Print ISBN: 978-3-319-01158-5

  • Online ISBN: 978-3-319-01159-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics