ABSTRACT
Given a multi-modal dynamical system, optimal switching logic synthesis involves generating conditions for switching between the system modes such that the resulting hybrid system satisfies a quantitative specification. We formalize and solve the problem of optimal switching logic synthesis for quantitative specifications over long run behavior. Our paper generalizes earlier work on synthesis for safety. We present an approach for specifying quantitative measures using reward and penalty functions, and illustrate its effectiveness using several examples. Each trajectory of the system, and each state of the system, is associated with a cost. Our goal is to synthesize a system that minimizes this cost from each initial state. Our algorithm works in two steps. For a single initial state, we reduce the synthesis problem to an unconstrained numerical optimization problem which can be solved by any off-the-shelf numerical optimization engines. In the next step, optimal switching condition is learnt as a generalization of the optimal switching states discovered for each initial state. We prove the correctness of our technique and demonstrate the effectiveness of this approach with experimental results.
- E. Asarin, O. Bournez, T. Dang, O. Maler, and A. Pnueli. Effective synthesis of switching controllers for linear systems. Proc. of the IEEE, 88(7):1011--1025, 2000.Google ScholarCross Ref
- H. Axelsson, Y. Wardi, M. Egerstedt, and E. Verriest. Gradient descent approach to optimal mode scheduling in hybrid dynamical systems. J. Optimization Theory and Applications, 136(2):167--186, 2008.Google ScholarDigital Library
- H. Axelsson, Y. Wardi, M. Egerstedt, and E. Verriest. Gradient descent approach to optimal mode scheduling in hybrid dynamical systems. Journal of Optimization Theory and Applications, 136:167--186, 2008.Google ScholarDigital Library
- A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth. Learnability and the vapnik-chervonenkis dimension. J. ACM, 36(4):929--965, 1989. Google ScholarDigital Library
- J. Bonnans, J. Gilbert, C. Lemaréchal, and C. Sagastizábal. Numerical Optimization - Theoretical and Practical Aspects, Second Edition. 2006. Google ScholarDigital Library
- M. Branicky, V. Borkar, and S. Mitter. A unified framework for hybrid control: Model and optimal control theory. IEEE Trans. on Aut. Cntrl., 43(1):31--45, 1998.Google ScholarCross Ref
- F. Cassez, J. J. Jessen, K. G. Larsen, J.-F. Raskin, and P.-A. Reynier. Automatic synthesis of robust and optimal controllers - an industrial case study. In HSCC, pages 90--104, 2009. Google ScholarDigital Library
- K. Chatterjee. Markov decision processes with multiple long-run average objectives. In FSTTCS, pages 473--484, 2007. Google ScholarDigital Library
- K. Chatterjee, R. Majumdar, and T. A. Henzinger. Controller synthesis with budget constraints. In HSCC, pages 72--86, 2008. Google ScholarDigital Library
- J. Cury, B. Brogh, and T. Niinomi. Supervisory controllers for hybrid systems based on approximating automata. IEEE Trans. Aut. Cntrl., 43:564--568, 1998.Google ScholarCross Ref
- Y. Freund and R. E. Schapire. Large Margin Classification Using the Perceptron Algorithm. In Machine Learning, pages 277--296, 1998. Google ScholarDigital Library
- H. González, R. Vasudevan, M. Kamgarpour, S. Sastry, R. Bajcsy, and C. Tomlin. A numerical method for the optimal control of switched systems. In CDC, pages 7519--7526, 2010.Google ScholarCross Ref
- H. Gonzalez, R. Vasudevan, M. Kamgarpour, S. S. Sastry, R. Bajcsy, and C. J. Tomlin. A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems. In HSCC, pages 51--60, 2010. Google ScholarDigital Library
- P. M. Gruber and J. M. Wills, editors. Handbook of Convex Geometry : Two-Volume Set. North Holland, 1993.Google Scholar
- P. Gupta and A. Patra. Super-stable energy based switching control scheme for dc-dc buck converter circuits. In ISCAS (4), pages 3063--3066, 2005.Google Scholar
- S. Jha, S. Gulwani, S. Seshia, and A. Tiwari. Synthesizing switching logic for safety and dwell-time requirements. In ICCPS, pages 22--31, 2010. Google ScholarDigital Library
- S. Jha, S. A. Seshia, and A. Tiwari. Full version: Synthesizing switching logic to minimize long-run cost. http://eecs.berkeley.edu/~jha/optSLsynth.pdf.Google Scholar
- R. Karp. A characterization of the minimum cycle mean in a digraph. Dis. Math., pages 309--311, 1978.Google Scholar
- T. Koo and S. Sastry. Mode switching synthesis for reachability specification. In Proc. HSCC 2001, LNCS 2034, pages 333--346, 2001. Google ScholarDigital Library
- A. Kucera and O. Strazovsky. On the controller synthesis for finite-state markov decision processes. Fundamenta Informaticae, 82(1-2):141--153, 2008. Google ScholarDigital Library
- J. C. Lagarias, J. A. Reeds, M. H. Wright, and P. E. Wright. Convergence properties of the nelder-mead simplex method in low dimensions. SIAM Journal of Optimization, 9:112--147, 1998. Google ScholarDigital Library
- P. Manon and C. Valentin-Roubinet. Controller synthesis for hybrid systems with linear vector fields. In Proc. IEEE Intl. Symp. on Intelligent Control, pages 17--22, 1999.Google ScholarCross Ref
- MathWorks. Minimum of unconstrained multivariable function using derivative-free method. http://www.mathworks.com/help/techdoc/ref/fminsearch.html.Google Scholar
- MathWorks. Solve initial value problems for ordinary differential equations. http://www.mathworks.com/help/techdoc/ref/ode23.html.Google Scholar
- T. Moor and J. Raisch. Discrete control of switched linear systems. In ECC'99, 1999.Google ScholarCross Ref
- J. A. Nelder and R. Mead. A simplex method for function minimization. The Computer Journal, 7(4):308--313, January 1965.Google ScholarCross Ref
- J. I. Rasmussen, K. G. Larsen, and K. Subramani. On using priced timed automata to achieve optimal scheduling. FMSD, 29:97--114, July 2006. Google ScholarDigital Library
- M. Shaikh and P. Caines. On the optimal control of hybrid systems: Optimization of trajectories, switching times, and location schedules. In HSCC, 2003. Google ScholarDigital Library
- P. Tabuada. Controller synthesis for bisimulation equivalence. Systems and Control Letters, 57(6):443--452, 2008.Google ScholarCross Ref
- A. Taly and A. Tiwari. Switching logic synthesis for reachability. In EMSOFT, pages 19--28, 2010. Google ScholarDigital Library
- C. Tomlin, L. Lygeros, and S. Sastry. A game-theoretic approach to controller design for hybrid systems. Proc. of the IEEE, 88(7):949--970, 2000.Google ScholarCross Ref
- L. G. Valiant. A theory of the learnable. Commun. ACM, 27(11):1134--1142, 1984. Google ScholarDigital Library
- X. Xu and P. Antsaklis. Optimal control of switched systems via nonlinear optimization based on direct differentiation of value functions. Intl. journal of control, 75(16):1406--1426, 2002.Google Scholar
Index Terms
Synthesis of optimal switching logic for hybrid systems
Recommendations
Synthesizing switching logic for safety and dwell-time requirements
ICCPS '10: Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical SystemsCyber-physical systems (CPS) can be usefully modeled as hybrid automata combining the physical dynamics within modes with discrete switching behavior between modes. CPS designs must satisfy safety and performance requirements. While the dynamics within ...
Switching logic synthesis for reachability
EMSOFT '10: Proceedings of the tenth ACM international conference on Embedded softwareWe consider the problem of driving a system from some initial configuration to a desired configuration while avoiding some unsafe configurations. The system to be controlled is a dynamical system that can operate in different modes. The goal is to ...
Synthesizing switching logic using constraint solving
For a system that can operate in multiple different modes, we define the switching logic synthesis problem as follows: given a description of the dynamics in each mode of the system, find the conditions for switching between the modes so that the ...
Comments