Article Outline
Keywords
Optimal Control Problem
Iterative Dynamic Programming
Early Applications of IDP
Choice of Candidates for Control
Piecewise Linear Continuous Control
Algorithm for IDP
Time-Delay Systems
State Constraints
Singular Control Problems
Sensitivity of Control Policy
Use of Variable Stage-Lengths
Nonseparable Problems
Future Directions
See also
References
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bellman R (1957) Dynamic programming. Princeton Univ. Press, Princeton
Bellman R, Dreyfus S (1962) Applied dynamic programming. Princeton Univ. Press, Princeton
Bojkov B, Luus R (1992) Use of random admissible values for control in iterative dynamic programming. Ind Eng Chem Res 31:1308–1314
Bojkov B, Luus R (1993) Evaluation of the parameters used in iterative dynamic programming. Canad J Chem Eng 71:451–459
Bojkov B, Luus R (1994) Time-optimal control by iterative dynamic programming. Ind Eng Chem Res 33:1486–1492
Bojkov B, Luus R (1995) Time optimal control of high dimensional systems by iterative dynamic programming. Canad J Chem Eng 73:380–390
Bojkov B, Luus R (1996) Optimal control of nonlinear systems with unspecified final times. Chem Eng Sci 51:905–919
Dadebo S, Luus R (1992) Optimal control of time-delay systems by dynamic programming. Optimal Control Appl Meth 13:29–41
Dadebo SA, McAuley KB (1995) Dynamic optimization of constrained chemical engineering problems using dynamic programming. Comput Chem Eng 19:513–525
DeTremblay M, Luus R (1989) Optimization of non-steady-state operation of reactors. Canad J Chem Eng 67:494–502
Hartig F, Keil FJ, Luus R (1995) Comparison of optimization methods for a fed-batch reactor. Hungarian J Ind Chem 23:141–148
Lapidus L, Luus R (1967) Optimal control of engineering processes. Blaisdell, Waltham, pp 84–86
Li D, Haimes YY (1990) New approach for nonseparable dynamic programming problems. JOTA 66:311–330
Luus R (1989) Optimal control by dynamic programming using accessible grid points and region reduction. Hungarian J Ind Chem 17:523–543
Luus R (1990) Application of dynamic programming to high-dimensional nonlinear optimal control problems. Internat J Control 52:239–250
Luus R (1990) Optimal control by dynamic programming using systematic reduction in grid size. Internat J Control 19:995–1013
Luus R (1991) Application of iterative dynamic programming to state constrained optimal control problems. Hungarian J Ind Chem 19:245–254
Luus R (1991) Effect of the choice of final time in optimal control of nonlinear systems. Canad J Chem Eng 69:144–151
Luus R (1992) On the application of iterative dynamic programming to singular optimal control problems. IEEE Trans Autom Control 37:1802–1806
Luus R (1993) Application of dynamic programming to differential-algebraic process systems. Comput Chem Eng 17:373–377
Luus R (1993) Application of iterative dynamic programming to very high-dimensional systems. Hungarian J Ind Chem 21:243–250
Luus R (1993) Optimization of fed-batch fermentors by iterative dynamic programming. Biotechnol and Bioengin 41:599–602
Luus R (1993) Piecewise linear continuous control by iterative dynamic programming. Ind Eng Chem Res 32:859–865
Luus R (1994) Optimal control of batch reactors by iterative dynamic programming. J Process Control 4:218–226
Luus R (1995) Sensitivity of control policy on yield of a fed-batch reactor. Proc. IASTED Internat. Conf. on Modelling and Simulation, Pittsburgh, PA, April 27-29, 1995, pp 224–226
Luus R (1996) Numerical convergence properties of iterative dynamic programming when applied to high dimensional systems. Chem Eng Res Des 74:55–62
Luus R (1996) Use of iterative dynamic programming with variable stage lengths and fixed final time. Hungarian J Ind Chem 24:279–284
Luus R (1997) Application of iterative dynamic programming to optimal control of nonseparable problems. Hungarian J Ind Chem 25:293–297
Luus R (1997) Use of iterative dynamic programming for optimal singular control problems. Proc. IASTED Internat. Conf. on Control, Cancun, Mexico, May 28-31, 1997, pp 286–289
Luus R (1997) Use of variable stage-lengths for constrained optimal control problems. Hungarian J Ind Chem 25:299–304
Luus R (1998) Direct approach to time optimal control by iterative dynamic programming. Proc. IASTED Internat. Conf. on Intelligent Systems and Control, Halifax, Nova Scotia, Canada, June 1-4, 1998, pp 121–125
Luus R (1998) Iterative dynamic programming: from curiosity to a practical optimization procedure. Control and Intelligent Systems 26:1–8
Luus R (2000) Iterative dynamic programming. Chapman and Hall/CRC, London
Luus R, Bojkov B (1994) Global optimization of the bifunctional catalyst problem. Canad J Chem Eng 72:160–163
Luus R, Dittrich J, Keil FJ (1992) Multiplicity of solutions in the optimization of a bifunctional catalyst blend in a tubular reactor. Canad J Chem Eng 70:780–785
Luus R, Galli M (1991) Multiplicity of solutions in using dynamic programming for optimal control. Hungarian J Ind Chem 19:55–62
Luus R, Jaakola THI (1973) Optimization by direct search and systematic reduction of the size of search region. AIChE J 19:760–766
Luus R, Okongwu ON (1999) Towards practical optimal control of batch reactors. Chem Eng 75:1–9
Luus R, Rosen O (1991) Application of iterative dynamic programming to final state constrained optimal control problems. Ind Eng Chem Res 30:1525–1530
Luus R, Smith SG (1991) Application of dynamic programming to high-dimensional systems described by difference equations. Chem Eng Techn 14:122–126
Luus R, Storey C (1997) Optimal control of final state constrained systems. Proc. IASTED Internat. Conf. on Modelling, Simulation and Control, Singapore, Aug. 11-13, 1997, pp 245–249
Luus R, Tassone V (1992) Optimal control of nonseparable problems by iterative dynamic programming. Proc. 42nd Canad. Chemical Engin. Conf., Toronto, Canada, October, 18-21, 1992, pp 81–82
Luus R, Zhang X, Hartig F, Keil FJ (1995) Use of piecewise linear continuous control for time-delay systems. Ind Eng Chem Res 34:4136–4139
Marroquin G, Luyben WL (1973) Practical control studies of batch reactors using realistic mathematical models. Chem Eng Sci 28:993–1003
Mekarapiruk W, Luus R (1997) Optimal control of final state constrained systems. Canad J Chem Eng 25:806–811
Mekarapiruk W, Luus R (1997) Optimal control of inequality state constrained systems. Ind Eng Chem Res 36:1686–1694
Tassone V, Luus R (1993) Reduction of allowable values for control in iterative dynamic programming. Chem Eng Sci 48:3864–3867
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag
About this entry
Cite this entry
Luus, R. (2008). Dynamic Programming: Optimal Control Applications . In: Floudas, C., Pardalos, P. (eds) Encyclopedia of Optimization. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-74759-0_151
Download citation
DOI: https://doi.org/10.1007/978-0-387-74759-0_151
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-74758-3
Online ISBN: 978-0-387-74759-0
eBook Packages: Mathematics and StatisticsReference Module Computer Science and Engineering