On Stability of Bang-Bang Type Controls
Abstract
From the theory of nonlinear optimal control problems it is known that the solution stability w.r.t. data perturbations and conditions for strict local optimality are closely related facts. For important classes of control problems, sufficient optimality conditions can be formulated as a combination of the independence of active constraints' gradients and certain coercivity criteria. In the case of discontinuous controls, however, common pointwise coercivity approaches may fail.
In the paper, we consider sufficient optimality conditions for strong local minimizers which make use of an integrated Hamilton--Jacobi inequality. In the case of linear system dynamics, we show that the solution stability (including the switching points localization) is ensured under relatively mild regularity assumptions on the switching function zeros. For the objective functional, local quadratic growth estimates in L1 sense are provided. An example illustrates stability as well as instability effects in case the regularity condition is violated.
MSC codes
Keywords
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
A. Agrachëv, R. Gamkrelidze, Symplectic geometry for optimal control, Monogr. Textbooks Pure Appl. Math., Vol. 133, Dekker, New York, 1990, 263–277
2.
A. Agrachev, P. Dzedza, Zh. Stefani, Strong minima in optimal control, Tr. Mat. Inst. Steklova, 220 (1998), 8–26
3.
Andrei Agrachev, Gianna Stefani, Pierluigi Zezza, Symplectic methods for strong local optimality in the bang‐bang case, World Sci. Publishing, River Edge, NJ, 2002, 169–181
4.
Arthur Bryson, Jr., Yu Ho, Applied optimal control, Hemisphere Publishing Corp. Washington, D. C., 1975xiv+481, Optimization, estimation, and control; Revised printing
5.
Frank Clarke, Vera Zeidan, Sufficiency andthe Jacobi condition in the calculus of variations, Canad. J. Math., 38 (1986), 1199–1209
6.
A. Dontchev, William Hager, The Euler approximation in state constrained optimal control, Math. Comp., 70 (2001), 173–203
7.
A. Dontchev, K. Malanowski, A characterization of Lipschitzian stability in optimal control, Chapman & Hall/CRC Res. Notes Math., Vol. 411, Chapman & Hall/CRC, Boca Raton, FL, 2000, 62–76
8.
U. Felgenhauer, Diskretisierung von Steuerungsproblemen unter stabilen Optimalitätsbedingungen, Habilitation thesis, Brandenburgische Technische Universität Cottbus, 1999.
9.
Ursula Felgenhauer, On smoothness properties and approximability of optimal control functions, Ann. Oper. Res., 101 (2001), 23–42, Optimization with data perturbations, II
10.
U. Felgenhauer, Stability and local growth near bounded‐strong local optimal controls, in System Modelling and Optimization XX, Proceedings of the 20th IFIP TC7 Conference, Trier 2001, Kluwer Academic Publishers, Dordrecht, The Netherlands, to appear.
11.
U. Felgenhauer, Structural properties and approximation of optimal controls, Nonlinear Anal., 47 (2001), pp. 1869–1880.
12.
U. Felgenhauer, Weak and strong optimality conditions for constrained control problems with discontinuous control, J. Optim. Theory Appl., 110 (2001), 361–387
13.
R. Klötzler, On a general concept of duality in optimal control, Lecture Notes in Math., Vol. 703, Springer, Berlin, 1979, 189–196
14.
Rolf Klötzler, Sabine Pickenhain, Pontryagin’s maximum principle for multidimensional control problems, Internat. Ser. Numer. Math., Vol. 111, Birkhäuser, Basel, 1993, 21–30
15.
Urszula Ledzewicz, Heinz Schättler, High‐order approximations for abnormal bang‐bang extremals, Chapman & Hall/CRC Res. Notes Math., Vol. 396, Chapman & Hall/CRC, Boca Raton, FL, 1999, 126–134
16.
K. Malanowski, Two‐norm approach in stability and sensitivity analysis of optimization and optimal control problems, Adv. Math. Sci. Appl., 2 (1993), 397–443
17.
K. Malanowski, Stability and sensitivity analysis of solutions to infinite‐dimensional optimization problems, Lecture Notes in Control and Inform. Sci., Vol. 197, Springer, London, 1994, 109–127
18.
K. Malanowski, Stability and sensitivity of solutions to nonlinear optimal control problems, Appl. Math. Optim., 32 (1995), 111–141
19.
Kazimierz Malanowski, Stability analysis of solutions to parametric optimal control problems, Approx. Optim., Vol. 9, Lang, Frankfurt am Main, 1997, 227–244
20.
Kazimierz Malanowski, Christof Büskens, Helmut Maurer, Convergence of approximations to nonlinear optimal control problems, Lecture Notes in Pure and Appl. Math., Vol. 195, Dekker, New York, 1998, 253–284
21.
Kazimierz Malanowski, Helmut Maurer, Sensitivity analysis for parametric control problems with control‐state constraints, Comput. Optim. Appl., 5 (1996), 253–283
22.
Kazimierz Malanowski, Helmut Maurer, Sensitivity analysis for optimal control problems subject to higher order state constraints, Ann. Oper. Res., 101 (2001), 43–73, Optimization with data perturbations, II
23.
Kazimierz Malanowski, Helmut Maurer, Sensitivity analysis for state constrained optimal control problems, Discrete Contin. Dynam. Systems, 4 (1998), 241–272
24.
H. Maurer, Second order sufficient conditions for control problems with free final time, in Proceedings of the 3rd European Control Conference, Rome, 1995, A. Isidori et al., eds., 1995, pp. 3602–3606.
25.
Helmut Maurer, Hans Oberle, Second order sufficient conditions for optimal control problems with free final time: the Riccati approach, SIAMJ. Control Optim., 41 (2002), 380–403
26.
H. Maurer, S. Pickenhain, Second‐order sufficient conditions for control problems with mixed control‐state constraints, J. Optim. Theory Appl., 86 (1995), 649–667
27.
A. Milyutin, N. Osmolovskii, Calculus of variations and optimal control, Translations of Mathematical Monographs, Vol. 180, American Mathematical Society, 1998xii+372, Translated from the Russian manuscript by Dimitrii Chibisov
28.
John Noble, Heinz Schättler, Sufficient conditions for relative minima of broken extremals in optimal control theory, J. Math. Anal. Appl., 269 (2002), 98–128
29.
Nikola Osmolovski, Quadratic conditions for nonsingular extremals in optimal control (a theoretical treatment), Russian J. Math. Phys., 2 (1994), 487–516
30.
Nikolai Osmolovskii, Quadratic conditions for nonsingular extremals in optimal control (examples), Russian J. Math. Phys., 5 (1997), 373–388
31.
N. Osmolovskii, Second‐order conditions for broken extremal, Chapman & Hall/CRC Res. Notes Math., Vol. 411, Chapman & Hall/CRC, Boca Raton, FL, 2000, 198–216
32.
S. Pickenhain, Sufficiency conditions for weak local minima in multidimensional optimal control problems with mixed control‐state restrictions, Z. Anal. Anwendungen, 11 (1992), 559–568
33.
S. Pickenhain, Duality in optimal control with first order differential equations, in Encyclopedia of Optimization, Vol. I, C. A. Floudas and P. M. Pardalos, eds., Kluwer Academic Publishers, Dordrecht, The Netherlands, 2001, pp. 472–477.
34.
S. Pickenhain, K. Tammer, Sufficient conditions for local optimality in multidimensional control problems with state restrictions, Z. Anal. Anwendungen, 10 (1991), 397–405
35.
Andrei Sarychev, First‐ and second‐order sufficient optimality conditions for bang‐bang controls, SIAM J. Control Optim., 35 (1997), 315–340
36.
Heinz Schättler, On the local structure of time‐optimal bang‐bang trajectories in , SIAM J. Control Optim., 26 (1988), 186–204
Information & Authors
Information
Published In
SIAM Journal on Control and Optimization
Pages: 1843 - 1867
ISSN (online): 1095-7138
Copyright
Copyright © 2003 Society for Industrial and Applied Mathematics.
History
Published online: 26 July 2006
MSC codes
Keywords
Authors
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- Optimality conditions and Lipschitz stability for non-smooth semilinear elliptic optimal control problems with sparse controlsRevista de la Real Academia de Ciencias Exactas, Físicas y Naturales. Serie A. Matemáticas, Vol. 118, No. 3 | 21 April 2024
- Stability and Genericity of Bang-Bang Controls in Affine ProblemsSIAM Journal on Control and Optimization, Vol. 62, No. 3 | 11 June 2024
- Finite element error analysis of affine optimal control problemsESAIM: Control, Optimisation and Calculus of Variations, Vol. 30 | 28 August 2024
- On the regularity and stability of the Mayer‐type convex optimal control problemsAsian Journal of Control, Vol. 25, No. 2 | 13 September 2022
- On the Accuracy of the Model Predictive Control MethodSIAM Journal on Control and Optimization, Vol. 60, No. 4 | 16 August 2022
- Hölder Regularity in Bang-Bang Type Affine Optimal Control ProblemsLarge-Scale Scientific Computing | 18 March 2022
- A sharp error analysis for the DG method of optimal control problemsAIMS Mathematics, Vol. 7, No. 5 | 1 Jan 2022
- Gradient Methods on Strongly Convex Feasible Sets and Optimal Control of Affine SystemsApplied Mathematics & Optimization, Vol. 81, No. 3 | 6 October 2018
- Error Analysis for the Implicit Euler Discretization of Linear-Quadratic Control Problems with Higher Index DAEs and Bang–Bang SolutionsProgress in Differential-Algebraic Equations II | 11 October 2020
- Metric sub-regularity in optimal control of affine problems with free end stateESAIM: Control, Optimisation and Calculus of Variations, Vol. 26 | 3 September 2020
- Metric Regularity Properties in Bang-Bang Type Linear-Quadratic Optimal Control ProblemsSet-Valued and Variational Analysis, Vol. 27, No. 2 | 8 August 2018
- Error Estimates for Space-Time Discretization of Parabolic Time-Optimal Control Problems with Bang-Bang ControlsSIAM Journal on Control and Optimization, Vol. 57, No. 3 | 21 May 2019
- Stability for bang-bang control problems of partial differential equationsOptimization, Vol. 67, No. 12 | 25 September 2018
- Tikhonov regularization of control-constrained optimal control problemsComputational Optimization and Applications, Vol. 70, No. 1 | 23 December 2017
- On the convergence of the gradient projection method for convex optimal control problems with bang–bang solutionsComputational Optimization and Applications, Vol. 70, No. 1 | 29 January 2018
- Euler discretization for a class of nonlinear optimal control problems with control appearing linearlyComputational Optimization and Applications, Vol. 69, No. 3 | 15 November 2017
- Regularization and discretization error estimates for optimal control of ODEs with group sparsityESAIM: Control, Optimisation and Calculus of Variations, Vol. 24, No. 2 | 13 June 2018
- Higher-order numerical scheme for linear quadratic problems with bang–bang controlsComputational Optimization and Applications, Vol. 69, No. 2 | 6 October 2017
- High Order Discrete Approximations to Mayer's Problems for Linear SystemsSIAM Journal on Control and Optimization, Vol. 56, No. 1 | 5 January 2018
- Second-Order Analysis and Numerical Approximation for Bang-Bang Bilinear Control ProblemsSIAM Journal on Control and Optimization, Vol. 56, No. 6 | 20 November 2018
- On the Regularity of Linear-Quadratic Optimal Control Problems with Bang-Bang SolutionsLarge-Scale Scientific Computing | 3 January 2018
- Sufficient Second-Order Conditions for Bang-Bang Control ProblemsSIAM Journal on Control and Optimization, Vol. 55, No. 5 | 28 September 2017
- Regularization and implicit Euler discretization of linear-quadratic optimal control problems with bang-bang solutionsApplied Mathematics and Computation, Vol. 287-288 | 1 Sep 2016
- Dualization and discretization of linear-quadratic control problems with bang–bang solutionsEURO Journal on Computational Optimization, Vol. 4, No. 1 | 1 Feb 2016
- Second-Order Optimality Conditions for Broken Extremals and Bang-Bang Controls: Theory and ApplicationsAdvances in Mathematical Modeling, Optimization and Optimal Control | 20 May 2016
- Numerical approximations in optimal control of a class of heterogeneous systemsComputers & Mathematics with Applications, Vol. 70, No. 11 | 1 Dec 2015
- Robust error estimates for regularization and discretization of bang–bang control problemsComputational Optimization and Applications, Vol. 62, No. 1 | 26 February 2014
- Linear-quadratic control problems with L1 -control costOptimal Control Applications and Methods, Vol. 36, No. 4 | 27 June 2014
- Convergence results for the discrete regularization of linear-quadratic control problems with bang–bang solutionsComputational Optimization and Applications, Vol. 61, No. 3 | 8 February 2015
- Fields of extremals and sensitivity analysis for multi-input bilinear optimal control problemsDiscrete & Continuous Dynamical Systems - A, Vol. 35, No. 9 | 1 Jan 2015
- An implicit discretization scheme for linear-quadratic control problems with bang–bang solutionsOptimization Methods and Software, Vol. 29, No. 3 | 20 August 2013
- Improved Error Estimate for an Implicit Discretization Scheme for Linear-Quadratic Control Problems with Bang-Bang SolutionsLarge-Scale Scientific Computing | 26 June 2014
- The Euler Method for Linear Control Systems RevisitedLarge-Scale Scientific Computing | 26 June 2014
- Regularization of Linear-Quadratic Control Problems with $$L^1$$ L 1 -Control CostSystem Modeling and Optimization | 28 November 2014
- Note on local quadratic growth estimates in bang–bang optimal control problemsOptimization, Vol. 269 | 15 March 2013
- Metric Regularity and Stability of Optimal Control Problems for Linear SystemsSIAM Journal on Control and Optimization, Vol. 51, No. 5 | 28 October 2013
- Necessary Conditions for Convergence Rates of Regularizations of Optimal Control ProblemsSystem Modeling and Optimization | 1 Jan 2013
- Approximations of linear control problems with bang-bang solutionsOptimization, Vol. 62, No. 1 | 1 Jan 2013
- A geometric analysis of bang-bang extremals in optimal control problems for combination cancer chemotherapy2012 IEEE 51st IEEE Conference on Decision and Control (CDC) | 1 Dec 2012
- Quadratic order conditions for bang-singular extremalsNumerical Algebra, Control and Optimization, Vol. 2, No. 3 | 1 Aug 2012
- Error bounds for Euler approximation of linear-quadratic control problems with bang-bang solutionsNumerical Algebra, Control and Optimization, Vol. 2, No. 3 | 1 Aug 2012
- Multi-input Optimal Control Problems for Combined Tumor Anti-angiogenic and Radiotherapy TreatmentsJournal of Optimization Theory and Applications, Vol. 153, No. 1 | 16 November 2011
- Structural Stability Investigation of Bang-Singular-Bang Optimal ControlsJournal of Optimization Theory and Applications, Vol. 152, No. 3 | 22 September 2011
- Second Order Analysis for Bang-Bang Control Problems of PDEsSIAM Journal on Control and Optimization, Vol. 50, No. 4 | 23 August 2012
- The Calculus of Variations: A Historical PerspectiveGeometric Optimal Control | 10 May 2012
- The Pontryagin Maximum Principle: From Necessary Conditions to the Construction of an Optimal SolutionGeometric Optimal Control | 10 May 2012
- Reachable Sets of Linear Time-Invariant Systems: From Convex Sets to the Bang-Bang TheoremGeometric Optimal Control | 10 May 2012
- The High-Order Maximum Principle: From Approximations of Reachable Sets to High-Order Necessary Conditions for OptimalityGeometric Optimal Control | 10 May 2012
- The Method of Characteristics: A Geometric Approach to Sufficient Conditions for a Local MinimumGeometric Optimal Control | 10 May 2012
- Synthesis of Optimal Controlled Trajectories: From Local to Global SolutionsGeometric Optimal Control | 10 May 2012
- Control-Affine Systems in Low Dimensions: From Small-Time Reachable Sets to Time-Optimal SynthesesGeometric Optimal Control | 10 May 2012
- Directional Sensitivity Differentials for Parametric Bang-Bang Control ProblemsLarge-Scale Scientific Computing | 1 Jan 2010
- Lipschitz Stability of Broken Extremals in Bang-Bang Control ProblemsLarge-Scale Scientific Computing | 1 Jan 2008
- On a Distributed Control Problem Arising in Dynamic Optimization of a Fixed-Size PopulationSIAM Journal on Optimization, Vol. 18, No. 3 | 4 October 2007
- Approximations with Error Estimates for Optimal Control Problems for Linear SystemsLarge-Scale Scientific Computing | 1 Jan 2006
- Optimization methods for the verification of second order sufficient conditions for bang–bang controlsOptimal Control Applications and Methods, Vol. 26, No. 3 | 1 April 2005
- Sensitivity analysis of optimal control problems with bang-bang controls42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475) | 1 Jan 2003
View Options
- Access via your Institution
- Questions about how to access this content? Contact SIAM at [email protected].