Discrete Time Stochastic Adaptive Control
Abstract
This paper establishes global convergence of a stochastic adaptive control algorithm for discrete time linear systems. It is shown that, with probability one, the algorithm will ensure the system inputs and outputs are sample mean square bounded and the conditional mean square output tracking error achieves its global minimum possible value for linear feedback control. Thus, asymptotically, the adaptive control algorithm achieves the same performance as could be achieved if the system parameters were known.
[1] , Adaptive control of single-input, single-output linear systems, IEEE Trans. Automat. Control, 23 (1978), 557–569 10.1109/TAC.1978.1101822 58:26433 0384.93028
[2] , Global Stability of Parameter Adaptive Control Systems, S & IS Report, 7902 R, Yale University, 1979, March
[3] , Discrete-time multivariable adaptive control, IEEE Trans. Automat. Control, 25 (1980), 449–456 10.1109/TAC.1980.1102363 81c:93048 0429.93034
[4] , Analysis of recursive stochastic algorithms, IEEE Trans. Automatic Control, AC-22 (1977), 551–575 10.1109/TAC.1977.1101561 57:5358 0362.93031
[5] , On positive real transfer functions and the convergence of some recursive schemes, IEEE Trans. Automatic Control, AC-22 (1977), 539–551 10.1109/TAC.1977.1101552 56:15049 0361.93063
[6] , Masters Thesis, Time series recursions and stochastic approximation, Ph.D. dissertation, The Australian National University, 1978, Sept.
[7] , On a stabilizing property of adaptive regulators, 1976, Reprint IFAC Symposium on Identification (Tbilisi, USSR)
[8] , On self-tuning regulators, Automatica, 9 (1973), 195–199 0249.93049
[9] , A Course in Probability Theory, Harcourt Brace and World, New York, 1978
[10] , Introduction to Modern Abstract Algebra, Addison-Wesley, Reading, MA, 1967 0189.29401
[11] , Discrete-parameter martingales, North-Holland Publishing Co., Amsterdam, 1975viii+236 53:6729 0345.60026
[12] , Stability Theory of Dynamical Systems, John Wiley, New York, 1970 0222.93010
[13] , Discrete positive-real functions and their application to system stability, Proc. Inst. Elec. Engrs., 116 (1969), 153–155 46:8721
[14] , Stochastic adaptive control: The general delay-colored noise case, Technical Report, 7904, Dept. of Electrical Engineering, University of Newcastle, Australia, 1979, March