Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems
This thesis describes the development of an efficient algorithm for solving nonlinear stochastic optimal control problems in discrete-time based on the principle of model-reality differences. The main idea is the integration of optimal control and parameter estimation. In this work, a simplified...
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
2011
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/3019/1/24p%20KEK%20SIE%20LONG.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my-uthm-ep.3019 |
|---|---|
| record_format |
uketd_dc |
| spelling |
my-uthm-ep.30192021-11-02T01:39:28Z Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems 2011-06 Kek, Sie Long QA Mathematics QA299.6-433 Analysis This thesis describes the development of an efficient algorithm for solving nonlinear stochastic optimal control problems in discrete-time based on the principle of model-reality differences. The main idea is the integration of optimal control and parameter estimation. In this work, a simplified model-based optimal control model with adjustable parameters is constructed. As such, the optimal state estimate is applied to design the optimal control law. The output is measured from the model and used to adapt the adjustable parameters. During the iterative procedure, the differences between the real plant and the model used are captured by the adjustable parameters. The values of these adjustable parameters are updated repeatedly. In this way, the optimal solution of the model will approach to the true optimum of the original optimal control problem. Instead of solving the original optimal control problem, the model-based optimal control problem is solved. The algorithm developed in this thesis contains three sub-algorithms. In the first sub-algorithm, the state mean propagation removes the Gaussian white noise to obtain the expected solution. Furthermore, the accuracy of the state estimate with the smallest state error covariance is enhanced by using the Kalman filtering theory. This enhancement produces the filtering solution by using the second sub-algorithm. In addition, an improvement is made in the third sub-algorithm where the minimum output residual is combined with the cost function. In this way, the real solution is closely approximated. Through the practical examples, the applicability, efficiency and effectiveness of these integrated sub-algorithms have been demonstrated through solving several practical real world examples. In conclusion, the principle of modelreality differences has been generalized to cover a range of discrete-time nonlinear optimal control problems, both for deterministic and stochastic cases, based on the proposed modified linear optimal control theory. 2011-06 Thesis http://eprints.uthm.edu.my/3019/ http://eprints.uthm.edu.my/3019/1/24p%20KEK%20SIE%20LONG.pdf text en public phd doctoral Universiti Teknologi Malaysia Fakulti Sains |
| institution |
Universiti Tun Hussein Onn Malaysia |
| collection |
UTHM Institutional Repository |
| language |
English |
| topic |
QA Mathematics QA299.6-433 Analysis |
| spellingShingle |
QA Mathematics QA299.6-433 Analysis Kek, Sie Long Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| description |
This thesis describes the development of an efficient algorithm for solving
nonlinear stochastic optimal control problems in discrete-time based on the principle
of model-reality differences. The main idea is the integration of optimal control and
parameter estimation. In this work, a simplified model-based optimal control model
with adjustable parameters is constructed. As such, the optimal state estimate is
applied to design the optimal control law. The output is measured from the model
and used to adapt the adjustable parameters. During the iterative procedure, the
differences between the real plant and the model used are captured by the adjustable
parameters. The values of these adjustable parameters are updated repeatedly. In this
way, the optimal solution of the model will approach to the true optimum of the
original optimal control problem. Instead of solving the original optimal control
problem, the model-based optimal control problem is solved. The algorithm
developed in this thesis contains three sub-algorithms. In the first sub-algorithm, the
state mean propagation removes the Gaussian white noise to obtain the expected
solution. Furthermore, the accuracy of the state estimate with the smallest state error
covariance is enhanced by using the Kalman filtering theory. This enhancement
produces the filtering solution by using the second sub-algorithm. In addition, an
improvement is made in the third sub-algorithm where the minimum output residual
is combined with the cost function. In this way, the real solution is closely
approximated. Through the practical examples, the applicability, efficiency and
effectiveness of these integrated sub-algorithms have been demonstrated through
solving several practical real world examples. In conclusion, the principle of modelreality
differences has been generalized to cover a range of discrete-time nonlinear
optimal control problems, both for deterministic and stochastic cases, based on the
proposed modified linear optimal control theory. |
| format |
Thesis |
| qualification_name |
Doctor of Philosophy (PhD.) |
| qualification_level |
Doctorate |
| author |
Kek, Sie Long |
| author_facet |
Kek, Sie Long |
| author_sort |
Kek, Sie Long |
| title |
Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| title_short |
Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| title_full |
Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| title_fullStr |
Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| title_full_unstemmed |
Integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| title_sort |
integrated optimal control and parameter estimation algorithms for discrete-time nonlinear stochastic dynamical systems |
| granting_institution |
Universiti Teknologi Malaysia |
| granting_department |
Fakulti Sains |
| publishDate |
2011 |
| url |
http://eprints.uthm.edu.my/3019/1/24p%20KEK%20SIE%20LONG.pdf |
| _version_ |
1747831013080301568 |