TY - JOUR
T1 - System Identification Based on Generalized Orthonormal Basis Function for Unmanned Helicopters
T2 - A Reinforcement Learning Approach
AU - Liu, Zun
AU - Li, Jianqiang
AU - Wang, Cheng
AU - Yu, Richard
AU - Chen, Jie
AU - He, Ying
AU - Sun, Changyin
N1 - Publisher Copyright:
© 1967-2012 IEEE.
PY - 2021/2
Y1 - 2021/2
N2 - System identification is very important for the controller design of unmanned helicopters, and it has significant impacts on the quality of flight missions. With the recent advances of reinforcement learning, we propose a generalized orthonormal basis function (GOBF)-based system identification scheme for unmanned helicopters. Using GOBF, the traditional parameter estimation problem in system identification not only becomes better numerical conditioned but also can be affected by the prior knowledge. The proposed novel GOBF-based system identification scheme can enable users to make good use of prior knowledge due to the learning capability of reinforcement learning. In addition, there is a theoretical guarantee of convergence in the proposed GOBF-based system identification scheme. Moreover, we develop an additional self-optimization process based on Bayes theory to enhance the robustness of the scheme and improve the search efficiency of the proposed scheme. Both simulations and practical experiments show the effectiveness and advantages of our proposed scheme.
AB - System identification is very important for the controller design of unmanned helicopters, and it has significant impacts on the quality of flight missions. With the recent advances of reinforcement learning, we propose a generalized orthonormal basis function (GOBF)-based system identification scheme for unmanned helicopters. Using GOBF, the traditional parameter estimation problem in system identification not only becomes better numerical conditioned but also can be affected by the prior knowledge. The proposed novel GOBF-based system identification scheme can enable users to make good use of prior knowledge due to the learning capability of reinforcement learning. In addition, there is a theoretical guarantee of convergence in the proposed GOBF-based system identification scheme. Moreover, we develop an additional self-optimization process based on Bayes theory to enhance the robustness of the scheme and improve the search efficiency of the proposed scheme. Both simulations and practical experiments show the effectiveness and advantages of our proposed scheme.
KW - Generalized orthonormal basis function
KW - reinforcement learning
KW - system identification
KW - unmanned helicopters
UR - https://www.scopus.com/pages/publications/85099679671
U2 - 10.1109/TVT.2021.3051696
DO - 10.1109/TVT.2021.3051696
M3 - 文章
AN - SCOPUS:85099679671
SN - 0018-9545
VL - 70
SP - 1135
EP - 1145
JO - IEEE Transactions on Vehicular Technology
JF - IEEE Transactions on Vehicular Technology
IS - 2
M1 - 9324980
ER -