A neural network PID-like controller using a hybrid of online Actor-Critic reinforcement algorithm with the square root cubature Kalman filter

dc.contributor.authorSento, Adna
dc.contributor.authorKitjaidure, Yuttana
dc.date.accessioned2026-08-06T10:18:42Z
dc.date.available2026-08-06T10:18:42Z
dc.date.issued2018-01-01
dc.description.abstractThis paper presents a new model of the Neural Network PID-Like controller using an Actor-Critic reinforcement algorithm, called the Neural Network PID-Like controller using an Actor-Critic reinforcement algorithm (NNPID-AC). The proposed NNPID-AC controller is designed to develop the performances and the speed of calculation under the iterative learning algorithm. In the learning algorithm, the critic algorithm receives the reward value and control input to criticize the current state using the action-state value function approximation. Furthermore, instead of applying every available action to predict the local successor state, the algorithm only uses one-step estimation using the fifth degree spherical-radial cubature rule algorithm. To evaluate the proposed NNPID-AC controller, the robot arm MATLAB simulations have been implemented and provide the control system with the load and noise to prove the robustness and fault tolerance, respectively. From the results, the robot arm control system simulation under the control of the proposed NNPID-AC controller can potentially track the error and gives the best responses compared with the other conventional controller either with or without the load and the noise disturbance.
dc.identifier.citationInternational Journal of Intelligent Engineering and Systems, 11(6), 261-270, 2018
dc.identifier.doi10.22266/IJIES2018.1231.26
dc.identifier.issn2185310X
dc.identifier.other2-s2.0-85062103865
dc.identifier.urihttps://dspace.kmitl.ac.th/handle/123456789/8231
dc.sourceInternational Journal of Intelligent Engineering and Systems
dc.subjectActor-critic reinforcement learning algorithm
dc.subjectIntelligent system
dc.subjectNeural network controller
dc.subjectNonlinear dynamic control system
dc.titleA neural network PID-like controller using a hybrid of online Actor-Critic reinforcement algorithm with the square root cubature Kalman filter
dc.typeArticle

Files

Collections