The Adaptive PID Controlling Algorithm Using Asynchronous Advantage Actor-Critic Learning Method

Sun, Qifeng and Ren, Hui and Duan, Youxiang and Yan, Yanan (2019) The Adaptive PID Controlling Algorithm Using Asynchronous Advantage Actor-Critic Learning Method. In: Simulation Tools and Techniques. 11th International Conference, SIMUtools 2019, Chengdu, China, July 8–10, 2019, Proceedings.

[thumbnail of 34496.pdf] PDF
34496.pdf

Download (602kB)

Abstract

To address the problems of the slow convergence and inefficiency in the existing adaptive PID controllers, we proposed a new adaptive PID controller using the Asynchronous Advantage Actor-Critic (A3C) algorithm. Firstly, the controller can parallel train the multiple agents of the Actor-Critic (AC) structures exploiting the multi-thread asynchronous learning characteristics of the A3C structure. Secondly, in order to achieve the best control effect, each agent uses a multilayer neural network to approach the strategy function and value function to search the best parameter-tuning strategy in continuous action space. The simulation results indicated that our proposed controller can achieve the fast convergence and strong adaptability compared with conventional controllers.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Date Deposited: 04 Mar 2026 12:33
Last Modified: 20 Nov 2026 11:03
URI: https://eprints.eai.eu/id/eprint/25157

Actions (login required)

View Item
View Item