IEEE Transactions on Neural Networks and Learning Systems, Volume 35, Issue 10, Pages 13453-13460 , 01/01/2024

Discrete-Time Reinforcement Learning Adaptive Control for Non-Gaussian Distribution of Sampling Intervals

C. Treesatayapun

Abstract

This article proposes an optimal controller based on reinforcement learning (RL) for a class of unknown discrete-time systems with non-Gaussian distribution of sampling intervals. The critic and actor networks are implemented using the MiFRENc and MiFRENa architectures, respectively. The learning algorithm is developed with learning rates determined through convergence analysis of internal signals and tracking errors. Experimental systems with a comparative controller are conducted to validate the proposed scheme, and comparative results show superior performance for non-Gaussian distributions, with weight transfer for the critic network omitted. Additionally, the proposed learning laws, using the estimated co-state, significantly improve dead-zone compensation and nonlinear variation.

Document Type

Article

Source Type

Journal

Keywords

Dead-zonediscrete-time systemsfuzzy rules emulated networksnon-Gaussian distribution samplingreinforcement learning (RL)

ASJC Subject Area

Computer Science : SoftwareComputer Science : Computer Science ApplicationsComputer Science : Computer Networks and CommunicationsComputer Science : Artificial Intelligence


Bibliography


& Treesatayapun, C. (2024). Discrete-Time Reinforcement Learning Adaptive Control for Non-Gaussian Distribution of Sampling Intervals. IEEE Transactions on Neural Networks and Learning Systems, 35(10) 13453-13460. doi:10.1109/TNNLS.2023.3269441

Copy | Save