Energies, Volume 18, Issue 15 , 01/08/2025

Electric Vehicle Energy Management Under Unknown Disturbances from Undefined Power Demand: Online Co-State Estimation via Reinforcement Learning

C. Treesatayapun, A. J. Munoz-Vazquez, S. K. Korkua, B. Srikarun, C. Pochaiya

Abstract

This paper presents a data-driven energy management scheme for fuel cell and battery electric vehicles, formulated as a constrained optimal control problem. The proposed method employs a co-state network trained using real-time measurements to estimate the control law without requiring prior knowledge of the system model or a complete dataset across the full operating domain. In contrast to conventional reinforcement learning approaches, this method avoids the issue of high dimensionality and does not depend on extensive offline training. Robustness is demonstrated by treating uncertain and time-varying elements, including power consumption from air conditioning systems, variations in road slope, and passenger-related demands, as unknown disturbances. The desired state of charge is defined as a reference trajectory, and the control input is computed while ensuring compliance with all operational constraints. Validation results based on a combined driving profile confirm the effectiveness of the proposed controller in maintaining the battery charge, reducing fluctuations in fuel cell power output, and ensuring reliable performance under practical conditions. Comparative evaluations are conducted against two benchmark controllers: one designed to maintain a constant state of charge and another based on a soft actor–critic learning algorithm.

Document Type

Article

Source Type

Journal

Keywords

co-state optimal controlelectric vehicleenergy management systemonline data-drivenunknown disturbances

ASJC Subject Area

Engineering : Engineering (miscellaneous)Energy : Renewable Energy, Sustainability and the EnvironmentEnergy : Energy (miscellaneous)Energy : Energy Engineering and Power TechnologyEnergy : Fuel TechnologyMathematics : Control and OptimizationEngineering : Electrical and Electronic Engineering


Bibliography


Treesatayapun, C., Munoz-Vazquez, A., Korkua, S., Srikarun, B., & Pochaiya, C. (2025). Electric Vehicle Energy Management Under Unknown Disturbances from Undefined Power Demand: Online Co-State Estimation via Reinforcement Learning. Energies, 18(15) doi:10.3390/en18154062

Copy | Save