A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles

Jingyi Xu, Z. Li, Li Gao, Junyi Ma, Qi Liu, Yanan Zhao

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

7 Citations (Scopus)
26 Downloads (Pure)

Abstract

The deep reinforcement learning-based energy management strategies (EMS) have become a promising solution for hybrid electric vehicles (HEVs). When driving cycles are changed, the neural network will be retrained, which is a time-consuming and laborious task. A more efficient way of choosing EMS is to combine deep reinforcement learning (DRL) with transfer learning, which can transfer knowledge of one domain to the other new domain, making the network of the new domain reach convergence values quickly. Different exploration methods of DRL, including adding action space noise and parameter space noise, are compared against each other in the transfer learning process in this work. Results indicate that the network added parameter space noise is more stable and faster convergent than the others. In conclusion, the best exploration method for transferable EMS is to add noise in the parameter space, while the combination of action space noise and parameter space noise generally performs poorly. Our code is available at https://github.com/BIT-XJY/RL-based-Transferable-EMS.git.
Original languageEnglish
Title of host publicationProceedings of the 2022 IEEE Intelligent Vehicles Symposium (IV)
PublisherIEEE
Pages470-477
Number of pages8
ISBN (Electronic)9781665488211
ISBN (Print)978-1-6654-8821-1
DOIs
Publication statusPublished - 2022
Event2022 IEEE Intelligent Vehicles Symposium (IV) - Aachen, Germany
Duration: 5 Jun 20229 Jun 2022

Conference

Conference2022 IEEE Intelligent Vehicles Symposium (IV)
Country/TerritoryGermany
CityAachen
Period5/06/229/06/22

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Fingerprint

Dive into the research topics of 'A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles'. Together they form a unique fingerprint.

Cite this