Deep Deterministic Policy Gradient for High-Speed Train Trajectory Optimization

Lingbin Ning, Min Zhou*, Zhuopu Hou, Rob M.P. Goverde, Fei Yue Wang, Hairong Dong

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

7 Citations (Scopus)
6 Downloads (Pure)

Abstract

This paper proposes a novel train trajectory optimization approach for high-speed railways. We restrict our attention to single train operation scenarios with different scheduled/rescheduled running times aiming at generating optimal train recommended trajectories in real time, which can ensure punctuality and energy efficiency of train operation. A learning-based approach deep deterministic policy gradient (DDPG) is designed to generate optimal train trajectories based on the offline training from the interaction between the agent and the trajectory simulation environment. An allocating running time and selecting operation modes (ARTSOM) algorithm is proposed to improve train punctuality and give a series of discrete operation modes (full traction, cruising, coasting, full braking), and thus to produce a feasible training set for DDPG, which can speed up the training process. Numerical experiments show that an optimized speed profile can be generated by DDPG within seconds on a realistic railway line. In addition, the results demonstrate the generalization ability of trained DDPG in solving TTO problems with different running times and line conditions.

Original languageEnglish
Pages (from-to)11562-11574
Number of pages13
JournalIEEE Transactions on Intelligent Transportation Systems
Volume23
Issue number8
DOIs
Publication statusPublished - 2022

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • deep deterministic policy gradient
  • energy efficiency
  • High-speed railway
  • train trajectory optimization

Fingerprint

Dive into the research topics of 'Deep Deterministic Policy Gradient for High-Speed Train Trajectory Optimization'. Together they form a unique fingerprint.

Cite this