Safe Curriculum Learning for Linear Systems with Parametric Unknowns in Primary Flight Control

D.D.C. De Buysscher, T.S.C. Pollack, E. van Kampen

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

1 Citation (Scopus)
44 Downloads (Pure)

Abstract

Safe Curriculum Learning aims at improving safety and efficiency aspects of Reinforcement Learning (RL). Curricular RL approaches divide a task into stages of increasing complexity in order to increase efficiency. This paper proposes a black box safe curriculum learning architecture applicable to systems with parametric unknowns. The agent domain solely requires knowledge of the state and action spaces’ dimensions for a given task and system. By adding system identification capabilities to existing safe curriculum learning paradigms, the proposed architecture ensures safe learning of tracking tasks without requiring initial knowledge of the system dynamics. A model estimate is generated online to complement safety filters that rely on uncertain models for their safety guarantees. This research explicitly targets linearised systems with decoupled dynamics. The paradigm is initially verified on a mass-spring-damper system, after which it is applied to a quadrotor altitude and attitude tracking task. The RL agent is able to safely learn an optimal policy that can track an independent reference on each degree of freedom.
Original languageEnglish
Title of host publicationAIAA SCITECH 2022 Forum
Number of pages23
ISBN (Electronic)978-1-62410-631-6
DOIs
Publication statusPublished - 2022
EventAIAA SCITECH 2022 Forum - virtual event
Duration: 3 Jan 20227 Jan 2022

Publication series

NameAIAA Science and Technology Forum and Exposition, AIAA SciTech Forum 2022

Conference

ConferenceAIAA SCITECH 2022 Forum
Period3/01/227/01/22

Fingerprint

Dive into the research topics of 'Safe Curriculum Learning for Linear Systems with Parametric Unknowns in Primary Flight Control'. Together they form a unique fingerprint.

Cite this