Synergistic Offline-Online Control Synthesis via Local Gaussian Process Regression

John Jackson, L. Laurenti, Eric Frew, Morteza Lahijanian

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review


Autonomous systems often have complex and possibly unknown dynamics due to, e.g., black-box components. This leads to unpredictable behaviors and makes control design with performance guarantees a major challenge. This paper presents a data-driven control synthesis framework for such systems subject to linear temporal logic on finite traces (LTLf) specifications. The framework combines a baseline (offline) controller with a novel online controller and refinement procedure that improves the baseline guarantees as new data is collected. The baseline controller is computed offline on an uncertain abstraction constructed using Gaussian process (GP) regression on a given dataset. The offline controller provides a lower bound on the probability of satisfying the LTLf specification, which may be far from optimal due to both discretization and regression errors. The synergy arises from the online controller using the offline abstraction along with the current state and new data to choose the next best action. The online controller may improve the baseline guarantees since it avoids the discretization error and reduces regression error as new data is collected. The new data are also used to refine the abstraction and offline controller using local GP regression, which significantly reduces the computation overhead. Evaluations show the efficacy of the proposed offline-online framework, especially when compared against the offline controller.
Original languageEnglish
Title of host publicationProceedings of the 60th IEEE Conference on Decision and Control (CDC 2021)
ISBN (Print)978-1-6654-3659-5
Publication statusPublished - 2021
Event60th IEEE Conference on Decision and Control (CDC 2021) - Austin, United States
Duration: 14 Dec 202117 Dec 2021


Conference60th IEEE Conference on Decision and Control (CDC 2021)
Country/TerritoryUnited States


Dive into the research topics of 'Synergistic Offline-Online Control Synthesis via Local Gaussian Process Regression'. Together they form a unique fingerprint.

Cite this