Stochastic Control with Partial Observations on a Finite Horizon

Jan H. van Schuppen*

*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volumeChapterScientific

Abstract

In stochastic control with partial observations, the control law at any time can depend only on the past outputs and the past inputs of the stochastic control system. Neither is available to the control law in the current state nor the past states. Control theory for stochastic systems with partial observations is poorly developed and poorly understood. The approach to this control problem is to first determine a stochastic realization of the stochastic control system based on the information structure and second to apply a modified dynamic programming procedure. The approach is illustrated for a Gaussian stochastic control system and for an output-finite–state-finite stochastic control system. The tracking problem is treated.

Original languageEnglish
Title of host publicationControl and System Theory of Discrete-Time Stochastic Systems
EditorsJ.H. van Schuppen
PublisherSpringer
Chapter14
Pages547-598
Number of pages52
ISBN (Electronic)978-3-030-66952-2-14
DOIs
Publication statusPublished - 2021

Publication series

NameCommunications and Control Engineering
ISSN (Print)0178-5354
ISSN (Electronic)2197-7119

Keywords

  • Finite horizon
  • Partial observations
  • Stochastic control

Fingerprint

Dive into the research topics of 'Stochastic Control with Partial Observations on a Finite Horizon'. Together they form a unique fingerprint.

Cite this