Control and System Theory of Discrete-Time Stochastic Systems

Research output: Book/ReportBookScientific


This book helps students, researchers, and practicing engineers to understand the theoretical framework of control and system theory for discrete-time stochastic systems so that they can then apply its principles to their own stochastic control systems and to the solution of control, filtering, and realization problems for such systems. Applications of the theory in the book include the control of ships, shock absorbers, traffic and communications networks, and power systems with fluctuating power flows.
The focus of the book is a stochastic control system defined for a spectrum of probability distributions including Bernoulli, finite, Poisson, beta, gamma, and Gaussian distributions. The concepts of observability and controllability of a stochastic control system are defined and characterized. Each output process considered is, with respect to conditions, represented by a stochastic system called a stochastic realization. The existence of a control law is related to stochastic controllability while the existence of a filter system is related to stochastic observability. Stochastic control with partial observations is based on the existence of a stochastic realization of the filtration of the observed process.​
Original languageEnglish
Number of pages923
ISBN (Electronic)978-3-030-66952-2
ISBN (Print)978-3-030-66951-5
Publication statusPublished - 2021

Publication series

Name Communications and Control Engineering
ISSN (Print)0178-5354
ISSN (Electronic)2197-7119


  • Stochastic Systems
  • Control Theory
  • Filtering and Prediction
  • Stochastic Realization
  • Control with Partial Observations
  • Stochastic Control
  • Optimal State Estimation
  • Linear Filtering


Dive into the research topics of 'Control and System Theory of Discrete-Time Stochastic Systems'. Together they form a unique fingerprint.

Cite this