Dynamic Expectation Maximization Algorithm for Estimation of Linear Systems with Colored Noise

Research output: Contribution to journalArticleScientificpeer-review

13 Downloads (Pure)

Abstract

The free energy principle from neuroscience has recently gained traction as one of the most prominent brain theories that can emulate the brain’s perception and action in a bio-inspired manner. This renders the theory with the potential to hold the key for general artificial intelligence. Leveraging this potential, this paper aims to bridge the gap between neuroscience and robotics by reformulating an FEP-based inference scheme—Dynamic Expectation Maximization—into an algorithm that can perform simultaneous state, input, parameter, and noise hyperparameter estimation of any stable linear state space system subjected to colored noises. The resulting estimator was proved to be of the form of an augmented coupled linear estimator. Using this mathematical formulation, we proved that the estimation steps have theoretical guarantees of convergence. The algorithm was rigorously tested in simulation on a wide variety of linear systems with colored noises. The paper concludes by demonstrating the superior performance of DEM for parameter estimation under colored noise in simulation, when compared to the state-of-the-art estimators like Sub Space method, Prediction Error Minimization (PEM), and Expectation Maximization (EM) algorithm. These results contribute to the applicability of DEM as a robust learning algorithm for safe robotic applications.
Original languageEnglish
Article number1306
Number of pages33
JournalEntropy
Volume23
Issue number10
DOIs
Publication statusPublished - 2021

Keywords

  • free energy principle
  • system identification
  • linear time-invariant (LTI) systems
  • colored noise
  • state space models
  • robotics

Fingerprint

Dive into the research topics of 'Dynamic Expectation Maximization Algorithm for Estimation of Linear Systems with Colored Noise'. Together they form a unique fingerprint.

Cite this