Derivation and Analysis of the Primal-Dual Method of Multipliers Based on Monotone Operator Theory

Thomas William Sherson, Richard Heusdens, W. Bastiaan Kleijn

Research output: Contribution to journalArticleScientificpeer-review

9 Citations (Scopus)
57 Downloads (Pure)

Abstract

In this paper, we present a novel derivation of an existing algorithm for distributed optimization termed the primal-dual method of multipliers (PDMM). In contrast to its initial derivation, monotone operator theory is used to connect PDMM with other first-order methods such as Douglas-Rachford splitting and the alternating direction method of multipliers, thus, providing insight into its operation. In particular, we show how PDMM combines a lifted dual form in conjunction with Peaceman-Rachford splitting to facilitate distributed optimization in undirected networks. We additionally demonstrate sufficient conditions for primal convergence for strongly convex differentiable functions and strengthen this result for strongly convex functions with Lipschitz continuous gradients by introducing a primal geometric convergence bound.

Original languageEnglish
Article number8496887
Pages (from-to)334-347
Number of pages14
JournalIEEE Transactions on Signal and Information Processing over Networks
Volume5
Issue number2
DOIs
Publication statusPublished - 2019

Keywords

  • distributed optimization
  • monotone operator
  • Primal-Dual method of multipliers (PDMM)

Cite this