Loading [a11y]/accessibility-menu.js
Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization | IEEE Journals & Magazine | IEEE Xplore

Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization


Abstract:

Given an undirected graph G = (N, E) of agents N = {1,..., N} connected with edges in E, we study how to compute an optimal decision on which there is consensus among age...Show More

Abstract:

Given an undirected graph G = (N, E) of agents N = {1,..., N} connected with edges in E, we study how to compute an optimal decision on which there is consensus among agents and that minimizes the sum of agent-specific private convex composite functions {Φi}i∈N, where Φi ≐ ξi + fi belongs to agent-i. Assuming only agents connected by an edge can communicate, we propose a distributed proximal gradient algorithm (DPGA) for consensus optimization over both unweighted and weighted static (undirected) communication networks. In one iteration, each agent-i computes the prox map of ξi and gradient of fi, and this is followed by local communication with neighboring agents. We also study its stochastic gradient variant, SDPGA, which can only access to noisy estimates of ∇fi at each agent-i. This computational model abstracts a number of applications in distributed sensing, machine learning and statistical inference. We show ergodic convergence in both suboptimality error and consensus violation for the DPGA and SDPGA with rates O(1/t) and O(1/√t), respectively.
Published in: IEEE Transactions on Automatic Control ( Volume: 63, Issue: 1, January 2018)
Page(s): 5 - 20
Date of Publication: 07 June 2017

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.