Skip to main content
SpringerLink
Log in

Achieving geometric convergence for distributed optimization with Barzilai-Borwein step sizes

  • Letter
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Wang Y H, Lin P, Hong Y G. Distributed regression estimation with incomplete data in multi-agent networks. Sci China Inf Sci, 2018, 61: 092202

    Article  MathSciNet  Google Scholar 

  2. Yu W W, Li C J, Yu X H, et al. Economic power dispatch in smart grids: a framework for distributed optimization and consensus dynamics. Sci China Inf Sci, 2018, 61: 012204

    Article  Google Scholar 

  3. Nedić A, Ozdaglar A. Distributed subgradient methods for multi-agent optimization. IEEE Trans Automat Contr, 2009, 54: 48–61

    Article  MathSciNet  MATH  Google Scholar 

  4. Shi W, Ling Q, Wu G, et al. EXTRA: an exact first-order algorithm for decentralized consensus optimization. SIAM J Optim, 2015, 25: 944–966

    Article  MathSciNet  MATH  Google Scholar 

  5. Berahas A S, Bollapragada R, Keskar N S, et al. Balancing communication and computation in distributed optimization. IEEE Trans Automat Contr, 2019, 64: 3141–3155

    Article  MathSciNet  MATH  Google Scholar 

  6. Xu J, Zhu S, Soh Y C, et al. Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes. In: Proceedings of IEEE Conference on Decision and Control, Osaka, 2015. 2055–2060

  7. Nedić A, Olshevsky A, Shi W, et al. Geometrically convergent distributed optimization with uncoordinated step-sizes. In: Proceedings of American Control Conference, Seattle, 2017. 3950–3955

  8. Huang N, Dai Y H, Burdakov O. Stabilized Barzilai-Borwein method. J Comput Math, 2019, 37: 916–936

    Article  MathSciNet  MATH  Google Scholar 

  9. Tan C H, Ma S Q, Dai Y H, et al. Barzilai-Borwein step size for stochastic gradient descent. In: Proceedings of Annual Conference on Neural Information Processing Systems, Barcelona, 2016. 685–693

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant Nos. 11671116, 12071108, 11701137, 91630202) and Strategic Priority Research Program of CAS (Grant No. XDA27000000).

Author information

Authors and Affiliations

  1. School of Artificial Intelligence, Hebei University of Technology, Tianjin, 300401, China

    Juan Gao & Peng Yang

  2. Institute of Mathematics, Hebei University of Technology, Tianjin, 300401, China

    Xin-Wei Liu & Yakui Huang

  3. LSEC, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, 100190, China

    Yu-Hong Dai

  4. School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, 100049, China

    Yu-Hong Dai

Authors
  1. Juan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xin-Wei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yu-Hong Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yakui Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xin-Wei Liu.

Additional information

Supporting information

Appendixes A—D. The supporting information is available online at info.scichina.com and link.springer.com. The supporting materials are published as submitted, without typesetting or editing. The responsibility for scientific accuracy and content remains entirely with the authors.

Supplementary File

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, J., Liu, XW., Dai, YH. et al. Achieving geometric convergence for distributed optimization with Barzilai-Borwein step sizes. Sci. China Inf. Sci. 65, 149204 (2022). https://doi.org/10.1007/s11432-020-3256-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-020-3256-x

Search

Navigation