Education Article
Privacy-preserving weighted average consensus and optimal attacking strategy for multi-agent networks

https://doi.org/10.1016/j.jfranklin.2021.01.039Get rights and content

Abstract

This paper proposes a privacy-preserving consensus algorithm which enables all the agents in the directed network to eventually reach the weighted average of initial states, and while preserving the privacy of the initial state of each agent. A novel privacy-preserving scheme is proposed in our consensus algorithm where initial states are hidden in random values. We also develop detailed analysis based on our algorithm, including its convergence property and the topology condition of privacy leakages for each agent. It can be observed that final consensus point is independent of their initial values that can be arbitrary random values. Besides, when an eavesdropper exists and can intercept the data transmitted on the edges, we introduce an index to measure the privacy leakage degree of agents, and then analyze the degree of privacy leakage for each agent. Similarly, the degree for network privacy leakage is derived. Subsequently, we establish an optimization problem to find the optimal attacking strategy, and present a heuristic optimization algorithm based on the Sequential Least Squares Programming (SLSQP) to solve the proposed optimization problem. Finally, numerical experiments are designed to demonstrate the effectiveness of our algorithm.

Introduction

In the past few decades, considerable interests have been focused on the average consensus studies of multi-agent networks [1], [2], [3], [4], [5] due to its extensive real applications, such as dynamic load balancing [6], coordination of groups of mobile autonomous agents [7] and cooperative control of vehicle formations [8]. A survey of theory and applications of consensus problems in networked systems is presented in [9]. One of the fundamental problems in average consensus studies is how to design a consensus algorithm which can enable the states of all agents reach the average initial value of all agents. In traditional average consensus algorithms, if one agent knows the update rules of all other agents, then under some observability conditions, it can infer the initial states of all other agents [22] such that the privacy of initial states is leaked. From the privacy-preserving perspective, the participating agents may not want to expose their initial values in the process of achieving the average consensus. For example, in social networks, a group of individuals can execute a prescribed procedure to obtain the common opinion on a subject [10]. However, they may not want to reveal their exact personal opinion on the subject. Another example is the multi-agent rendezvous problem [11], where all agents are committed to eventually rendezvousing at a certain location, but they want to keep their initial location secret to the others. Hence, preserving the privacy of initial states becomes an important research topic.

This paper develops a privacy-reserving average consensus algorithm for the directed connected network in the presence of an eavesdropper. Specially, we propose a novel privacy-preserving scheme to hide the initial states in random noises. Subsequently, we introduce an index to measure the degree of agent privacy leakage under attacks. An optimization problem to find the optimal attacking strategy is established, and a heuristic optimization algorithm based on the Sequential Least Squares Programming (SLSQP) for solving the optimization problem is presented. The major contributions of this paper are summarized as the following four aspects:

  • A privacy-reserving average consensus algorithm for the directed connected network is developed, which not only preserves the privacy of the initial states, but also achieves the weighted average consensus. Unlike the existing privacy-preserving method, the initial states of agents are hidden in random values, that is, the initial state is equal to the specific random values generated. In this case, the consensus point is the linear combination of random values, and depends on the random values.

  • The theoretical analysis results are developed, including consensus analysis and topology condition analysis of privacy leakages for each agent. These results are also verified by numerical examples.

  • We propose a measure index for the degree of privacy leakage, based on which, the degree of privacy leakage under attacks is derived for agents and network, respectively.

  • A heuristic optimization algorithm based on the SLSQP to search for the optimal attacking strategy is presented.

The remainder of this paper is structured as follows. In Section 2, we provide the related work. In Section 3, we introduce the notations, and present the graph theory for communication network. Also, we give a novel privacy-preserving scheme. The main results are established in Section 4, including four parts. First, the consensus analysis based on the proposed algorithm is presented. Second, the privacy preserving condition analysis is provided. Third, the degree of agent privacy leakage under attacks is derived based on the proposed measure index. Fourth, a heuristic optimization algorithm based on the SLSQP to find the optimal attacking strategy is established. Section 5 provides some numerical examples to testify the effectiveness of our results. Section 6 contains some main conclusions and further research.

Section snippets

Related work

The study of average consensus algorithms has attracted considerable attention in recent years, and all sorts of average consensus algorithms have emerged for different dynamic systems [12], [13], [14], [15], [16]. For example, in [12], a proportional and derivative-like average consensus algorithm for multi-agent systems with linear and Lipschitz nonlinear dynamics under a switching topology is proposed. In [13], a decentralized event-triggered average consensus protocol for multi-agent

Notations

Some notations used in this paper are given in the following. Let RN and RN×N denote the set of N-dimensional real column vectors and the set of N-dimensional real square matrices, respectively. Im is the m×m dimensional identity matrix. Let 1 denote a column vector with all entries equal to one. (·)T represents the transpose of a matrix or a vector. Let x be the standard Euclidean norm for a vector x. A represents the F-norm for the matrix A. Let ei denote the ith canonical basis in RN

Consensus analysis

In this subsection, the consensus analysis results under the algorithm (6) are established.

Theorem 1

Under the average consensus algorithm (6), x(t) converges to 1·x¯(0), i.e.,limtx(t)1·x¯(0)=0.

Proof

According to the above privacy-preserving scheme, the real initial value xir(0) of each agent i is di(1)+di(2)++di(mi), that is, xir(0)=l=1midi(l). And the weighted average of the initial states of all agents isx¯(0)=i=1Nwixir(0)=i=1Nwil=1midi(l)=l=1MwTd(l),

Since di(l)=0,mi<l, the third equation holds.

Simulation examples

Example 1

In this section, we verify the performance of the proposed algorithm (2). The directed graph is shown in Fig. 2, which is directed and connected. And, the weighted matrix is as followsA=[0.20.8000000.700.3000.300.400.3000.50.10.200.2000.600.4000000.80.2].

The Perror vector of the weighted matrix A can be calculated, and it isw=[0.06120.43540.16330.16330.13610.0408]T.

Meanwhile, we change the weighted matrix A to be doubly stochastic. Simulation results on agents’ consensus are discussed based on

Conclusion and future work

In this paper, we investigate the privacy-reserving average consensus problem, where all the agents in the directed network eventually reach the weighted average of initial states, and the privacy of the initial state of each agent is preserved. We propose a novel privacy-preserving scheme such that initial states of all agents are hidden in random values. We also develop detailed analysis based on our algorithm, including its convergence properties and the topology condition of privacy

Declaration of Competing Interest

There is no conflict of interest in the revise submission of this manuscript, and manuscript is approved by all authors for publication. I would like to declare on behalf of my co-authors that the work described was original research that has not been published previously.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (Grant no. 61603065), in part by the Science and Technology Research Program of Chongqing Municipal Education Commission (Grant no. KJQN201901101), and in part by Scientific Research Foundation of Chongqing University of Technology (Grant no. 2019ZD104 and 2019ZD113).

References (29)

  • G. Cybenko

    Dynamic load balancing for distributed memory multiprocessors

    J. Parallel Distrib. Comput.,

    (1989)
  • H. Zhang et al.

    Online deception attack against remote state estimation

    IFAC Proc. Vol.

    (2014)
  • S. Tan et al.

    Analysis and control of networked game dynamics via a microscopic deterministic approach

    IEEE Trans. Autom. Control

    (2016)
  • H. Yu et al.

    Consensus of data-sampled multi-agent systems with markovian switching topologies

    Asian J. Control,

    (2012)
  • Z. Ji et al.

    Protocols design and uncontrollable topologies construction for multi-agent networks

    IEEE Trans. Autom. Control,

    (2015)
  • A. Wang et al.

    On the general consensus protocol in multi-agent networks with second-order dynamics and sampled data

    Asian J. Control,

    (2016)
  • X. Meng et al.

    Optimal sampling and performance comparison of periodic and event based impulse control

    IEEE Trans. Autom. Control,

    (2012)
  • A. Jadbabaie et al.

    Coordination of groups of mobile autonomous agents using nearest neighbor rules

    IEEE Trans. Autom. Control,

    (2003)
  • W. Ren et al.

    A survey of consensus problems in multi-agent coordination

    Proceedings of the American Control Conference

    (2005)
  • R. Olfati-Saber et al.

    Consensus and cooperation in networked multi-agent systems

    Proc. IEEE,

    (2007)
  • M. DeGroot

    Reaching a consensus

    J. Am. Stat. Assoc.

    (1974)
  • J. Lin et al.

    The multi-agent rendezvous problem

    Proceedings of the 42nd IEEE Conference on Decision and Control,

    (2003)
  • D. Wang et al.

    A PD-like protocol with a time delay to average consensus control for multi-agent systems under an arbitrarily fast switching topology

    IEEE Trans. Cybern.

    (2017)
  • Z. Wang et al.

    Decentralized event-triggered average consensus for multi-agent systems in CPSs with communication constraints

    IEEE/CAA J. Autom. Sin.

    (2015)
  • Cited by (0)

    View full text