A new sensor selection scheme for Bayesian learning based sparse signal recovery in WSNs

https://doi.org/10.1016/j.jfranklin.2017.06.009Get rights and content

Abstract

In this paper, we address the issue of sparse signal recovery in wireless sensor networks (WSNs) based on Bayesian learning. We first formulate a compressed sensing (CS)-based signal recovery problem for the detection of sparse event in WSNs. Then, from the perspective of energy saving and communication overhead reduction of the WSNs, we develop an optimal sensor selection algorithm by employing a lower-bound of the mean square error (MSE) for the MMSE estimator. To tackle the nonconvex difficulty of the optimum sensor selection problem, a convex relaxation is introduced to achieve a suboptimal solution. Both uncorrelated and correlated noises are considered and a low-complexity realization of the sensor selection algorithm is also suggested. Based on the selected subset of sensors, the sparse Bayesian learning (SBL) is utilized to reconstruct the sparse signal. Simulation results illustrate that our proposed approaches lead to a superior performance over the reference methods in comparison.

Introduction

Wireless sensor networks (WSNs) usually consist of a large number of sensor nodes (SNs), which are spread out over fields of interest, where each SN is capable of sensing, processing, and communicating to other nodes or fusion center (FC). WSNs have been extensively studied for environmental monitoring, habitat monitoring, prediction and detection of natural calamities, medical monitoring and structural health monitoring [1]. As SNs are generally small devices with limited battery power, memory, computational capability, and physical size [2], it is important to design WSNs such that the implementation and the associated traffic overhead are as small as possible while preserving the same level of information acquisition and transmission.

In some real-world applications, a physical scenario or event of interest may be described by a sparse signal in the spatial domain. This can be found in a broad range of monitoring applications, such as tracking multiple sources or multiple targets, sensing the underutilized spectrum in a cognitive radio network, and monitoring civil structural health conditions [3], [4], [5]. In these applications, conventional lossy compression techniques such as distributed source coding (DSC) and entropy coding could be exploited [6]. However, these techniques require heavy computational load and communication overhead which are not suitable for implementation in WSNs. As such, compressive sensing (CS) [7] has been employed in WSNs for data acquisition with a small number of measurements [8], [9], [10]. In [8], Haupt et al. investigated CS for networked data in WSNs through considering distributed data sources and their sampling, transmission, and storage. Fazel et al. [9] proposed a compressive sensing based random access scheme with the assumption that the measured signal at sensor nodes is spatially sparse in some basis domain, making it possible to reconstruct the data from under-sampled measurements at FC. In [10], Mamaghanian et al. investigated CS for energy-efficient signals gathering in a wireless body sensor network. All of these works can be viewed as sparse signal recovery problem, and thus, a special effort has been made to develop efficient sparse signal reconstruction methods for CS-based WSNs applications.

Several techniques have been developed based on convex optimization methods [11], [12] and iterative greedy search algorithms [13] for reconstructing the sparse signal from few measurements. Another different strategy to solve the problem is to relax the cost function of the minimization by replacing the l0-norm with lp-norm for some p ∈ (0, 1], and an example is the focal underdetermined system solver (FOCUSS) [14]. Recently, a method called approximate message passing (AMP) [15] has been shown to be an efficient algorithm for solving the optimization problem. Some techniques developed under the probabilistic framework for sparse signal reconstruction have also received a great deal of attention, which exploit priors on the regression coefficients for regularizing the under-determined problem [16]. One method that has attractive properties is so-called sparse Bayesian learning (SBL). It was developed for the relevance vector machine (RVM) [17] and adapted for basis selection from over-complete dictionaries [18]. Later, it was further developed to improve the estimation performance from sparse information [19], [20], [21], and has been shown to outperform many of other schemes in terms of the recovery accuracy [21]. The applications of SBL in WSNs could be found in [22], [23], [24]. In [22], the authors proposed a distributed sparse Bayesian learning (dSBL) algorithm for sparse regression in WSNs based on loopy belief propagation (LBP). In [23], the authors applied a temporal sparse Bayesian learning (T-SBL) algorithm to solve the drift observation equation for estimating sensor drift. In our recent work [24], we investigated multi-target localization using SBL in WSNs from a small number of measurements. However, these measurements are randomly selected. In this paper, we extend our previous work in order to operate in a more general framework with optimal selection of measurements.

Due to the geographical locations of SNs and environmental conditions, the observations from different SNs often differ in their quality and information carried. In order to save communication resources and prolong the network lifetime, it is necessary to select only part of the SNs, identified as active sensor nodes, for transmission of their observations while keeping others, called inactive SNs, sleeping. As such, sensor selection has been actively studied over the last decade. Optimal sensor selection has been a commonly investigated problem, which is generally formulated by selecting the best subset of the available SNs subject to a specific performance constraint. Unfortunately, the optimal sensor selection often turns out to be a combinatorial problem. Therefore, some researchers have resorted to approximation or relaxation to make the problem feasible especially in the case of there being a moderate-to-large number of sensors. A related problem has been studied in [25], where the authors considered a parameter called the volume of the confidence ellipsoid and adopted a convex relaxation technique to simplify the combinatorial problem to a convex one, which can be solved in polynomial time. Liu et al. [26] proposed an optimal node-selection algorithm to select a subset of camera sensors for estimating the location of a target while minimizing the energy cost. Moreover, different optimization criteria can be adopted for optimal sensor selection. For example, the authors in [27] tackled the combinatorial optimization problem of maximizing the mutual information between the chosen sensors and the sensors which are not selected, and provided a polynomial-time approximation algorithm by exploiting the submodularity of mutual information. Furthermore, the authors in [28] have shown that certain structural properties of the sensor selection problem allow recasting it as a maximization of submodular functions over uniform matroids. In [29], the authors selected the sensors with a greedy algorithm by minimizing the coherence between the rows of the sensing matrix.

It is noted that several works have addressed the sensor selection problem in CS-based WSNs [30], [31], [32]. Ling and Tian [30] investigated the problem of monitoring sparse phenomena using a large-scale and distributed WSN, in which compressive data collection is enforced by turning off a fraction of sensors using a simple random node sleeping strategy. In [31], the authors considered a Bayesian compressive sensing approach and proposed two efficient algorithms to decrease the number of active sensor nodes while maintaining a high performance. In [32], the authors formulated the active node selection problem in compressive sleeping WSNs as an optimization problem, which is then approximated by a constrained convex relaxation plus a rounding scheme. However, in these existing literatures, the study of sensor selection problem hinges on the assumption of uncorrelated measurement noises. In general, the noises experienced by the sensors are often correlated, due to the fact that the measurement noises of different sensors may depend on a common parameter [33]. Although the authors in [34] have studied the sensor selection paradigm with correlated measurement noises, yet it is not designed for sparse signal estimation, and thus not suitable for CS-based WSNs. Therefore, it is an important and imperative task to develop sensor selection methods that are applicable to a more practical framework of correlated measurement noises in CS-based WSNs.

Motivated by the observations above, in this paper, we focus on accurate recovery of a sparse signal in WSNs using SBL and a subset of sensory measurements. Our goal is to improve the sparse signal reconstruction performance of the WSNs while using only a subset of sensors. The main contributions of this paper are outlined as follows:

  • (1)

    A new CS-based sparse signal estimation framework is first established with an objective of detecting sparse physical events in WSNs.

  • (2)

    A sensor selection algorithm is then proposed to select the best subset of sensors in the MMSE sense by employing a lower-bound of the MSE. To tackle the nonconvexity of the optimum sensor selection problem, a convex relaxation is introduced, and a reweighted relaxation algorithm is further proposed to obtain a suboptimal solution.

  • (3)

    Both uncorrelated and correlated noises are considered in sensor selection, and an equivalent stochastic optimization method with reduced computational complexity is also developed to solve the sensor selection problem.

  • (4)

    The SBL together with the proposed sensor selection is used for the first time to solve the sparse signal recovery problem in WSNs, which yields an improved signal reconstruction performance as compared with some of the existing methods in literature.

The remainder of this paper is organized as follows. Section 2 describes the problem formulation, and Section 3 presents the new sensor selection methods. Then, in Section 4, SBL is applied to recover the sparse signal in WSNs. Next, we present some experimental results in Section 5. Finally, conclusions are drawn in Section 6.

Section snippets

Problem formulation

We consider a single-hop transmission WSN as shown in Fig. 1, where N sensor nodes are distributed over an area of interest to estimate an unknown signal vector xRN and send measured physical data fi (i=1,2,,N) to the FC. In order to support sensor selection for the sake of saving communication resources [30], we consider the use of a time division multiplexing access (TDMA) based transmission between the SNs and FC. We assume the FC selects part of the SNs according to certain applications,

A lower-bound on MSE

Here, we first introduce some knowledge about estimation error bound for the purpose of selecting the best subset of sensors. Based on the problem statement and the related assumptions in Section 2, we show that it is possible to find a closed-form expression for the MMSE estimation of x given the received signal vector y. The MMSE estimator inherits the following structure [35] x^=SΩγ(S,y)E[x|y,S]where γ(S, y)’s are the weighting coefficients with Sγ(S,y)=1, and E[x|y,S]RN is the

Sparse signal recovery using SBL

In this section, we apply the SBL to reconstruct the sparse signal x. As introduced in [43], a two-layer hierarchical prior model is proposed to promote the sparsity of x. In the first layer, x is assigned a Gaussian prior distribution p(x|α)=i=1Np(xi|αi)where, p(xi|αi)=N(xi|0,αi1), and αΔ={αi}, the inverse variance of the Gaussian distribution, are nonnegative hyperparameters. The second layer specifies Gamma distributions as hyperpriors over the hyperparameters {αi} p(α)=i=1NGamma(αi|a,b)=

Simulation experiments

In this section, we demonstrate the effectiveness of our proposed sensor selection approaches and SBL sparse reconstruction algorithm for CS-based WSNs by simulation using Matlab2015b.

Conclusion

In this paper, we have investigated the problem of recovering sparse signals in CS-based WSNs with sensor selection for both uncorrelated and correlated noises. A lower-bound of the MSE for the MMSE estimator was used as the objective function for our sensor selection. By using the convex relaxation, the sensor selection optimization problem was relaxed into a suboptimal semi-definite program, which has been solved efficiently at the FC. An equivalent stochastic optimization method with reduced

Acknowledgments

This work is supported by the National Natural Science Foundation (Grant no. 61372122), the Natural Science Foundation of Jiangsu Province (Grant no. BK20160294), the Graduate Students Scientific Research and Innovation Projects of the Jiangsu Higher Education Institutions (Grant no. KYLX_0809), and the Natural Science Foundation of Jiangsu University of Technology (Grant no. KYY14002).

References (46)

  • M.A. Alsheikh et al.

    Machine learning in wireless sensor networks: algorithms, strategies, and applications

    IEEE Commun. Surv. Tutor.

    (2014)
  • R.V. Kulkarni et al.

    Computational intelligence in wireless sensor networks

    IEEE Commun. Surv. Tutor.

    (2011)
  • J. Kotecha et al.

    Distributed multitarget classification in wireless sensor networks

    IEEE J. Sel. Areas Commun.

    (2005)
  • J. Barzerque et al.

    Distributed spectrum sensing for cognitive radios by exploiting sparsity

    IEEE Trans. Signal Process.

    (2008)
  • LingQ. et al.

    Localized structural health monitoring using energy-efficient wireless sensor networks

    IEEE Sens. J.

    (2009)
  • LuoC. et al.

    Compressive data gathering for large-scale wireless sensor networks

    Proceedings of the 15th Annual International Conference on Mobile Computing and Networking, Beijing, China

    (2009)
  • E.J. Candés et al.

    An introduction to compressive sampling

    IEEE Signal Process. Mag.

    (2008)
  • J. Haupt et al.

    Compressed sensing for networked data: A different approach to decentralized compression

    IEEE Signal Process. Mag.

    (2008)
  • F. Fazel et al.

    Random access compressed sensing for energy-efficient underwater sensor networks

    IEEE J. Sel. Areas Commun.

    (2011)
  • S. Pudlewski et al.

    Compressed-sensing-enabled video streaming for wireless multimedia sensor networks

    IEEE Trans. Mob. Comput.

    (2012)
  • ChenS.S. et al.

    Atomic decomposition by basis pursuit

    SIAM Rev.

    (2001)
  • LuW. et al.

    Regularized modified BPDN for noisy sparse reconstruction with partial erroneous support and signal value knowledge

    IEEE Trans. Signal Process.

    (2012)
  • J.A. Tropp et al.

    Signal recovery from random measurements via orthogonal matching pursuit

    IEEE Trans. Inf. Theory

    (2007)
  • S.F. Cotter et al.

    Sparse solutions to linear inverse problems with multiple measurement vectors

    IEEE Trans. Signal Process.

    (2005)
  • D.L. Donoho et al.

    Message-passing algorithms for compressed sensing

    Proceedings of the National Academy of Sciences

    (2009)
  • E.G. Larsson et al.

    Linear regression with a sparse parameter vector

    IEEE Trans. Signal Process.

    (2007)
  • M. Tipping

    Sparse Bayesian learning and the relevance vector machine

    J. Mach. Learn. Res.

    (2001)
  • D. Wipf et al.

    Sparse Bayesian learning for basis selection

    IEEE Trans. Signal Process.

    (2004)
  • QiuK. et al.

    Variance-component based sparse signal reconstruction and model selection

    IEEE Trans. Signal Process.

    (2010)
  • ZhangZ. et al.

    EP-GIG priors and applications in Bayesian sparse learning

    J. Mach. Learn. Res.

    (2012)
  • D. Wipf et al.

    Latent variable Bayesian models for promoting sparsity

    IEEE Trans. Inf. Theory

    (2011)
  • T. Buchgraber et al.

    Distributed variational sparse Bayesian learning for sensor networks

    Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing

    (2012)
  • WangY. et al.

    Blind drift calibration of sensor networks using sparse Bayesian learning

    IEEE Sens. J.

    (2016)
  • Cited by (10)

    View all citing articles on Scopus
    View full text