Skip to main content
SpringerLink
Log in

Dissemination of compressed historical information in sensor networks

  • Regular Paper
  • Published:
The VLDB Journal Aims and scope Submit manuscript

Abstract

Sensor nodes are small devices that “measure” their environment and communicate feeds of low-level data values to a base station for further processing and archiving. Dissemination of these multi-valued feeds is challenging because of the limited resources (processing, bandwidth, energy) available in the nodes of the network. In this paper, we first describe the SBR algorithm for compressing multi-valued feeds containing historical data from each sensor. The key to our technique is the base signal, a series of values extracted from the real measurements that is used to provide piece-wise approximation of the measurements. While our basic technique exploits correlations among measurements taken on a single node, we further show how it can be adapted to exploit correlations among multiple nodes in a localized setting. Sensor nodes may form clusters and, within a cluster, a group leader identifies and coalesces similar measurements taken by different nodes. This localized mode of operation further improves the accuracy of the approximation, typically by a factor from 5 to 15. We provide detailed experiments of our algorithms and make direct comparisons against standard approximation techniques like Wavelets, Histograms and the Discrete Cosine Transform, on a variety of error metrics and for real data sets from different domains.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahmed, N., Natarakan, T., Rao, K.R.: Discrete cosine transform. IEEE Transactions on Computers, C-23 (1974)

  2. Ailamaki, A., Faloutsos, C., Fischbeck, P.S., Small, M.J., VanBriesen, J.: An environmental sensor network to determine drinking water quality and security. SIGMOD Record 32(4), 47–52 (2003)

    Article  Google Scholar 

  3. Akyildiz, I., Su, W., Sankarasubramaniam, Y., Cayirci, E.: A Survey on Sensor Networks. IEEE Communications Magazine, 40(8), 102–114 (2002)

    Article  Google Scholar 

  4. Bawa, M., Garcia,-Molina, H., Gionis, A., Motwani, R.: Estimating Aggregates on a Peer-to-Peer Network. Technical report, Stanford, 2003.

  5. Belussi, A., Faloutsos, C.: Estimating the selectivity of spatial queries using the ‘correlation’ fractal dimension. In: Proceedings of the VLDB Conference (1995)

  6. Cerpa, A., Estrin, D.: ASCENT: Adaptive self-configuring sensor network topologies. In: Proceedings of INFOCOM(2002)

  7. Chakrabarti, K., Garofalakis, M., Rastogi, R., Shim, K.: Approximate query processing using wavelets. In: Proceedings of the VLDB Conference (2000)

  8. Chang, J.H., Tassiulas, L.: Energy conserving routing in wireless ad-hoc networks. In: Proceedings of INFOCOM (2000)

  9. Chen, J., Dewitt, D.J., Tian, F., Wang, Y.: NiagaraCQ: A scalable continuous query system for internet databases. In: Proceedings of the ACM SIGMOD Conference (2000)

  10. Chen, Y., Dong, G., Han, J., Wah, B.W., Wang, J.: Multi-dimensional regression analysis of time-series data streams. In: Proceedings of the VLDB Conference (2002)

  11. Cheng, R., Kalashnikov, D.V., Prabhakar, S.: Evaluating Probabilistic Queries over Imprecise Data. In: Proceedings of the ACM SIGMOD Conference (2003)

  12. Cherniack, M., Franklin, M.J., Zdonik, S.B.: Data management for pervasive computing. In: Proceedings of the VLDB Conference (2001)

  13. Considine, J., Li, F., Kollios, G., Byers, J.: Approximate aggregation techniques for sensor databases. In: Proceedings of the ICDE Conference (2004)

  14. Deligiannakis, A., Kotidis, Y., Roussopoulos, N.: Compressing historical information in sensor networks. In: Proceedings of the ACM SIGMOD Conference (2004)

  15. Deligiannakis, A., Kotidis, Y., Roussopoulos, N.: Hierarchical in-network data aggregation with quality guarantees. In: Proceedings of the EDBT Conference (2004)

  16. Deligiannakis, A., Roussopoulos, N.: Extended wavelets for multiple measures. In: Proceedings of the ACM SIGMOD Conference (2003)

  17. Demers, A., Gehrke, J., Rajaraman, R., Trigoni, N., Yao, Y.: The cougar project: A Work In Progress Report. SIGMOD Record 32(4), 53–59 (2003)

    Article  Google Scholar 

  18. Deshpande, A., Guestrin, C., Madden, S., Hellerstein, J.M., Hong, W.: Model-Driven Data Acquisition in Sensor Networks. In: Proceedings of the VLDB Conference (2004)

  19. Estrin, D., Govindan, R., Heidermann, J., Kumar, S.: Next century challenges: scalable coordination in sensor networks. In: Proceedings of MobiCOM (1999)

  20. Ganesan, D., Estrin, D., Heidermann, J.: DIMENSIONS: Why do we need a new Data Handling architecture for Sensor Networks? In: Proceedings of HotNets-I (2002)

  21. Garofalakis, M., Gibbons, P.B.: Wavelet synopses with error guarantees. In: Proceedings of the ACM SIGMOD Conference (2002)

  22. Garofalakis, M., Gibbons, P.B.: Probabilistic Wavelet Synopses. ACM Transactions on Database Systems 29(1), 43–90 (2004)

    Article  Google Scholar 

  23. Gibbons, P.B.: Distinct Sampling for Highly-Accurate Answers to Distinct Values Queries and Event Reports. In: Proceedings of the VLDB Conference (2001)

  24. Gibbons, P.B., Matias, Y.: New sampling-based summary statistics for improving Approximate Query Answers. In: Proceedings of the ACM SIGMOD Conference (1998)

  25. Gilbert, A.C., Kotidis, Y., Muthukrishnan, S., Strauss, M.: One-Pass Wavelet Decompositions of Data Streams. IEEE Transactions on Knowledge and Data Engineering 15(3), 541–554 (2003)

    Article  Google Scholar 

  26. Heidermann, J., Silva, F., Intanagonwiwat, C., Govindan, R., Estrin, D., Ganesan, D.: Building efficient wireless sensor networks with low-level naming. In: Proceedings of SOSP (2001)

  27. Heinzelman, W., Chandrakasan, A., Balakrishnan, H.: Energy-efficient communication protocol for wireless microsensor networks. In: Proceedings of the Hawaii Conference on System Sciences (2000)

  28. Hellerstein, J.M., Franklin, M.J., Chandrasekaran, S., Deshpande, A., Hildrum, K., Madden, S., Raman, V., Shah, M.A.: Adaptive Query Processing: Technology in Evolution. IEEE Data Engineering Bulletin 23(2) (2000)

  29. Intanagonwiwat, C., Estrin, D., Govindan, R., Heidermann, J.: Impact of network density on data aggregation in wireless sensor networks. In: Proceedings of ICDCS (2002)

  30. Ioannidis, Y.E., Poosala, V.: Histogram-based approximation of set-valued query answers. In: Proceedings of the VLDB Conference (2000)

  31. Kempe, D., Dobra, A., Gehrke, J.: Gossip-based computation of aggregate information. In: Proceedings of FOCS (2003)

  32. Khanna, S., Tan, W.C.: On Computing functions with uncertainty. In: Proceedings of ACM PODS Conference (2001)

  33. Korn, F., Labrinidis, A., Kotidis, Y., Faloutsos, C.: Quantifiable Data Mining Using Ratio Rules. VLDB Journal 8(3–4), 254–266 (2000)

    Google Scholar 

  34. Kotidis, Y.: Snapshot Queries: Towards data-centric sensor networks. In: Proceedings of the ICDE Conference (2005)

  35. Lee, J., Kim, D., Chung, C.: Multi-dimensional selectivity estimation using compressed histogram information. In: Proceedings of the ACM SIGMOD Conference (1999)

  36. Lindsey, S., Raghavendra, C.S.: Pegasis: Power-Efficient Gathering in Sensor Information Systems. In: Proceedings of the IEEE Aerospace Conference (2002)

  37. Madden, S., Franklin, M.J., Hellerstein, J.M., Hong, W.: TAG: A tiny aggregation service for ad hoc sensor networks. In: Proceedings of the OSDI Conference (2002)

  38. Madden, S., Franklin, M.J., Hellerstein, J.M., Hong, W.: The design of an acquisitional query processor for sensor networks. In: Proceedings of the ACM SIGMOD Conference (2003)

  39. Mainwaring, A., Polastre, J., Szewczyk, R., Culler, D., Anderson, J.: Wireless Sensor Networks for Habitat Monitoring. ACM WSNA Workshop (2002)

  40. Matias, Y., Vitter, J.S., Wang, M.: Wavelet-based histograms for selectivity estimation. In: Proceedings of the ACM SIGMOD Conference (1998)

  41. Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Datar, M., Manku, G., Olston, C., Rosenstein, J., Varma, R.: Query processing, resource management, and approximation in a data stream management system. In: Proceedings of CIDR (2003)

  42. Olston, C., Jiang, J., Widom, J.: Adaptive filters for continuous queries over distributed data streams. In: Proceedings of the ACM SIGMOD Conference (2003)

  43. Olston, C., Widom, J.: Offering a precision-performance tradeoff for aggregation queries over replicated data. In: Proceedings of the VLDB Conference (2000)

  44. Poosala, V., Ioannidis, Y.E.: Selectivity estimation without the attribute value independence assumption. In: Proceedings of the VLDB Conference (1997)

  45. Poosala, V., Ioannidis, Y.E., Haas, P.J., Shekita, E.J.: Improved Histograms for Selectivity Estimation of Range Predicates. In: Proceedings of the ACM SIGMOD Conference (1996)

  46. Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes in C. Cambridge University Press, 2nd edition edition (1992)

  47. Qiao, L., Agrawal, D., Abbadi, A.E.: RHist: Adaptive Summarization over Continuous Data Streams. In: Proceedings of CIKM (2002)

  48. Sharaf, A., Beaver, J., Labrinidis, A., Chrysanthis, P.: Balancing Energy Efficiency and Quality of Aggregate Data in Sensor Networks. VLDB Journal 13(4), 384–403 (2004)

    Article  Google Scholar 

  49. Shih, E., Cho, S.-H., Ickes, N.: Physical layer driven protocol and algorithm design for energy-efficient wireless sensor networks. In: Proceedings of MOBICOM (2001)

  50. Singh, S., Woo, M., Raghavendra, C.S.: Power-Aware Routing in Mobile Ad Hoc Networks. In: ACM/IEEE International Conference on Mobile Computing and Networking (1998)

  51. Stollnitz, E.J., DeRose, T.D., Salesin, D.H.: Wavelets for Computer Graphics—Theory and Applications. Morgan Kaufmann Publishers, Inc., San Francisco, CA (1996)

    Google Scholar 

  52. Tan, H.O., Korpeoglu, I.: Power Efficient Data Gathering and Aggregation in Wireless Sensor Networks. SIGMOD Record 32(4), (2003)

  53. Thaper, N., Guha, S., Indyk, P., Koudas, N.: Dynamic Multidimensional Histograms. In: Proceedings of the ACM SIGMOD Conference (2002)

  54. Viglas, S.D., Naughton, J.F.: Rate-based query optimization for streaming information sources. In: Proceedings of the ACM SIGMOD Conference (2002)

  55. Vitter, J.S., Wang, M.: Approximate computation of multidimensional aggregates of sparse data using wavelets. In: Proceedings of the ACM SIGMOD Conference (1999)

  56. Warneke, B., Last, M., Liebowitz, B., Pister, K.S.J.: Smart Dust: Communicating with a Cubic-Millimeter Computer. IEEE Computer 34(1), 44–51 (2001)

    Google Scholar 

  57. Yao, Y., Gehrke, J.: The Cougar Approach to In-Network Query Processing in Sensor Networks. SIGMOD Record 31(3), 9–18 (2002)

    Article  Google Scholar 

  58. Younis, O., Fahmy, S.: HEED: A hybrid, energy-efficient, distributed clustering approach for Ad Hoc sensor networks. IEEE Transactions on Mobile Computing 3(4) (2004)

  59. Zdonik, S.B., Stonebraker, M., Cherniack, M., Cetintemel, U., Balazinska, M., Balakrishnan, H.: The Aurora and Medusa Projects. IEEE Data Engineering Bulletin (2003)

  60. Zeinalipour-Yazti, D., Neema, S., Gunopulos, D., Kalogeraki, V., Najjar, W.: Data acquision in sensor networks with large memories. In: Proceedings of the IEEE International Workshop on Networking Meets Databases (2005)

Download references

Author information

Authors and Affiliations

  1. University of Maryland, Maryland, USA

    Antonios Deligiannakis & Nick Roussopoulos

  2. AT&T Labs-Research, USA

    Yannis Kotidis

Authors
  1. Antonios Deligiannakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yannis Kotidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nick Roussopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antonios Deligiannakis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Deligiannakis, A., Kotidis, Y. & Roussopoulos, N. Dissemination of compressed historical information in sensor networks. The VLDB Journal 16, 439–461 (2007). https://doi.org/10.1007/s00778-005-0173-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00778-005-0173-5

Keywords

Search

Navigation