research-article

Real-time sensor data streams

Author:

Silvia NittelAuthors Info & Claims

SIGSPATIAL Special, Volume 7, Issue 2

Pages 22 - 28

https://doi.org/10.1145/2826686.2826691

Published: 17 September 2015 Publication History

Abstract

Today's observation streams of large numbers of geographically distributed sensors in geosensor networks arrive continuously at powerful servers, and users are interested in analyzing the sensor data streams in real-time. This article investigates challenges in data management that arise when massive real-time data streams become available and discusses different data management technologies for managing and analyzing real-time sensor data streams.

References

[1]

J. Abdul, M. B. Potdar, and P. Chauhan. Parallel and Distributed GIS for Processing Geo-data : An Overview. International Journal of Computer Applications, 106(16):9--16, 2014.

[2]

A. Aji, F. Wang, H. Vo, R. Lee, Q. Liu, X. Zhang, and J. Saltz. Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce. Proceedings VLDB Endowment, 6(11):1009, 2013.

Digital Library

[3]

I. F. Akyildiza, X. Wang, and W. Wang. Wireless mesh networks: a survey. Computer Networks, 47(4):445--487, 2005.

Digital Library

[4]

M. Ali, B. Chandramouli, J. Goldstein, and R. Schindlauer. The extensibility framework in Microsoft StreamInsight. In 2011 IEEE 27th International Conference on Data Engineering, pages 1242--1253. Ieee, Apr. 2011.

Digital Library

[5]

AMPLab-UCBerkeley. SPARKR software, 2015.

[6]

G. Andrienko, N. Andrienko, P. Jankowski, D. Keim, M. Kraak, a. MacEachren, and S. Wrobel. Geovisual analytics for spatial decision support: Setting the research agenda. International Journal of Geographical Information Science, 21(8):839--857, 2007.

Digital Library

[7]

Apache. Hadoop, 2015.

[8]

A. Biem, E. Bouillet, and H. Feng. IBM InfoSphere Streams for Scalable, Real-Time, Intelligent Transportation Services. In SIGMOD '10: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, pages 1093--1103, Indianapolis, IN, 2010.

Digital Library

[9]

J. Dean and S. Ghemawat. MapReduce : Simplified Data Processing on Large Clusters. In Symposium on Operating System Design and Implementation (OSDI), pages 1--18, San Francisco, CA, 2010. USENIX.

Digital Library

[10]

A. Fox, C. Eichelberger, J. Hughes, and S. Lyon. Spatio-temporal indexing in non-relational distributed databases. In Proceedings - 2013 IEEE International Conference on Big Data, pages 291--299, 2013.

[11]

Github. GIS tools for Hadoop, 2015.

[12]

S. Kazemitabar, U. Demiryurek, M. Ali, A. Akdogan, and C. Shahabi. Geospatial stream query processing using Microsoft SQL Server StreamInsight. Proceedings of the VLDB Endowment, 3(1-2):1537--1540, 2010.

Digital Library

[13]

N. Marz and J. Warren. Big Data - Principles and best practices of scalable realtime data systems. Manning Publications, 2015.

Digital Library

[14]

J. Miller, M. Raymond, J. Archer, S. Adem, L. Hansel, M. Luti, Y. Zhao, A. Teredesai, and M. Ali. An Extensibility Approach for Spatio-temporal Stream Processing using Microsoft StreamInsight. In SSTD'11: Proceedings of the 12th international conference on Advances in spatial and temporal databases, pages 496--501, 2011.

Digital Library

[15]

R. N. Murty, G. Mainland, I. Rose, A. R. Chowdhury, A. Gosain, J. Bers, and M. Welsh. CitySense: An Urban-Scale Wireless Sensor Network and Testbed. 2008 IEEE Conference on Technologies for Homeland Security, pages 583--588, May 2008.

[16]

S. Nittel. A survey of geosensor networks: Advances in dynamic environmental monitoring. Sensors, 9(7):5664--5678, 2009.

[17]

L. Sanchez, J. Galache, V. Gutierrez, J. M. Hernandez, J. Bernat, A. Gluhak, and T. Garcia. SmartSantander: The meeting point between Future Internet research and experimentation and the smart cities. In Future Network & Mobile Summit (FutureNetw), pages 1--8, Warsaw, Poland, 2011.

[18]

TIBCO StreamBase. Streambase CEP, 2015.

[19]

B. B. Venkatesan. Feasibility study of continuous real-time spatial interpolation of phenomena using built-in functionality of a commercial data stream management system. Technical report, Department of Spatial Information Science, University of Maine, USA, Orono, 2013.

[20]

A. Witkowski, S. Bellamkonda, and H. Li. Continuous queries in Oracle. VLDB '07 Proceedings of the 33rd International Conference on Very Large Data Bases, pages 1173--1184, 2007.

Digital Library

Cited By

Chen ZHe YWu DZuo LLi KZhang WDeng Z(2024) ℓ 1,2 -Norm and CUR Decomposition based Sparse Online Active Learning for Data Streams with Streaming Features 2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825278(384-393)Online publication date: 15-Dec-2024
https://doi.org/10.1109/BigData62323.2024.10825278
Lemmerz THerlé SBlankenbach J(2023)Geostatistics on Real-Time Geodata Streams—An Extended Spatiotemporal Moran’s I Index with Distributed Stream Processing TechnologiesISPRS International Journal of Geo-Information10.3390/ijgi1203008712:3(87)Online publication date: 22-Feb-2023
https://doi.org/10.3390/ijgi12030087
Single MBruhin LSchütz NNaef AHegi HReuse PSchindler KKrack PWiest RChan ANef TGerber S(2023)Development of an Open-source and Lightweight Sensor Recording Software System for Conducting Biomedical Research: Technical ReportJMIR Formative Research10.2196/430927(e43092)Online publication date: 17-Feb-2023
https://doi.org/10.2196/43092
Show More Cited By

Index Terms

Real-time sensor data streams

Recommendations

Processing real-time sensor data streams for 3D web visualization
IWGS '14: Proceedings of the 5th ACM SIGSPATIAL International Workshop on GeoStreaming

Today, myriads of sensors are surrounding us. Their usage ranges from environmental monitoring (e.g., weather and air quality), over sensor-equipped smart buildings, to the quantified self and other human observing applications. The data streams ...
An Efficient Data Streams Mining Method for Wireless Sensor Network's Data Aggregation
ETCS '09: Proceedings of the 2009 First International Workshop on Education Technology and Computer Science - Volume 03

Wireless distributed sensor systems will enable the reliable monitoring of a variety of environments for both civil and military applications. The data model generated by sensor network is data streams. Because of the rapid data arriving speed and huge ...
Real-Time Scheduling for Data Stream Management Systems
ECRTS '05: Proceedings of the 17th Euromicro Conference on Real-Time Systems

Quality-aware management of data streams is gaining moreand more importance with the amount of data produced by streams growing continuously. The resources required for data stream processing depend on different factors and are limited by the environment ...

Comments

Information & Contributors

Information

Published In

cover image SIGSPATIAL Special

SIGSPATIAL Special Volume 7, Issue 2

July 2015

43 pages

EISSN:1946-7729

DOI:10.1145/2826686

Editor:
Chi-Yin Chow (Ted)
City University of Hong Kong

Issue’s Table of Contents

Copyright © 2015 Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 September 2015

Published in SIGSPATIAL Volume 7, Issue 2

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
256
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chen ZHe YWu DZuo LLi KZhang WDeng Z(2024) ℓ 1,2 -Norm and CUR Decomposition based Sparse Online Active Learning for Data Streams with Streaming Features 2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825278(384-393)Online publication date: 15-Dec-2024
https://doi.org/10.1109/BigData62323.2024.10825278
Lemmerz THerlé SBlankenbach J(2023)Geostatistics on Real-Time Geodata Streams—An Extended Spatiotemporal Moran’s I Index with Distributed Stream Processing TechnologiesISPRS International Journal of Geo-Information10.3390/ijgi1203008712:3(87)Online publication date: 22-Feb-2023
https://doi.org/10.3390/ijgi12030087
Single MBruhin LSchütz NNaef AHegi HReuse PSchindler KKrack PWiest RChan ANef TGerber S(2023)Development of an Open-source and Lightweight Sensor Recording Software System for Conducting Biomedical Research: Technical ReportJMIR Formative Research10.2196/430927(e43092)Online publication date: 17-Feb-2023
https://doi.org/10.2196/43092
Schreckenberger CHe YLüdtke SBartelt CStuckenschmidt HWilliams BChen YNeville J(2023)Online random feature forests for learning in varying feature spacesProceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v37i4.25581(4587-4595)Online publication date: 7-Feb-2023
https://dl.acm.org/doi/10.1609/aaai.v37i4.25581
AYKURT ÖORMAN Z(2022)Akan Verinin Makine Öğrenme Algoritmaları Kullanılarak ÖlçeklenmesiTürkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi10.54525/tbbmd.105117715:1(24-32)Online publication date: 27-Jun-2022
https://doi.org/10.54525/tbbmd.1051177
Aykurt ÖOrman Z(2022)Scaling of Streaming Data Using Machine Learning AlgorithmsAnalyzing Multidisciplinary Uses and Impact of Innovative Technologies10.4018/978-1-6684-6015-3.ch008(172-186)Online publication date: 27-May-2022
https://doi.org/10.4018/978-1-6684-6015-3.ch008
Buyle RVan de Vyvere BRojas Meléndez JVan Lancker DVlassenroot EVan Compernolle MLefever SColpaert PMechant PMannens E(2021)A Sustainable Method for Publishing Interoperable Open Data on the WebData10.3390/data60800936:8(93)Online publication date: 19-Aug-2021
https://doi.org/10.3390/data6080093
Middya ARoy S(2021)Spatial Interpolation Techniques on Participatory Sensing DataACM Transactions on Spatial Algorithms and Systems10.1145/34576097:3(1-32)Online publication date: 8-Jun-2021
https://dl.acm.org/doi/10.1145/3457609
Jayarajan AHau KGoodwin APekhimenko GSherwood TBerger EKozyrakis C(2021)LifeStream: a high-performance stream processing engine for periodic streamsProceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3445814.3446725(107-122)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3445814.3446725
Brown PDasu TKanza YSrivastava D(2019)From Rocks to PebblesACM Transactions on Spatial Algorithms and Systems10.1145/33296775:3(1-38)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3329677
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents