skip to main content
10.1145/3219104.3219123acmotherconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
research-article

A Cloud-Based Scientific Gateway for Internet of Things Data Analytics

Published: 22 July 2018 Publication History

Abstract

As inexpensive Internet of Things (IoT) sensors have become widely available, an increasing number of researchers in domains as diverse as the engineering and geosciences, biomedicine, the social sciences, and even the arts have become interested in the insights and creative expression such sensors might enable. At the University of Iowa, we convened a series of meetings at which we posed the following framing question: "What would you do with 10,000, ~$10 sensors?" These discussions identified the clear need for a standard, end-to-end infrastructure for sensor deployment and data collection through data analytics and visualization, one that allowed researchers to focus on research and scholarship rather than infrastructure development. This paper1 describes the development of a suite of wireless sensors and a cloud-based toolkit for data capture, analysis, and visualization, based on Amazon Web Services (AWS), MQTT, and Jupyter notebooks.

References

[1]
"Message Queueing Telemetry Transport (MQTT)," 2018. http://mqtt.org.
[2]
"Jupyter Notebook," 2018. http://jupyter.org.
[3]
G. Paul and J. Irvine, "Privacy Implications of Wearable Health Devices," in Proceedings of the 7th International Conference on Security of Information and Networks (SIN'14), New York, NY, USA, 2014.
[4]
J. Stewart, R. Stewart and S. Kennedy, "Dynamic IoT Management System using K-means Machine Learning for Precision Agriculture Applications," in Proceedings of the 2nd International Conference on Internet of things and Cloud Computing (ICC'17), New York, NY, USA, 2017.
[5]
R.-Q. Wang, H. Mao, Y. Wang, C. Rae and W. Shaw, "Hyper-resolution Monitoring of Urban Flooding with Social Media and Crowdsourcing Data," Computers & Geosciences, vol. 111, pp. 139--147, 2018.
[6]
C. E. Catlett, P. H. Beckman, R. Sankaran and K. Kusiak Galvin, "Array of Things: A Scientific Research Instrument in the Public Way: Platform Design and Early Lessons Learned," in Proceedings of the 2nd International Workshop on Science of Smart City Operations and Platforms Engineering (SCOPE'17), New York, NY, USA, 2017.
[7]
"LoRaWAN," 2018. https://www.lora-alliance.org/technology.
[8]
V. Bahl, R. Chandra, T. Moscibroda, R. Murty and M. Welsh, "White Space Networking with Wi-Fi like Connectivity," ACM SIGCOMM Computer Communication Review, vol. 39, no. 4, pp. 27--38, 2009.
[9]
R. Chandra, T. Moscibroda, V. Bahl, R. Murty, G. Nychis and X. Wang, "A Campus-wide Testbed over the TV White Spaces," ACM SIGMOBILE Mobile Computing and Communications Review, vol. 15, no. 3, pp. 2--9, 2011.
[10]
"Arduino Open Source Hardware," 2018. https://www.arduino.cc.
[11]
I. Demir and W. F. Krajewski, "Towards an Integrated Flood Information System: Centralized Data Access, Analysis, and Visualization," Environmental Modelling & Software, vol. 50, pp. 77--84, 2013.
[12]
"MQTT Paho," 2018. http://www.eclipse.org/paho.
[13]
"Elasticsearch," 2018. https://www.elastic.co.
[14]
"Kibana," 2018. https://www.elastic.co/products/kibana.
[15]
"RStudio," 2018. https://www.rstudio.com.
[16]
"Jupyter Hub," 2018. https://jupyterhub.readthedocs.io/en/latest.
[17]
"RStudio Server," 2018. https://www.rstudio.com/products/rstudio/download-server.
[18]
"MongoDB," 2018. https://www.mongodb.com.
[19]
Z. Kapetanovic, D. Vasisht, J. Won, R. Chandra and M. Kimball, "Experiences Deploying an Always-on Farm Network," GetMobile: Mobile Computing and Communications, vol. 21, no. 2, pp. 16--21, 2017.

Cited By

View all
  • (2023)Industrial IoT system for laser-wire direct energy deposition: data collection and visualization of manufacturing process signalsIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/1296/1/0120061296:1(012006)Online publication date: 1-Dec-2023
  • (2021)Rinegan: A Scalable Image Processing Architecture for Large Scale Surveillance ApplicationsFrontiers in Neurorobotics10.3389/fnbot.2021.64810115Online publication date: 23-Aug-2021
  • (2021)IoT Statistic and Analytics of Networking Traffic Data using AWS IoT Cloud Core2021 International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC52510.2021.9621156(98-103)Online publication date: 20-Oct-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity
July 2018
652 pages
ISBN:9781450364461
DOI:10.1145/3219104
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AWS
  2. Arduino
  3. Elasticsearch
  4. Internet of Things
  5. Jupyter
  6. LoRaWAN
  7. MQTT
  8. White Spaces
  9. environmental monitoring

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

PEARC '18

Acceptance Rates

PEARC '18 Paper Acceptance Rate 79 of 123 submissions, 64%;
Overall Acceptance Rate 133 of 202 submissions, 66%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Industrial IoT system for laser-wire direct energy deposition: data collection and visualization of manufacturing process signalsIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/1296/1/0120061296:1(012006)Online publication date: 1-Dec-2023
  • (2021)Rinegan: A Scalable Image Processing Architecture for Large Scale Surveillance ApplicationsFrontiers in Neurorobotics10.3389/fnbot.2021.64810115Online publication date: 23-Aug-2021
  • (2021)IoT Statistic and Analytics of Networking Traffic Data using AWS IoT Cloud Core2021 International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC52510.2021.9621156(98-103)Online publication date: 20-Oct-2021
  • (2021)Data Statistic, Visualization, and Notifications of Networking Traffic Data using AWS IoT Cloud2021 International Conference on Software Security and Assurance (ICSSA)10.1109/ICSSA53632.2021.00015(37-42)Online publication date: 10-Nov-2021
  • (2020)Harnessing the Computing Continuum for Programming Our WorldFog Computing10.1002/9781119551713.ch7(215-230)Online publication date: 25-Apr-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media