Abstract
How to effectively handle heterogeneous data sources is one of the main challenges in the design of large-scale research computing platforms to collect, analyze and integrate data from IoT sensors. The platform must seamlessly support the integration of myriads of data formats and communication protocols, many being introduced after the platform has been deployed. Edge gateways, devices deployed at the edge of the network near the sensors, communicate with measurement stations using their proper protocol, receive and translate the messages to a standardized format, forward the data to the processing platform and provide local data buffering and preprocessing. In this work we present the TDM Edge Gateway architecture, which we have developed to be used in research contexts to meet the requirements of being self-built, low-cost, and compatible with current or future connected sensors.
The architecture is based on a microservice-oriented design implemented with software containerization and leverages publish/subscribe Inter Process Communication to ensure modularity and resiliency. Costs and construction simplicity are ensured by adopting the popular Raspberry Pi Single Board Computer. The resulting platform is lean, flexible and easy to expand and integrate. It does not pose constraints on programming languages to use and relies on standard protocols and data models.
This work was supported by the TDM project funded by Sardinian Regional Authorities under grant agreement POR FESR 2014–2020 Azione 1.2 (D. 66/14 13.12.2016 S3-ICT).
To the memory of Dr. Gianluigi Zanetti.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beserra, D., Moreno, E.D., Endo, P.T., Barreto, J., Sadok, D., Fernandes, S.: Performance analysis of LXC for HPC environments. In: 2015 Ninth International Conference on Complex, Intelligent, and Software Intensive Systems. pp. 358–363. IEEE, July 2015. https://doi.org/10.1109/CISIS.2015.53
Cloutier, M., Paradis, C., Weaver, V.: A Raspberry Pi cluster instrumented for fine-grained power measurement. Electronics 5(4), 61 (2016). https://doi.org/10.3390/electronics5040061. http://www.mdpi.com/2079-9292/5/4/61
Di Tommaso, P., Palumbo, E., Chatzou, M., Prieto, P., Heuer, M.L., Notredame, C.: The impact of docker containers on the performance of genomic pipelines. PeerJ 3, e1273 (2015). https://doi.org/10.7717/peerj.1273
Docker Inc: Docker Documentation. https://docs.docker.com/. Accessed 20 May 2019
Dolui, K., Kiraly, C.: Towards multi-container deployment on IoT gateways. In: 2018 IEEE Global Communications Conference (GLOBECOM), pp. 1–7. IEEE, Abu Dhabi, United Arab Emirates, December 2018. https://doi.org/10.1109/GLOCOM.2018.8647688. https://ieeexplore.ieee.org/document/8647688/
Dragoni, N., Giallorenzo, S., Lafuente, A.L., Mazzara, M., Montesi, F., Mustafin, R., Safina, L.: Microservices: Yesterday, Today, and Tomorrow. In: Mazzara, M., Meyer, B. (eds.) Present and Ulterior Software Engineering, pp. 195–216. Springer International Publishing, Cham (2017). https://doi.org/10.1007/978-3-319-67425-4_12. https://doi.org/10.1007/978-3-319-67425-4_12
Fiware Foundation: Home – FIWARE. https://www.fiware.org/. Accessed 14 May 2019
Hajji, W., Tso, F.: Understanding the performance of low power raspberry Pi cloud for big data. Electronics 5(4), 29 (2016). https://doi.org/10.3390/electronics5020029. http://www.mdpi.com/2079-9292/5/2/29
Massidda, L., Marrocu, M.: Quantile regression post-processing of weather forecast for short-term solar power probabilistic forecasting. Energies 11(7), 1763 (2018). https://doi.org/10.3390/en11071763. http://publications.crs4.it/pubdocs/2018/MM18a
Massidda, L., Marrocu, M.: Smart meter forecasting from one minute to one year horizons. Energies 11(12), 3250 (2018). https://doi.org/10.3390/en11123520. http://publications.crs4.it/pubdocs/2018/MM18b
Merkel, D.: Docker: lightweight linux containers for consistent development and deployment. Linux Journal 2014 (2014)
Morabito, R., Petrolo, R., Loscrì, V., Mitton, N.: LEGIoT: a lightweight edge gateway for the Internet of Things. Fut. Generation Comput. Syst. 81, 1–15 (2018). https://doi.org/10.1016/j.future.2017.10.011. https://linkinghub.elsevier.com/retrieve/pii/S0167739X17306593
Pace, P., Aloi, G., Gravina, R., Caliciuri, G., Fortino, G., Liotta, A.: An edge-based architecture to support efficient applications for healthcare industry 4.0. IEEE Trans. Ind. Inform. 15(1), 481–489 (2019). https://doi.org/10.1109/TII.2018.2843169. https://ieeexplore.ieee.org/document/8370750/
The Eclipse Foundation: Eclipse Kura. https://www.eclipse.org/kura/. Accessed 01 July 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Gaggero, M., Busonera, G., Pireddu, L., Zanetti, G. (2020). TDM Edge Gateway: A Flexible Microservice-Based Edge Gateway Architecture for Heterogeneous Sensors. In: Schwardmann, U., et al. Euro-Par 2019: Parallel Processing Workshops. Euro-Par 2019. Lecture Notes in Computer Science(), vol 11997. Springer, Cham. https://doi.org/10.1007/978-3-030-48340-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-48340-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-48339-5
Online ISBN: 978-3-030-48340-1
eBook Packages: Computer ScienceComputer Science (R0)