Abstract
Smart sensor systems are a key factor to ensure sustainable compute by enabling machine learning algorithms to be executed at the data source. This is particularly helpful when working with moving parts or in remote areas, where no tethered deployment is possible. However, including computations directly at the measurement device places an increased load on the power budget. Therefore, we introduce the Hierarchical Machine Learning framework “HiMLEdge” which enables highly specialized models that are tuned using an energy-aware multi-criteria optimization. We evaluate our framework with prognostic health management in a three-part feasibility study: First, we apply an exhaustive search to find hierarchical taxonomies, which we benchmark against hand-tuned flat classifiers. This test shows a decrease in power consumption of up to 47.63% for the hierarchical approach. Second, the search strategy is improved with Reinforcement Learning. As a novel contribution, we include real measurements in the reward function, instead of using a surrogate metric. This inclusion leads to a different optimal policy in comparison to the literature, which shows the error that may be introduced by an approximation. Third, we conduct tests on the system level, including communication and system-off power draw. In this scenario, the optimized hierarchical model can perform four times as many readings per hour as a flat classifier while achieving the same five years of battery life with similar accuracy. In turn, this also means that the battery life can be increased by the same amount if the readings per hour are kept constant.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adams, S., et al.: Hierarchical fault classification for resource constrained systems. Mech. Syst. Signal Process. 134, 106266 (2019) https://doi.org/10.1016/j.ymssp.2019.106266https://linkinghub.elsevier.com/retrieve/pii/S0888327019304819
Akbari, A., Wu, J., Grimsley, R., Jafari, R.: Hierarchical Signal Segmentation and Classification for Accurate Activity Recognition. In: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. pp. 1596–1605. UbiComp ’18, Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3267305.3267528
Aquino-Brítez, D., Ortiz, A., Ortega, J., León, J., Formoso, M., Gan, J.Q., Escobar, J.J.: Optimization of Deep Architectures for EEG Signal Classification: An AutoML Approach Using Evolutionary Algorithms. Sensors 21(6), 2096 (2021) DOI: https://doi.org/10.3390/s21062096,https://www.mdpi.com/1424-8220/21/6/2096, number: 6 Publisher: Multidisciplinary Digital Publishing Institute
Bischl, B., Mersmann, O., Trautmann, H., Preuß, M.: Algorithm selection based on exploratory landscape analysis and cost-sensitive learning. In: Proceedings of the 14th annual conference on Genetic and evolutionary computation. pp. 313–320. GECCO ’12, Association for Computing Machinery, New York, NY, USA (2012). https://doi.org/10.1145/2330163.2330209
Bruckert, S., Finzel, B., Schmid, U.: The Next Generation of Medical Decision Support: A Roadmap Toward Transparent Expert Companions. Front. Artif. Intell. 3 (2020) https://www.frontiersin.org/article/10.3389/frai.2020.507973
García-Martín, E., Rodrigues, C.F., Riley, G., Grahn, H.: Estimation of energy consumption in machine learning. Journal of Parallel and Distributed Computing 134, 75–88 (2019) https://doi.org/10.1016/j.jpdc.2019.07.007,https://www.sciencedirect.com/science/article/pii/S0743731518308773
Goetschalckx, K., Moons, B., Lauwereins, S., Andraud, M., Verhelst, M.: Optimized Hierarchical Cascaded Processing. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 8(4), 884–894 (2018). https://doi.org/10.1109/JETCAS.2018.2839347
Lei, Y.: 2 - Signal processing and feature extraction. In: Lei, Y. (ed.) Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery, pp. 17–66. Butterworth-Heinemann (Jan 2017). https://doi.org/10.1016/B978-0-12-811534-3.00002-0,https://www.sciencedirect.com/science/article/pii/B9780128115343000020
Neupane, D., Seok, J.: Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset With Deep Learning Approaches: A Review. IEEE Access 8 (2020). https://doi.org/10.1109/ACCESS.2020.2990528
Ns, A.: Time complexity analysis of support vector machines (SVM) in LibSVM. Int. J. Comput. Appl. 128(3), 957–8887 (2015). https://doi.org/10.5120/ijca2015906480
Pech, M., Vrchota, J., Bednář, J.: Predictive maintenance and intelligent sensors in smart factory: Review. Sensors 21(4) (2021). https://doi.org/10.3390/s21041470,https://www.mdpi.com/1424-8220/21/4/1470
Ren, H., Anicic, D., Runkler, T.A.: The synergy of complex event processing and tiny machine learning in industrial IoT. In: Proceedings of the 15th ACM International Conference on Distributed and Event-based Systems, pp. 126–135. DEBS ’21, Association for Computing Machinery, New York, NY, USA (Jun 2021). https://doi.org/10.1145/3465480.3466928
Schwartz, D., Selman, J.M.G., Wrege, P., Paepcke, A.: Deployment of Embedded Edge-AI for Wildlife Monitoring in Remote Regions. In: 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 1035–1042 (Dec 2021). https://doi.org/10.1109/ICMLA52953.2021.00170
Silla, C.N., Freitas, A.A.: A survey of hierarchical classification across different application domains. Data Mining and Knowledge Discovery 22(1), 31–72 (2011). https://doi.org/10.1007/s10618-010-0175-9
Thomas, A., Guo, Y., Kim, Y., Aksanli, B., Kumar, A., Rosing, T.S.: Hierarchical and distributed machine learning inference beyond the edge. In: 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC), pp. 18–23 (2019). https://doi.org/10.1109/ICNSC.2019.8743164
Vaidyanathan, P.: Multirate digital filters, filter banks, polyphase networks, and applications: a tutorial. In: Proceedings of the IEEE 78(1), 56–93 (1990). https://doi.org/10.1109/5.52200
Vinuesa, R., et al.: The role of artificial intelligence in achieving the Sustainable Development Goals. Nature Commun. 11(1), 233 (2020). https://doi.org/10.1038/s41467-019-14108-y
Zhou, F., Gao, Y., Wen, C.: A Novel Multimode Fault Classification Method Based on Deep Learning. J. Control Sci. Eng. 2017 (2017). https://doi.org/10.1155/2017/3583610,https://www.hindawi.com/journals/jcse/2017/3583610/
Acknowledgement
This work was supported by the Bavarian Ministry of Economic Affairs, Regional Development and Energy through the Center for Analytics - Data - Applications (ADACenter) within the framework of “BAYERN DIGITAL II” (20–3410-2–9-8).‘
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wissing, J., Scheele, S., Mohammed, A., Kolossa, D., Schmid, U. (2022). HiMLEdge – Energy-Aware Optimization for Hierarchical Machine Learning. In: Guarda, T., Portela, F., Augusto, M.F. (eds) Advanced Research in Technologies, Information, Innovation and Sustainability. ARTIIS 2022. Communications in Computer and Information Science, vol 1676. Springer, Cham. https://doi.org/10.1007/978-3-031-20316-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-20316-9_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20315-2
Online ISBN: 978-3-031-20316-9
eBook Packages: Computer ScienceComputer Science (R0)