research-article

Edge Intelligence: Concepts, Architectures, Applications, and Future Directions

Authors:

Kay Bierzynski,

M. P. Cuéllar,

Diego P. MoralesAuthors Info & Claims

ACM Transactions on Embedded Computing Systems (TECS), Volume 21, Issue 5

Article No.: 48, Pages 1 - 41

https://doi.org/10.1145/3486674

Published: 08 October 2022 Publication History

Abstract

The name edge intelligence, also known as Edge AI, is a recent term used in the past few years to refer to the confluence of machine learning, or broadly speaking artificial intelligence, with edge computing. In this article, we revise the concepts regarding edge intelligence, such as cloud, edge, and fog computing, the motivation to use edge intelligence, and compare current approaches and analyze application scenarios. To provide a complete review of this technology, previous frameworks and platforms for edge computing have been discussed in this work to provide the general view of the basis for Edge AI. Similarly, the emerging techniques to deploy deep learning models at the network edge, as well as specialized platforms and frameworks to do so, are review in this article. These devices, techniques, and frameworks are analyzed based on relevant criteria at the network edge, such as latency, energy consumption, and accuracy of the models, to determine the current state of the art as well as current limitations of the proposed technologies. Because of this, it is possible to understand the current possibilities to efficiently deploy state-of-the-art deep learning models at the network edge based on technologies such as artificial intelligence accelerators, tensor processing units, and techniques that include federated learning and gossip training. Finally, the challenges of Edge AI are discussed in the work, as well as the future directions that can be extracted from the evolution of the edge computing and Internet of Things approaches.

References

[1]

Shahryar Afzal, Jiasi Chen, and K. K. Ramakrishnan. 2017. Characterization of 360-degree videos. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. 1–6.

Digital Library

[2]

A. Ahmed and E. Ahmed. 2016. A survey on mobile edge computing. In Proceedings of the 2016 10th International Conference on Intelligent Systems and Control (ISCO’16). 1–8.

[3]

Firas Al-Ali, Thilina Doremure Gamage, Hewa W. T. S. Nanayakkara, Farhad Mehdipour, and Sayan Kumar Ray. 2020. Novel casestudy and benchmarking of AlexNet for edge AI: From CPU and GPU to FPGA. In Proceedings of the 2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE’20). IEEE, Los Alamitos, CA, 1–4.

[4]

Mabrook Al-Rakhami, Mohammed Alsahli, Mohammad Mehedi Hassan, Atif Alamri, Antonio Guerrieri, and Giancarlo Fortino. 2018. Cost efficient edge intelligence framework using Docker containers. In Proceedings of the 2018 IEEE 16th International Conference on Dependable, Autonomic, and Secure Computing, the 16th International Conference on Pervasive Intelligence and Computing, the 4th International Conference on Big Data Intelligence, and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech’18). IEEE, Los Alamitos, CA, 800–807.

[5]

Georgia Albuquerque, Thomas Lowe, and Marcus Magnor. 2011. Synthetic generation of high-dimensional datasets. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2317–2324.

Digital Library

[6]

E. Aleksandrova, C. Anagnostopoulos, and K. Kolomvatsos. 2019. Machine learning model updates in edge computing: An optimal stopping theory approach. In Proceedings of the 2019 18th International Symposium on Parallel and Distributed Computing (ISPDC’19). 1–8.

[7]

Alasdair Allan. n.d. Benchmarking the Xnor AI2GO Platform on the Raspberry Pi. Accessed January 17, 2021 from https://www.globenewswire.com/en/news-release/2019/05/16/1826021/0/en/Xnor-releases-AI2GO-A-self-serve-edge-AI-platform-for-building-smart-on-device-solutions.html.

[8]

Alasdair Allan. n.d. Hands-On with the Smart-Edge Agile. Retrieved December 17, 2020 from https://blog.hackster.io/hands-on-with-the-smartedge-agile-b7b7f02b5d4b.

[9]

Amazon. n.d. AWS Greengrass. Retrieved December 17, 2020 from https://aws.amazon.com/greengrass/.

[10]

Ganesh Ananthanarayanan, Paramvir Bahl, Peter Bodík, Krishna Chintalapudi, Matthai Philipose, Lenin Ravindranath, and Sudipta Sinha. 2017. Real-time video analytics: The killer app for edge computing. Computer 50, 10 (2017), 58–67.

Digital Library

[11]

Shogo Ando and Akihiro Nakao. 2014. In-network cache simulations based on a YouTube traffic analysis at the edge network. In Proceedings of the 9th International Conference on Future Internet Technologies (CFI’14). ACM, New York, NY, Article 10, 6 pages.

Digital Library

[12]

Apache. n.d. Retrieved December 11, 2020 from Apache Kafka. https://kafka.apache.org/.

[13]

Apache. n.d. Apache MXNet. Retrieved December 3, 2020 from https://mxnet.apache.org/.

[14]

Apache. n.d. Edgent. Retrieved December 17, 2020 from https://edgent.incubator.apache.org/.

[15]

Apple. n.d. CoreML3 from Apple. Retrieved December 3, 2020 from https://developer.apple.com/machine-learning/core-ml/.

[16]

Apple. 2017. Deep learning for Siri’s voice: On-device deep mixture density networks for hybrid unit selection synthesis. Online. Available at https://machinelearning.apple.com/2017/08/06/sirivoices.html.

[17]

Apple. 2017. Hey Siri: An on-device DNN-powered voice trigger for Apple’s personal assistant. Available at https://machinelearning.apple.com/2017/10/01/heysiri.html.

[18]

Gaurav Batra, Zach Jacobson, Siddarth Madhav, Andrea Queirolo, and Nick Santhanam. 2018. Artificial-Intelligence Hardware: New Opportunities for Semiconductor Companies. Technical Report. McKinsey & Company, New York, NY.

[19]

Sourav Bhattacharya and Nicholas Lane. 2016. Sparsification and separation of deep learning layers for constrained resource inference on wearables. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM (SenSys’16).176–189.

Digital Library

[20]

Kay Bierzynski, Antonio Escobar, and Matthias Eberl. 2017. Cloud, fog and edge: Cooperation for the future? In Proceedings of the 2017 2nd International Conference on Fog and Mobile Edge Computing (FMEC’17). IEEE, Los Alamitos, CA, 62–67.

[21]

Michael Blot, David Picard, Matthieu Cord, and Nicolas Thome. 2016. Gossip training for deep learning. arXiv preprint arXiv:1611.09726 (2016).

[22]

Michael Blot, David Picard, Nicolas Thome, and Matthieu Cord. 2019. Distributed optimization for deep learning with gossip exchange. Neurocomputing 330 (2019), 287–296.

[23]

Michaela Blott, Thomas B. Preußer, Nicholas J. Fraser, Giulio Gambardella, Kenneth O’Brien, Yaman Umuroglu, Miriam Leeser, and Kees Vissers. 2018. FINN-R: An end-to-end deep-learning framework for fast exploration of quantized neural networks. ACM Transactions on Reconfigurable Technology and Systems 11, 3 (2018), 1–23.

Digital Library

[24]

Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloe Kiddon, et al. 2019. Towards federated learning at scale: System design. arXiv preprint arXiv:1902.01046 (2019).

[25]

Maxence Bouvier, Alexandre Valentian, Thomas Mesquida, Francois Rummens, Marina Reyboz, Elisa Vianello, and Edith Beigne. 2019. Spiking neural networks hardware implementations and challenges. ACM Journal on Emerging Technologies in Computing Systems 15, 2 (July 2019), 1-35.

Digital Library

[26]

Harshitha Bura, Nathan Lin, Naveen Kumar, Sangram Malekar, Sushma Nagaraj, and Kaikai Liu. 2018. An edge based smart parking solution using camera networks and deep learning. In Proceedings of the 2018 IEEE International Conference on Cognitive Computing (ICCC’18). IEEE, Los Alamitos, CA, 17–24.

[27]

Seraphin B. Calo, Maroun Touna, Dinesh C. Verma, and Alan Cullen. 2017. Edge computing architecture for applying AI to IoT. In Proceedings of the 2017 IEEE International Conference on Big Data (Big Data’17). IEEE, Los Alamitos, CA, 3012–3016.

[28]

Yu Cao, Songqing Chen, Peng Hou, and Donald Brown. 2015. FAST: A fog computing assisted distributed analytics system to monitor fall for stroke mitigation. In Proceedings of the 2015 IEEE International Conference on Networking, Architecture, and Storage (NAS’15).2–11.

[29]

Guobin Chen, Wongun Choi, Xiang Yu, Tony Han, and Manmohan Chandraker. 2017. Learning efficient object detection models with knowledge distillation. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 742–751.

[30]

J. Chen and X. Ran. 2019. Deep learning with edge computing: A review. Proceedings of the IEEE 107, 8 (Aug. 2019), 1655–1674.

[31]

Ning Chen, Yu Chen, Sejun Song, Chin-Tser Huang, and Xinyue Ye. 2016. Smart urban surveillance using fog computing. In Proceedings of the 2016 IEEE/ACM Symposium on Edge Computing (SEC’16). IEEE, Los Alamitos, CA, 95–96.

[32]

Qi Chen, Xu Ma, Sihai Tang, Jingda Guo, Qing Yang, and Song Fu. 2019. F-cooper: Feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds. In Proceedings of the 4th ACM/IEEE Symposium on Edge Computing. 88–100.

Digital Library

[33]

Tung-Chien Chen, Wei-Ting Wang, Kloze Kao, Chia-Lin Yu, Code Lin, Shu-Hsin Chang, and Pei-Kuei Tsung. 2019. NeuroPilot: A cross-platform framework for edge-AI. In Proceedings of the 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS’19). IEEE, Los Alamitos, CA, 167–170.

[34]

Zhang Chiliang, Hu Tao, Guan Yingda, and Ye Zuochang. 2019. Accelerating convolutional neural networks with dynamic channel pruning. In Proceedings of the 2019 Data Compression Conference (DCC’19). IEEE, Los Alamitos, CA, 563–563.

[35]

Yujeong Choi and Minsoo Rhu. 2020. Prema: A predictive multi-task scheduling algorithm for preemptible neural processing units. In Proceedings of the 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA’20). IEEE, Los Alamitos, CA, 220–233.

[36]

Myonglae Chu, Byoungho Kim, Sangsu Park, Hyunsang Hwang, Moongu Jeon, Byoung Hun Lee, and Byung-Geun Lee. 2014. Neuromorphic hardware system for visual pattern recognition with memristor array and CMOS neuron. IEEE Transactions on Industrial Electronics 62, 4 (2014), 2410–2419.

[37]

Cisco. n.d. Cisco Fog Director. Retrieved December 17, 2020 from https://www.cisco.com/c/en/us/products/cloud-systems-management/fog-director/index.html.

[38]

David D. Clark, Craig Partridge, J. Christopher Ramming, and John T. Wroclawski. 2003. A knowledge plane for the internet. In Proceedings of the 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 3–10.

Digital Library

[39]

Edge Computing Consortium and the Industrial Internet Alliance. n.d. Edge Computing Reference Architecture 2.0. Retrieved February 16, 2022 from http://en.ecconsortium.net/Uploads/file/20180328/1522232376480704.pdf.

[40]

Chetan Sharma Consulting. 2019. Edge computing framework: Understanding the opportunity roadmap. http://docplayer.net/149826792-Edge-computing-framework-understanding-the-opportunity-roadmap-chetan-sharma.html.

[41]

Thomas Cover and Peter Hart. 1967. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13, 1 (1967), 21–27.

Digital Library

[42]

Cresco. n.d. CRESCO. Retrieved December 15, 2020 from http://cresco.io/.

[43]

Crosser. n.d. Crosser. Retrieved December 17, 2020 from https://crosser.io/.

[44]

Mingyue Cui, Shipeng Zhong, Boyang Li, Xu Chen, and Kai Huang. 2020. Offloading autonomous driving services via edge computing. IEEE Internet of Things Journal 7, 10 (2020), 10535–10547.

[45]

Jeff Daily, Abhinav Vishnu, Charles Siegel, Thomas Warfel, and Vinay Amatya. 2018. GossipGraD: Scalable deep learning using gossip communication based asynchronous gradient descent. arXiv preprint arXiv:1803.05880 (2018).

[46]

Navneet Dalal and Bill Triggs. 2005. Histograms of oriented gradients for human detection. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). 996–893.

Digital Library

[47]

Shaveta Dargan, Munish Kumar, Maruthi Rohit Ayyagari, and Gulshan Kumar. 2019. A survey of deep learning and its applications: A new paradigm to machine learning. Archives of Computational Methods in Engineering 27 (2019), 1071–1092.

[48]

Bakkiam David Deebak and Fadi Al-Turjman. 2020. A hybrid secure routing and monitoring mechanism in IoT-based wireless sensor networks. Ad Hoc Networks 97 (2020), 102022.

Digital Library

[49]

Shuiguang Deng, Hailiang Zhao, Weijia Fang, Jianwei Yin, Schahram Dustdar, and Albert Y. Zomaya. 2020. Edge intelligence: The confluence of edge computing and artificial intelligence. IEEE Internet of Things Journal 7, 8 (2020), 7457–7469.

[50]

Yunbin Deng. 2019. Deep learning on mobile devices—A review. arXiv:1904.09274 (2019).

[51]

Jorg Drechsler and Jerome P. Reiter. 2011. An empirical evaluation of easily implemented, non parametric methods for generating synthetic datasets. Computational Statistics and Data Analysis 55, 12 (Dec. 2011), 3232–3243.

[52]

Li Du, Yuan Du, Yilei Li, Junjie Su, Yen-Cheng Kuan, Chun-Chen Liu, and Mau-Chung Frank Chang. 2017. A reconfigurable streaming deep convolutional neural network accelerator for Internet of Things. IEEE Transactions on Circuits and Systems I: Regular Papers 65, 1 (2017), 198–208.

[53]

Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. Retrieved February 16, 2022 from http://archive.ics.uci.edu/ml.

[54]

Quentin Ducasse, Pascal Cotret, Loïc Lagadec, and Robert Stewart. 2021. Benchmarking quantized neural networks on FPGAs with FINN. arXiv preprint arXiv:2102.01341 (2021).

[55]

Edoardo Cavalieri d’Oro, Simone Colombo, Marco Gribaudo, Mauro Iacono, Davide Manca, and Pietro Piazzolla. 2019. Modeling and evaluating a complex edge computing based systems: An emergency management support system case study. Internet of Things 6 (2019), 100054.

[56]

Meng-Fan Chang, An Chen, Yiran Chen, K.-T. Tim Chen, X. Sharon Hu, MeiKei Ieong, Yongpan Liu, et al. 2018. White Paper on AI Chip Technologies (2018). Tsinghua University and Beijing Innovation Center for Future Chips.

[57]

Rene Hass and Jem Davies. 2019. What’s Powering Artificial Intelligence? White Paper. ARM.

[58]

Facebook. n.d. Caffe2Go. Retrieved December 3, 2020 from https://pytorch.org/.

[59]

P. FAR-EDGE. 2017. FAR-EDGE project H2020. Online. Available at http://faredge.eu/#/.

[60]

Cristian Martín Fernández, Manuel Díaz Rodríguez, and Bartolomé Rubio Muñoz. 2018. An edge computing architecture in the Internet of Things. In Proceedings of the 2018 IEEE 21st International Symposium on Real-Time Distributed Computing (ISORC’18). IEEE, Los Alamitos, CA, 99–102.

[61]

Ana Juan Ferrer, Joan Manuel Marquès, and Josep Jorba. 2019. Towards the decentralised cloud: Survey on approaches and challenges for mobile, ad hoc, and edge computing. ACM Computing Surveys 51, 6 (2019), 1–36.

Digital Library

[62]

Foghorn. n.d. Foghorn Framework. Retrieved December 17, 2020 from https://www.foghorn.io/.

[63]

Fraunhofer Institute for Integrated Circuit IIS. n.d. OGEMA. Retrieved December 3, 2020 from https://www.iis.fraunhofer.de/en/ff/lv/iot-system/tech/edge-computing/edge-framework.html.

[64]

Julien Gedeon, Jeff Krisztinkovics, Christian Meurisch, Michael Stein, Lin Wang, and Max Mühlhäuser. 2018. A multi-cloudlet infrastructure for future smart cities: An empirical study. In Proceedings of the 1st International Workshop on Edge Systems, Analytics, and Networking (EdgeSys’18). ACM, New York, NY, 19–24.

Digital Library

[65]

Volkan Gezer, Jumyung Um, and Martin Ruskowski. 2017. An extensible edge computing architecture: Definition, requirements and enablers. Proceedings of the 11th International Conference on Mobile Ubiquitous Computing, Systems, Services, and Technologies (UBICOMM’17).

[66]

Ahmed Ghoneim, Ghulam Muhammad, Syed Umar Amin, and Brij Gupta. 2018. Medical image forgery detection for smart healthcare. IEEE Communications Magazine 56, 4 (2018), 33–37.

[67]

Nam Ky Giang, Victor C. M. Leung, and Rodger Lea. 2016. On developing smart transportation applications in fog computing paradigm. In Proceedings of the 6th ACM Symposium on Development and Analysis of Intelligent Vehicular Networks and Applications (DIVANet’16). ACM, New York, NY, 91–98.

Digital Library

[68]

Andrea Giordano, Giandomenico Spezzano, and Andrea Vinci. 2016. Smart agents and fog computing for smart city applications. In Proceedings of the First International Conference on Smart Cities—Volume 9704 (Smart-CT 2016). Springer-Verlag, Berlin, Germany, 137–146.

Digital Library

[69]

Garrett B. Goh, Khushmeen Sakloth, Charles Siegel, Abhinav Vishnu, and Jim Pfaendtner. 2018. Multimodal deep neural networks using both engineered and learned representations for biodegradability prediction. arXiv preprint arXiv:1808.04456 (2018).

[70]

Google. n.d. Google Coral. Retrieved November 21, 2020 from https://coral.ai/.

[71]

Google. n.d. ML Kit. Retrieved December 3, 2020 from https://firebase.google.com/products/ml-kit.

[72]

Google. n.d. SparkFun Edge. Retrieved December 3, 2020 from https://www.sparkfun.com/products/15170.

[73]

Google. n.d. TensorFlow Lite. Retrieved November 21, 2020 from https://www.tensorflow.org/lite.

[74]

Google. n.d. TensorFlow Lite Performance. Retrieved November 21, 2020 from https://www.tensorflow.org/lite/performance/gpu_advanced.

[75]

Rekha Goyat, Gulshan Kumar, Mritunjay Kumar Rai, Rahul Saha, Reji Thomas, and Tai Hoon Kim. 2020. Blockchain powered secure range-free localization in wireless sensor networks. Arabian Journal for Science and Engineering 45, 8 (2020), 6139–6155.

[76]

Jitender Grover and Ram Murthy Garimella. 2019. Optimization in Edge Computing and Small-Cell Networks. Springer International, Cham, Switzerland, 17–31.

[77]

Chirag Gupta, Arun Sai Suggala, Ankit Goyal, Harsha Vardhan Simhadri, Bhargavi Paranjape, Ashish Kumar, Saurabh Goyal, Raghavendra Udupa, Manik Varma, and Prateek Jain. 2017. ProtoNN: Compressed and accurate kNN for resource-scarce devices. In Proceedings of the International Conference on Machine Learning. 1331–1340.

[78]

Kiryong Ha, Zhuo Chen, Wenlu Hu, Wolfgang Richter, Padmanabhan Pillai, and Mahadev Satyanarayanan. 2014. Towards wearable cognitive assistance. In Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services. 68–81.

Digital Library

[79]

Kiryong Ha, Padmanabhan Pillai, Wolfgang Richter, Yoshihisa Abe, and Mahadev Satyanarayanan. 2013. Just-in-time provisioning for cyber foraging. In Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys’13). ACM, New York, NY, 153–166.

Digital Library

[80]

Y. Hao, Y. Miao, L. Hu, M. S. Hossain, G. Muhammad, and S. U. Amin. 2019. Smart-Edge-CoCaCo: AI-enabled smart edge with joint computation, caching, and communication in heterogeneous IoT. IEEE Network 33, 2 (2019), 58–64.

[81]

Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (March 2015).

[82]

Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2020. Meta-learning in neural networks: A survey. arXiv:2004.05439 (2020).

[83]

S. K. Alamgir Hossain, Anisur Rahman, and M. Anwar Hossain. 2018. Edge computing framework for enabling situation awareness in IoT based smart city. Journal of Parallel and Distributed Computing 122 (2018), 226–237.

[84]

Xueshi Hou, Sujit Dey, Jianzhong Zhang, and Madhukar Budagavi. 2018. Predictive view generation to enable mobile 360-degree and VR experiences. In Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network. 20–26.

Digital Library

[85]

Yupin Huang, Liping Qian, Anqi Feng, Ningning Yu, and Yuan Wu. 2019. Short-term traffic prediction by two-level data driven model in 5G-enabled edge computing networks. IEEE Access 7 (2019), 123981–123991.

[86]

Zhenqiu Huang, Kwei-Jay Lin, Bo-Lung Tsai, Surong Yan, and Chi-Sheng Shih. 2018. Building edge intelligence for online activity recognition in service-oriented IoT systems. Future Generation Computer Systems 87 (2018), 557–567.

Digital Library

[87]

Chien-Chun Hung, Ganesh Ananthanarayanan, Peter Bodik, Leana Golubchik, Minlan Yu, Paramvir Bahl, and Matthai Philipose. 2018. VideoEdge: Processing camera streams using hierarchical clusters. In Proceedings of the 2018 IEEE/ACM Symposium on Edge Computing (SEC’18). IEEE, Los Alamitos, CA, 115–131.

[88]

Loc N. Huynh, Youngki Lee, and Rajesh Krishna Balan. 2017. DeepMon: Mobile GPU-based deep learning framework for continuous vision applications. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. 82–95.

Digital Library

[89]

Intel. n.d. Intel Movidius. Retrieved December 3, 2020 from https://www.movidius.com/.

[90]

Intel and Nokia Siemens Networks. 2013. Increasing Mobile Operators’ Value Proposition with Edge Computing. Technical Brief. Intel.

[91]

ONR MURI Intel and NSF. n.d. Kinect Dataset. Retrieved November 21, 2020 from https://rgbd-dataset.cs.washington.edu/publications.html

[92]

Google I/O. n.d. Google TPU. Accessed January 24, 2021 from https://coral.ai/docs/edgetpu/faq/.

[93]

Mauro Isaja, John Soldatos, and Volkan Gezer. 2017. Combining edge computing and blockchains for flexibility and performance in industrial automation. In Proceedings of the International Conference on Mobile Ubiquitous Computing, Systems, Services, and Technologies (UBICOMM’17).

[94]

Kusumlata Jain and Smaranika Mohapatra. 2019. Taxonomy of Edge Computing: Challenges, Opportunities, and Data Reduction Methods. Springer International, Cham, Switzerland, 51–69.

[95]

David Jeans. 2019. Related’s Hudson Yards: Smart city or surveillance city? Online. Available at https://therealdeal.com/2019/03/15/hudsonyards-smart-city-or-surveillance-city/.

[96]

Amit Jindal, Andrew Tulloch, Ben Sharma, Bram Wasti, Fei Yang, Georgia Gkioxari, Jaeyoun Kim, et al. 2018. Enabling full body AR with Mask R-CNN2Go. https://research.facebook.com/blog/2018/01/enabling-full-body-ar-with-mask-r-cnn2go/.

[97]

Yiping Kang, Johann Hauswald, Cao Gao, Austin Rovinski, Trevor Mudge, Jason Mars, and Lingjia Tang. 2017. Neurosurgeon: Collaborative intelligence between the cloud and mobile edge. ACM SIGARCH Computer Architecture News 45, 1 (2017), 615–629.

Digital Library

[98]

Wolfgang Kellerer, Patrick Kalmbach, Andreas Blenk, Arsany Basta, Martin Reisslein, and Stefan Schmid. 2019. Adaptable and data-driven softwarized networks: Review, opportunities, and challenges. Proceedings of the IEEE 107, 4 (2019), 711–731.

[99]

Wazir Zada Khan, Ejaz Ahmed, Saqib Hakak, Ibrar Yaqoob, and Arif Ahmed. 2019. Edge computing: A survey. Future Generation Computer Systems 97 (2019), 219–235.

Digital Library

[100]

Shweta Prabhat Khare, Janos Sallai, Abhishek Dubey, and Aniruddha Gokhale. 2017. Short paper: Towards low-cost indoor localization using edge computing resources. In Proceedings of the 2017 IEEE 20th International Symposium on Real-Time Distributed Computing (ISORC’17). IEEE, Los Alamitos, CA, 28–31.

[101]

Hyongsuk Kim, Maheshwar Pd. Sah, Changju Yang, Tamás Roska, and Leon O. Chua. 2011. Neural synaptic weighting with a pulse-based memristor circuit. IEEE Transactions on Circuits and Systems I: Regular Papers 59, 1 (2011), 148–158.

[102]

Oanh Tran Thi Kim, Nguyen Dang Tri, Van Dung Nguyen, Nguyen H. Tran, and Choong Seon Hong. 2015. A shared parking model in vehicular network using fog and cloud environment. In Proceedings of the 2015 17th Asia-Pacific Network Operations and Management Symposium (APNOMS’15). IEEE, Los Alamitos, CA, 321–326.

[103]

Shamik Kundu, Kanad Basu, Mehdi Sadi, Twisha Titirsha, Shihao Song, Anup Das, and Ujjwal Guin. 2021. Special session: Reliability analysis for ML/AI hardware. arXiv preprint arXiv:2103.12166 (2021).

[104]

Aditya Kusupati, Manish Singh, Kush Bhatia, Ashish Kumar, Prateek Jain, and Manik Varma. 2019. FastGRNN: A fast, accurate, stable and tiny kilobyte sized gated recurrent neural network. arXiv preprint arXiv:1901.02358 (2019).

[105]

Griffin Lacey, Graham W. Taylor, and Shawki Areibi. 2016. Deep learning on FPGAs: Past, present, and future. arXiv preprint arXiv:1602.04283 (2016).

[106]

Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016. Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360 (2016).

[107]

Yen-Lin Lee, Pei-Kuei Tsung, and Max Wu. 2018. Technology trend of edge AI. In Proceedings of the 2018 International Symposium on VLSI Design, Automation, and Test (VLSI-DAT’18). IEEE, Los Alamitos, CA, 1–2.

[108]

Adisorn Lertsinsrubtavee, Anwaar Ali, Carlos Molina-Jimenez, Arjuna Sathiaseelan, and Jon Crowcroft. 2017. PiCasso: A lightweight edge computing platform. In Proceedings of the 2017 IEEE 6th International Conference on Cloud Networking (CloudNet’17). IEEE, Los Alamitos, CA, 1–7.

[109]

Dawei Li, Theodoros Salonidis, N. Desai, and M. Chuah. 2016. DeepCham: Collaborative edge-mediated adaptive deep learning for mobile object recognition. In Proceedings of the 2016 IEEE/ACM Symposium on Edge Computing (SEC’16).64–76.

[110]

E. Li, L. Zeng, Z. Zhou, and X. Chen. 2020. Edge AI: On-demand accelerating deep neural network inference via edge computing. IEEE Transactions on Wireless Communications 19, 1 (2020), 447–457.

[111]

Hongshan Li, Chenghao Hu, Jingyan Jiang, Zhi Wang, Yonggang Wen, and Wenwu Zhu. 2018. JALAD: Joint accuracy-and latency-aware deep structure decoupling for edge-cloud execution. In Proceedings of the 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS’18). IEEE, Los Alamitos, CA, 671–678.

[112]

Hongxing Li, Guochu Shou, Yihong Hu, and Zhigang Guo. 2016. Mobile edge computing: Progress and challenges. In Proceedings of the 2016 4th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud’16). IEEE, Los Alamitos, CA, 83–84.

[113]

Li-Jia Li, Hao Su, Fei-Fei Li, and Eric P. Xing. 2010. Object bank: A high-level image representation for scene classification & semantic feature sparsification. In Advances in Neural Information Processing Systems 23 (NIPS’10).

[114]

Wenbin Li and Matthieu Liewig. 2020. A survey of AI accelerators for edge environment. In World Conference on Information Systems and Technologies. Springer, 35–44.

[115]

Ji Lin, Yongming Rao, Jiwen Lu, and Jie Zhou. 2017. Runtime neural pruning. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 2178–2188.

Digital Library

[116]

The Linux Foundation Projects. n.d. EdgeX. Retrieved December 15, 2020 from https://www.edgexfoundry.org/.

[117]

Hong Liu, Yan Zhang, and Tao Yang. 2018. Blockchain-enabled security in electric vehicles cloud and edge computing. IEEE Network 32, 3 (2018), 78–83.

[118]

Kaikai Liu, Abhishek Gurudutt, Tejeshwar Kamaal, Chinmayi Divakara, and Praveen Prabhakaran. 2017. Edge computing framework for distributed smart applications. In Proceedings of the 2017 IEEE Conference on SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computed, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart City Innovation (SmartWorld/SCALCOM/UIC/ ATC/CBDCom/IOP/SCI’17). IEEE, Los Alamitos, CA, 1–8.

[119]

Lei Liu, Chen Chen, Qingqi Pei, Sabita Maharjan, and Yan Zhang. 2020. Vehicular edge computing and networking: A survey. arXiv:1980.06849 (2020).

[120]

Luyang Liu, Hongyu Li, and Marco Gruteser. 2019. Edge assisted real-time object detection for mobile augmented reality. In Proceedings of the 25th Annual International Conference on Mobile Computing and Networking. 1–16.

Digital Library

[121]

Sicong Liu, Junzhao Du, Kaiming Nan, Zimu Zhou, Hui Liu, Zhangyang Wang, and Yingyan Lin. 2020. AdaDeep: A usage-driven, automated deep model compression framework for enabling ubiquitous intelligent mobiles. IEEE Transactions on Mobile Computing 20 (2020), 3282–3297.

[122]

Shaoshan Liu, Liangkai Liu, Jie Tang, Bo Yu, Yifan Wang, and Weisong Shi. 2019. Edge computing for autonomous driving: Opportunities and challenges. Proceedings of the IEEE 107, 8 (2019), 1697–1716.

[123]

Yi Liu, Chao Yang, Li Jiang, Shengli Xie, and Yan Zhang. 2019. Intelligent edge computing for IoT-based energy management in smart cities. IEEE Network 33, 2 (2019), 111–117.

[124]

Christine Long. 2019. BeagleBone AI Makes a Sneak Preview. Retrieved December 17, 2020 from https://beagleboard.org/blog/2019-05-16-beaglebone-ai-preview.

[125]

Macchina. n.d. Macchina Platform for the Network Edge. Retrieved November 21, 2020 from https://macchina.io/.

[126]

Rasel Mahmud, Ranganath Vallakati, Anupam Mukherjee, Prakash Ranganathan, and Arash Nejadpak. 2015. A survey on smart grid metering infrastructures: Threats and solutions. In Proceedings of the 2015 IEEE International Conference on Electro/Information Technology (EIT’15). IEEE, Los Alamitos, CA, 386–391.

[127]

Ling Mao, Mei Xie, Yi Huang, and Yuefei Zhang. 2010. Preceding vehicle detection using histograms of oriented gradients. In Proceedings of the 2010 International Conference on Communications, Circuits, and Systems (ICCCAS’10). IEEE, Los Alamitos, CA, 354–358.

[128]

Gary A. McGilvary, Adam Barker, and Malcolm Atkinson. 2015. Ad hoc cloud computing. In Proceedings of the 2015 IEEE 8th International Conference on Cloud Computing. IEEE, Los Alamitos, CA, 1063–1068.

Digital Library

[129]

Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. 1273–1282.

[130]

Mahshid Mehrabi, Dongho You, Vincent Latzko, Hani Salah, Martin Reisslein, and Frank H. P. Fitzek. 2019. Device-enhanced MEC: Multi-access edge computing (MEC) aided by end device computation and caching: A survey. IEEE Access 7 (2019), 166079–166108.

[131]

Albert Mestres, Alberto Rodriguez-Natal, Josep Carner, Pere Barlet-Ros, Eduard Alarcón, Marc Solé, Victor Muntés-Mulero, et al. 2017. Knowledge-defined networking. ACM SIGCOMM Computer Communication Review 47, 3 (2017), 2–10.

Digital Library

[132]

Microsoft. n.d. Azure IoT Edge. Retrieved December 17, 2020 from https://azure.microsoft.com/es-es/services/iot-edge/.

[133]

MIT. n.d. MIT Pedestrian Database. Retrieved December 22, 2020 from http://cbcl.mit.edu/software-datasets/PedestrianData.html.

[134]

Mitch Tseng, Todd Edmunds, and Lalit Canaran. 2018. Introduction to edge computing in IIoT. https://www.iiconsortium.org/pdf/Introduction_to_Edge_Computing_in_IIoT_2018-06-18.pdf.

[135]

M. Mohammadi, A. Al-Fuqaha, S. Sorour, and M. Guizani. 2018. Deep learning for IoT big data and streaming analytics: A survey. IEEE Communications Surveys Tutorials 20, 4 (2018), 2923–2960.

Digital Library

[136]

Khan Muhammad, Salman Khan, Vasile Palade, Irfan Mehmood, and Victor Hugo C. De Albuquerque. 2019. Edge intelligence-assisted smoke detection in foggy surveillance environments. IEEE Transactions on Industrial Informatics 16, 2 (2019), 1067–1075.

[137]

M. G. Sarwar Murshed, Christopher Murphy, Daqing Hou, Nazar Khan, Ganesh Ananthanarayanan, and Faraz Hussain. 2019. arXiv:1908.00080 (2019).

[138]

R. K. Naha, S. Garg, D. Georgakopoulos, P. P. Jayaraman, L. Gao, Y. Xiang, and R. Ranjan. 2018. Fog computing: Survey of trends, architectures, requirements, and research directions. IEEE Access 6 (2018), 47980–48009.

[139]

Feng Nan, Joseph Wang, and Venkatesh Saligrama. 2016. Pruning random forests for prediction on a budget. In Advances in Neural Information Processing Systems. 2334–2342.

[140]

Deepak Narayanan, Aaron Harlap, Amar Phanishayee, Vivek Seshadri, Nikhil R. Devanur, Gregory R. Ganger, Phillip B. Gibbons, and Matei Zaharia. 2019. PipeDream: Generalized pipeline parallelism for DNN training. In Proceedings of the 27th ACM Symposium on Operating Systems Principles. 1–15.

Digital Library

[141]

Pedro J. Navarro, Carlos Fernandez, Raul Borraz, and Diego Alonso. 2017. A machine learning approach to pedestrian detection for autonomous vehicles using high-definition 3D range data. Sensors 17, 1 (2017), 18.

[142]

Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee, and Andrew Y. Ng. 2011. Multimodal deep learning. In Proceedings of the 28th International Conference in Machine Learning (ICML’11). 689–696.

[143]

Nuance. n.d. Dragon NaturallySpeaking. Retrieved January 24, 2021 from https://www.nuance.com/dragon.html.

[144]

Nvidia. n.d. Nvidia Jetson Nano. Retrieved November 21, 2020 from https://www.nvidia.com/es-es/autonomous-machines/embedded-systems/jetson-nano/.

[145]

W. Ouyang and X. Wang. 2013. Joint deep learning for pedestrian detection. In Proceedings of the IEEE International Conference on Computer Vision.2056–2063.

[146]

Sinno Jialin Pan and Qiang Yang. 2009. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22, 10 (2009), 1345–1359.

Digital Library

[147]

Z. Pang, L. Sun, Z. Wang, E. Tian, and S. Yang. 2015. A survey of cloudlet based mobile computing. In Proceedings of the 2015 International Conference on Cloud Computing and Big Data (CCBD’15). 268–275.

Digital Library

[148]

Diego Peteiro-Barral and Bertha Guijarro-Berdiñas. 2013. A survey of methods for distributed machine learning. Progress in Artificial Intelligence 2, 1 (2013), 1–11.

[149]

Quoc-Viet Pham, Fang Fang, Vu Nguyen Ha, Jalil Piran, Mai Le, Long Bao Le, Won-Joo Hwang, and Zhiguo Ding. 2020. A survey of multi-access edge computing in 5G and beyond: Fundamentals, technology integration, and state-of-the-art. IEEE Access 8 (2020), 116974–117017.

[150]

G. Plastiras, M. Terzi, C. Kyrkou, and T. Theocharidcs. 2018. Edge intelligence: Challenges and opportunities of near-sensor machine learning applications. In Proceedings of the 2018 IEEE 29th International Conference on Application-specific Systems, Architectures, and Processors (ASAP’18). 1–7.

[151]

Jiantao Qiu, Jie Wang, Song Yao, Kaiyuan Guo, Boxun Li, Erjin Zhou, Jincheng Yu, et al. 2016. Going deeper with embedded FPGA platform for convolutional neural network. In Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays.26–35.

Digital Library

[152]

Hasibur Rahman, Rahim Rahmani, and Theo Kanter. 2019. The role of mobile edge computing towards assisting IoT with distributed intelligence: A smartliving perspective. In Mobile Solutions and Their Usefulness in Everyday Life. Springer, 33–45.

[153]

Amir M. Rahmani, Tuan Nguyen Gia, Behailu Negash, Arman Anzanpour, Iman Azimi, Mingzhe Jiang, and Pasi Liljeberg. 2018. Exploiting smart e-Health gateways at the edge of Healthcare Internet-of-Things: A fog computing approach. Future Generation Computer Systems 78 (2018), 641–658.

Digital Library

[154]

Partha Pratim Ray, Dinesh Dash, and Debashis De. 2019. Edge computing for Internet of Things: A survey, e-healthcare case study and future direction. Journal of Network and Computer Applications 140 (2019), 1–22.

Digital Library

[155]

Partha Pratim Ray, Dinesh Dash, and Debashis De. 2019. Edge computing for Internet of Things: A survey, e-healthcare case study and future direction. Journal of Network and Computer Applications 140 (2019), 1–22.

Digital Library

[156]

Brandon Reagen, Paul Whatmough, Robert Adolf, Saketh Rama, Hyunkwang Lee, Sae Kyu Lee, José Miguel Hernández-Lobato, Gu-Yeon Wei, and David Brooks. 2016. Minerva: Enabling low-power, highly-accurate deep neural network accelerators. In Proceedings of the 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA’16). IEEE, Los Alamitos, CA, 267–278.

Digital Library

[157]

Byron Reese. 2019. AI at the Edge: A GigaOm Research Byte. ARM.

[158]

Ju Ren, Hui Guo, Chugui Xu, and Yaoxue Zhang. 2017. Serving at the edge: A scalable IoT architecture based on transparent computing. IEEE Network 31, 5 (2017), 96–105.

Digital Library

[159]

S. Yao, S. Hu, Y. Zhao, A. Zhang, and T. Abdelzaher. 2017. DeepSense: A unified deep learning framework for time-series mobile sensing data processing. In Proceedings of the 26th International Conference on World Wide Web.351–360.

[160]

D. Sabella, Alessandro Vaillant, Pekka Kuure, U. Rauschenbach, and F. Giust. 2016. Mobile-edge computing architecture: The role of MEC in the Internet of Things. IEEE Consumer Electronics Magazine 5 (2016), 84–91.

[161]

Semir Salkic, Baris Can Ustundag, Tarik Uzunovic, and Edin Golubovic. 2019. Edge computing framework for wearable sensor-based human activity recognition. In Proceedings of the International Symposium on Innovative and Interdisciplinary Applications of Advanced Technologies. 376–387.

[162]

David Sarabia-Jácome, Ignacio Lacalle, Carlos E. Palau, and Manuel Esteve. 2019. Efficient deployment of predictive analytics in edge gateways: Fall detection scenario. In Proceedings of the 2019 IEEE 5th World Forum on Internet of Things (WF-IoT’19). IEEE, Los Alamitos, CA, 41–46.

[163]

Kewei Sha, T. Andrew Yang, Wei Wei, and Sadegh Davari. 2020. A survey of edge computing-based designs for IoT security. Digital Communications and Networks 6, 2 (2020), 195–202.

[164]

Syed Danial Ali Shah, Mark A. Gregory, and Shuo Li. 2021. Cloud-native network slicing using software defined networking based multi-access edge computing: A survey. IEEE Access 9 (2021), 10903–10924.

[165]

C. Shi, Z. Ren, K. Yang, C. Chen, H. Zhang, Y. Xiao, and X. Hou. 2018. Ultra-low latency cloud-fog computing for Industrial Internet of Things. In Proceedings of the 2018 IEEE Wireless Communications and Networking Conference (WCNC’18). 1–6.

Digital Library

[166]

Weisong Shi, Jie Cao, Quan Zhang, Youhuizi Li, and Lanyu Xu. 2016. Edge computing: Vision and challenges. IEEE Internet of Things Journal 3, 5 (2016), 637–646.

[167]

Jamie Shotton, Toby Sharp, Pushmeet Kohli, Sebastian Nowozin, John Winn, and Antonio Criminisi. 2016. Decision jungles: Compact and rich models for classification. In Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS’13). 234–242.

[168]

Taylor Simons and Dah-Jye Lee. 2019. A review of binarized neural networks. Electronics 8, 6 (June 2019), 661.

[169]

Inés Sittón-Candanedo, Ricardo S. Alonso, Juan M. Corchado, Sara Rodríguez-González, and Roberto Casado-Vara. 2019. A review of edge computing reference architectures and a new global edge proposal. Future Generation Computer Systems 99 (2019), 278–294.

Digital Library

[170]

Inés Sittón-Candanedo, Ricardo S. Alonso, Óscar García, Lilia Muñoz, and Sara Rodríguez-González. 2019. Edge computing, IoT and social computing in smart energy scenarios. Sensors 19, 15 (2019), 3353.

[171]

A. H. Sodhro, S. Pirbhulal, and V. H. C. de Albuquerque. 2019. Artificial intelligence-driven mechanism for edge computing-based industrial applications. IEEE Transactions on Industrial Informatics 15, 7 (July 2019), 4235–4243.

[172]

Gopinath Sridhar, Ghanathe Nikhil, Seshadri Vivek, and Rahul Sharma. 2019. Machine learning models to tiny IoT devices. In Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation.79–95.

[173]

Vladimir Stantchev, Ahmed Barnawi, Sarfaraz Ghulam, Johannes Schubert, and Gerrit Tamm. 2015. Smart items, fog and cloud computing as enablers of servitization in healthcare. Sensors & Transducers 185, 2 (2015), 121.

[174]

Pei-Kuei Tsung, Tung-Chien Chen, Chien-Hung Lin, Chih-Yu Chang, and Jih-Ming Hsu. 2019. Heterogeneous computing for edge AI. In Proceedings of the 2019 International Symposium on VLSI Design, Automation, and Test (VLSI-DAT’19). IEEE, Los Alamitos, CA, 1–2.

[175]

Thavavel Vaiyapuri, Velmurugan Subbiah Parvathy, V. Manikandan, N. Krishnaraj, Deepak Gupta, and K. Shankar. 2021. A novel hybrid optimization for cluster-based routing protocol in information-centric wireless sensor networks for IoT based mobile edge computing. Wireless Personal Communications 2021 (2021), 1–24.

Digital Library

[176]

General Vision. n.d. Neuroshield. Retrieved November 21, 2020 from https://www.general-vision.com/hardware/neuroshield/

[177]

Shiqiang Wang, Tiffany Tuor, Theodoros Salonidis, Kin Leung, Christian Makaya, Ting He, and Kevin Chan. 2018. When edge meets learning: Adaptive control for resource-constrained distributed machine learning. In Proceedings of the 2018 IEEE INFOCOM Conference.

Digital Library

[178]

Xiaofei Wang, Yiwen Han, Victor C. M. Leung, Dusit Niyato, Xueqiang Yan, and Xu Chen. 2020. Convergence of edge computing and deep learning: A comprehensive survey. IEEE Communications Surveys & Tutorials 22, 2 (2020), 869–904.

[179]

Xiaofei Wang, Yiwen Han, Chenyang Wang, Qiyang Zhao, Xu Chen, and Min Chen. 2019. In-Edge AI: Intelligentizing mobile edge computing, caching and communication by federated learning. IEEE Network 33, 5 (2019), 156–165.

Digital Library

[180]

James Warren and Nathan Marz. 2015. Big Data: Principles and Best Practices of Scalable Realtime Data Systems. Simon & Schuster.

[181]

Xuechao Wei, Cody Hao Yu, Peng Zhang, Youxiang Chen, Yuxin Wang, Han Hu, Yun Liang, and Jason Cong. 2017. Automated systolic array architecture synthesis for high throughput CNN inference on FPGAs. In Proceedings of the 54th Annual Design Automation Conference.1–6.

Digital Library

[182]

M. Wolf. 2019. Machine learning + Distributed IoT = Edge intelligence. In Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS’19). 1715–1719.

[183]

Carole-Jean Wu, David Brooks, Kevin Chen, Douglas Chen, Sy Choudhury, Marat Dukhan, Kim Hazelwood, et al. 2019. Machine learning at Facebook: Understanding inference at the edge. In Proceedings of the 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA’19). IEEE, Los Alamitos, CA, 331–344.

[184]

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, et al. 2016. Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint arXiv:1609.08144 (2016).

[185]

Timo Wunderlich, Akos F. Kungl, Eric Müller, Andreas Hartel, Yannik Stradmann, Syed Ahmed Aamir, Andreas Grübl, et al. 2019. Demonstrating advantages of neuromorphic computation: A pilot study. Frontiers in Neuroscience 13 (2019), 260.

[186]

Xnor. n.d. AI2GO. Retrieved December 3, 2020 from https://www.xnor.ai/.

[187]

Zhijie Yang, Lei Wang, Dong Ding, Xiangyu Zhang, Yu Deng, Shiming Li, and Qiang Dou. 2018. Systolic array based accelerator and algorithm mapping for deep learning algorithms. In IFIP International Conference on Network and Parallel Computing. Springer, 153–158.

[188]

Zhi Yang, Ben Y. Zhao, Yuanjian Xing, Song Ding, Feng Xiao, and Yafei Dai. 2010. AmazingStore: Available, low-cost online storage service using cloudlets. In Proceedings of the 9th International Conference on Peer-to-Peer Systems (IPTPS’10). 2. http://dl.acm.org/citation.cfm?id=1863145.1863147.

[189]

Shuochao Yao, Yiran Zhao, Aston Zhang, Lu Su, and Tarek Abdelzaher. 2017. DeepIoT: Compressing deep neural network structures for sensing systems with a compressor-critic framework. In Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems. 1–14.

Digital Library

[190]

Shouyi Yin, Peng Ouyang, Shibin Tang, Fengbin Tu, Xiudong Li, Leibo Liu, and Shaojun Wei. 2017. A 1.06-to-5.09 TOPS/W reconfigurable hybrid-neural-network processor for deep learning applications. In Proceedings of the 2017 Symposium on VLSI Circuits. IEEE, Los Alamitos, CA, C26–C27.

[191]

Shouyi Yin, Peng Ouyang, Shibin Tang, Fengbin Tu, Xiudong Li, Shixuan Zheng, Tianyi Lu, Jiangyuan Gu, Leibo Liu, and Shaojun Wei. 2017. A high energy efficient reconfigurable hybrid neural network processor for deep learning applications. IEEE Journal of Solid-State Circuits 53, 4 (2017), 968–982.

[192]

Tom Young, Devamanyu Hazarika, Soujanya Poria, and Erik Cambria. 2018. Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine 13, 3 (2018), 55–75.

[193]

Qi Yu, Chao Wang, Xiang Ma, Xi Li, and Xuehai Zhou. 2015. A deep learning prediction process accelerator based FPGA. In Proceedings of the 2015 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing. IEEE, Los Alamitos, CA, 1159–1162.

Digital Library

[194]

Wei Yu, Fan Liang, Xiaofei He, William Grant Hatcher, Chao Lu, Jie Lin, and Xinyu Yang. 2017. A survey on the edge computing for the Internet of Things. IEEE Access 6 (2017), 6900–6919.

[195]

J. K. Zao, T. T. Gan, C. K. You, S. J. R. Mendez, C. E. Chung, Y. T. Wang, T. Mullen, and T. P. Jung. 2014. Augmented brain computer interaction based on fog computing and linked data. In Proceedings of the 2014 International Conference on Intelligent Environments. 374–377.

Digital Library

[196]

Muhammad Sharjeel Zareen, Shahzaib Tahir, Monis Akhlaq, and Baber Aslam. 2019. Artificial intelligence/machine learning in IoT for authentication and authorization of edge devices. In Proceedings of the 2019 International Conference on Applied and Engineering Mathematics (ICAEM’19). 220–224.

[197]

Tan Zhang, Aakanksha Chowdhery, Paramvir Bahl, Kyle Jamieson, and Suman Banerjee. 2015. The design and implementation of a wireless video surveillance system. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 426–438.

Digital Library

[198]

Xingzhou Zhang, Yifan Wang, Sidi Lu, Liangkai Liu, Lanyu Xu, and Weisong Shi. 2019. OpenEI: An open framework for edge intelligence. In Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS’19). IEEE, Los Alamitos, CA, 1840–1851.

[199]

Xingzhou Zhang, Yifan Wang, and Weisong Shi. 2018. pCAMP: Performance comparison of machine learning packages on the edges. In Proceedings of the USENIX Workshop on Hot Topics in Edge Computing (HotEdge’18).

[200]

Yongli Zhao, Boyuan Yan, Wei Wang, Yi Lin, and Jie Zhang. 2019. On-board artificial intelligence based on edge computing in optical transport networks. In Proceedings of the 2019 Optical Fiber Communications Conference and Exhibition (OFC’19). IEEE, Los Alamitos, CA, 1–3.

[201]

Zhuoran Zhao, Kamyar Mirzazad Barijough, and Andreas Gerstlauer. 2018. DeepThings: Distributed adaptive deep learning inference on resource-constrained iot edge clusters. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 37, 11 (2018), 2348–2359.

[202]

Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang. 2019. Edge intelligence: Paving the last mile of artificial intelligence with edge computing. Proceedings of the IEEE 107, 8 (Aug. 2019), 1738–1762.

Cited By

Liu XLv JKim BLi KJin HGao WBai J(2025)Cooperative Digital Healthcare Task Scheduling and Resource Management in Edge Intelligence SystemsTsinghua Science and Technology10.26599/TST.2024.901014030:2(926-945)Online publication date: Apr-2025
https://doi.org/10.26599/TST.2024.9010140
Loconte DIeva SGramegna FBilenchi IFasciano CPinto ALoseto GScioscia FRuta MDi Sciascio E(2025)Serverless Microservice Architecture for Cloud-Edge Intelligence in Sensor NetworksIEEE Sensors Journal10.1109/JSEN.2024.350225425:5(7875-7885)Online publication date: 1-Mar-2025
https://doi.org/10.1109/JSEN.2024.3502254
Shafee AHasan SAwaad T(2025)Privacy and security vulnerabilities in edge intelligence: An analysis and countermeasuresComputers and Electrical Engineering10.1016/j.compeleceng.2025.110146123(110146)Online publication date: Apr-2025
https://doi.org/10.1016/j.compeleceng.2025.110146
Show More Cited By

Index Terms

Edge Intelligence: Concepts, Architectures, Applications, and Future Directions
1. Computing methodologies
  1. Artificial intelligence
  2. Machine learning
2. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

A Survey on Edge Intelligence and Lightweight Machine Learning Support for Future Applications and Services
As the number of devices connected to the Internet has grown larger, so too has the intensity of the tasks that these devices need to perform. Modern networks are more frequently working to perform computationally intensive tasks on low-power devices and ...
Roadmap for edge AI: a Dagstuhl perspective

Based on the collective input of Dagstuhl Seminar (21342), this paper presents a comprehensive discussion on AI methods and capabilities in the context of edge computing, referred as Edge AI. In a nutshell, we envision Edge AI to provide adaptation for ...
Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy
MECOMM'18: Proceedings of the 2018 Workshop on Mobile Edge Communications

As the backbone technology of machine learning, deep neural networks (DNNs) have have quickly ascended to the spotlight. Running DNNs on resource-constrained mobile devices is, however, by no means trivial, since it incurs high performance and energy ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Embedded Computing Systems

ACM Transactions on Embedded Computing Systems Volume 21, Issue 5

September 2022

526 pages

ISSN:1539-9087

EISSN:1558-3465

DOI:10.1145/3561947

Editor:
Tulika Mitra
National University of Singapore, Singapore

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 08 October 2022

Online AM: 26 January 2022

Accepted: 12 September 2021

Revised: 12 July 2021

Received: 06 April 2021

Published in TECS Volume 21, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

KI-Flex
German Federal Ministry of Education and Research (BMBF)
Microelectronic from Germany
Spanish Ministry of Science and Innovation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
3,051
Total Downloads

Downloads (Last 12 months)811
Downloads (Last 6 weeks)69

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu XLv JKim BLi KJin HGao WBai J(2025)Cooperative Digital Healthcare Task Scheduling and Resource Management in Edge Intelligence SystemsTsinghua Science and Technology10.26599/TST.2024.901014030:2(926-945)Online publication date: Apr-2025
https://doi.org/10.26599/TST.2024.9010140
Loconte DIeva SGramegna FBilenchi IFasciano CPinto ALoseto GScioscia FRuta MDi Sciascio E(2025)Serverless Microservice Architecture for Cloud-Edge Intelligence in Sensor NetworksIEEE Sensors Journal10.1109/JSEN.2024.350225425:5(7875-7885)Online publication date: 1-Mar-2025
https://doi.org/10.1109/JSEN.2024.3502254
Shafee AHasan SAwaad T(2025)Privacy and security vulnerabilities in edge intelligence: An analysis and countermeasuresComputers and Electrical Engineering10.1016/j.compeleceng.2025.110146123(110146)Online publication date: Apr-2025
https://doi.org/10.1016/j.compeleceng.2025.110146
Xu YKhan TSong YMeijering E(2025)Edge deep learning in computer vision and medical diagnostics: a comprehensive surveyArtificial Intelligence Review10.1007/s10462-024-11033-558:3Online publication date: 17-Jan-2025
https://doi.org/10.1007/s10462-024-11033-5
Li XChen M(2024)RT-Cabi: an Internet of Things based framework for anomaly behavior detection with data correction through edge collaboration and dynamic feature fusionPeerJ Computer Science10.7717/peerj-cs.230610(e2306)Online publication date: 21-Oct-2024
https://doi.org/10.7717/peerj-cs.2306
Peter P G(2024)New Scientific Field for Modelling Complex Dynamical Systems: The Cybernetics Artificial Intelligence (CAI)IgMin Research10.61927/igmin1832:5(323-340)Online publication date: 8-May-2024
https://doi.org/10.61927/igmin183
Chougule SChaudhari BGhorpade SZennaro M(2024)Exploring Computing Paradigms for Electric Vehicles: From Cloud to Edge Intelligence, Challenges and Future DirectionsWorld Electric Vehicle Journal10.3390/wevj1502003915:2(39)Online publication date: 26-Jan-2024
https://doi.org/10.3390/wevj15020039
Sharma SPopli RSingh SChhabra GSaini GSingh MSandhu ASharma AKumar R(2024)The Role of 6G Technologies in Advancing Smart City Applications: Opportunities and ChallengesSustainability10.3390/su1616703916:16(7039)Online publication date: 16-Aug-2024
https://doi.org/10.3390/su16167039
Tyagi NSingh JSingh SSehra S(2024)A 3D Model-Based Framework for Real-Time Emergency Evacuation Using GIS and IoT DevicesISPRS International Journal of Geo-Information10.3390/ijgi1312044513:12(445)Online publication date: 9-Dec-2024
https://doi.org/10.3390/ijgi13120445
Diana MKiyama MAmagasaki MIto MMorishita Y(2024)Advanced Implementation of DNN Translator using ResNet9 for Edge DevicesInternational Journal of Networking and Computing10.15803/ijnc.14.2_14514:2(145-156)Online publication date: 2024
https://doi.org/10.15803/ijnc.14.2_145
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents