Skip to main content

Advertisement

Springer Nature Link
Log in

An evaluation of EfficientDet for object detection used for indoor robots assistance navigation

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Indoor object detection and recognition present one of the most crucial tasks for computer vision and robotic systems. Developing new intelligent autonomous robots is required in various applications including blind and visually impaired people assistance navigation and smart healthcare. Intelligent robots navigation is still a very challenging problem as it involves various aspects including indoor objects detection, recognition and scene understanding. We propose in this work to develop an indoor object detection system that can be used for intelligent vision of robotics applications. We ensure in this paper a lightweight implementation of the system using EfficientDet neural network. The proposed work presents a vision-based detection system able to work on real mobile robots by studying and considering their limited resources implementations. To ensure a lightweight implementation of the proposed indoor objects detection system and to design a deployable system in mobile robots application, we applied the weights pruning technique. To contribute for an embedded implementation of the proposed system, we used a pruning method which successfully reduced the network size, complexity and computation resources. Experimental results have demonstrated the robustness of the proposed indoor object detection system that can be deployed for indoor robotics assistance navigation systems. Based on the obtained results, we note that the proposed system achieved very competitive results in terms of detection precision as well as processing time. The proposed system can runs in low-end devices as we succeeded to reduce the parameters and FLOPs number, we achieved 89% on the testing set of the proposed indoor data set for EfficientDet D2. We achieved 31 FPS for the basic EfficientDet model and 38 FPS for the pruned model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Mehta, J., Ramnani, E., et Singh, S.: Face detection and tagging using deep learning. In: 2018 International Conference on Computer, Communication, and Signal Processing (ICCCSP). IEEE, pp. 1–6 (2018)

  2. Ayachi, R., Said, Y., et Abdelaali, A.B.: Pedestrian detection based on light-weighted separable convolution for advanced driver assistance systems. Neural Proc. Lett. 52(3), 2655–2668 (2020)

    Article  Google Scholar 

  3. Ayachi, R., Afif, M., Said, Y., et al.: Pedestrian detection for advanced driving assisting system: a transfer learning approach. In: 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP). IEEE, pp. 1–5 (2020)

  4. Ayachi, R., Afif, M., Said, Y., et al.: Traffic signs detection for real-world application of an advanced driving assisting system using deep learning. Neural Process. Lett. 51(1), 837–851 (2020)

    Article  Google Scholar 

  5. Afif, M., Said, Y., Pissaloux, E., et al.: Recognizing signs and doors for Indoor Wayfinding for Blind and Visually Impaired Persons. In: 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP). IEEE, pp. 1–4 (2020)

  6. Afif, M., Ayachi, R., Said, Y., et al.: An evaluation of retinanet on indoor object detection for blind and visually impaired persons assistance navigation. Neural Process. Lett. 51(3), 2265–2279 (2020)

    Article  Google Scholar 

  7. Afif, M., Ayachi, R., Pissaloux, E., et al.: Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people. Multimed. Tools Appl. 79(41), 31645–31662 (2020)

    Article  Google Scholar 

  8. Afif, M., Ayachi, R., Said, Y., et al.: Deep learning based application for indoor scene recognition. Neural Process. Lett. 51(3), 2827–2837 (2020)

    Article  Google Scholar 

  9. Staroverov, A., Yudin, D.A., Belkin, I., et al.: Real-time object navigation with deep neural networks and hierarchical reinforcement learning. IEEE Access 8, 195608–195621 (2020)

    Article  Google Scholar 

  10. Seaman, W.K., et Yavuz, S.: Indoor mobile robot navigation using deep convolutional neural network. J. Intell. Fuzzy Syst. no Preprint, pp. 1–11 (2020)

  11. Singh, P., Manikandan, R., Matiyali, N., et al.: Multi-layer pruning framework for compressing single shot multibox detector. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, pp. 1318–1327, 2019

  12. Pasandi, M.M., Hajabdollahi, M., Karimi, N., et al.: Modeling of Pruning Techniques for Deep Neural Networks Simplification. arXiv preprint. arXiv:2001.04062, 2020.

  13. Liu, H., Xin, B., Mu, S., et al.: Pruning the deep neural network by similar function. J. Phys.: Conf. Ser. 1187, 042006 (2019)

    Google Scholar 

  14. Tong, K., Wu, Y., de Zhou, F.: Recent advances in small object detection based on deep learning: A review. Image Vis. Comput. 97, 103910 (2020)

    Article  Google Scholar 

  15. Zhang, F., Duarte, F., Ma, R., et al.: Indoor Space Recognition Using Deep Convolutional Neural Network: A Case Study at MIT Campus. arXiv preprint. arXiv:1610.02414, 2016.

  16. Baimukashev, D., Zhilisbayev, A., Kuzdeuov, A., et al.: Deep learning based object recognition using physically-realistic synthetic depth scenes. Mach. Learn. Knowl. Extract. 1(3), 883–903 (2019)

    Article  Google Scholar 

  17. Ding, X., Luo, Y., Yu, Q., et al.: Indoor object recognition using pre-trained convolutional neural network. In: 2017 23rd International Conference on Automation and Computing (ICAC). IEEE, 2017. pp. 1–6.

  18. Pourghahestani, F.A., et Rashedi, E. Object detection in images using artificial neural network and improved binary gravitational search algorithm. In: 2015 4th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS). IEEE, 2015. pp. 1–4

  19. Barthakur, M., Thakuria, T., et Sarma, K.K.: Artificial Neural Network (ANN) based object recognition using multiple feature sets. In: Soft Computing Techniques in Vision Science, pp. 127–135. Springer, Berlin (2012)

    Google Scholar 

  20. Ran, L., Zhang, Y., Zhang, Q., et al.: Convolutional neural network-based robot navigation using uncalibrated spherical images. Sensors 17(6), 1341 (2017)

    Article  Google Scholar 

  21. Surmann, H., Jestel, C., Marchel, R., et al.: Deep Reinforcement learning for real autonomous mobile robot navigation in indoor environments. arXiv preprint. arXiv:2005.13857, (2020)

  22. Tan, M., Pang, R., et Le, Q.V.: Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 10781–10790 (2020)

  23. Lin, T.-Y., Dollár, P., Girshick, R., et al.: Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2117–2125 (2017)

  24. LabelImg. https://github.com/tzutalin/labelImg. Accessed 23 Aug 2019

  25. Kingma, D.P., Jimmy, BA.: Adam: a method for stochastic optimization. arXiv preprint. arXiv:1412.6980 (2014)

  26. Maity, R., Mishra, R., de Pattnaik, P.K.: A review of flying robot applications in healthcare. Smart Healthcare Anal.: State Art (2022). https://doi.org/10.1007/978-981-16-5304-9_8

    Article  Google Scholar 

  27. Lee, Y., Jun, D., Kim, B.-G., et al.: Enhanced single image super resolution method using lightweight multi-scale channel dense network. Sensors 21(10), 3351 (2021)

    Article  Google Scholar 

  28. Yuan, Y., Chu, J., Leng, L., et al.: A scale-adaptive object-tracking algorithm with occlusion detection. EURASIP J. Image Video Process. 2020(1), 1–15 (2020)

    Article  Google Scholar 

  29. De Oliveira, B.A.G., Ferreira, F.M.F., et da Silvamartins, C.A.P.: Fast and lightweight object detection network: detection and recognition on resource constrained devices. IEEE Access 6, 8714–8724 (2018)

    Article  Google Scholar 

  30. Ding, X., Luo, Y., Yu, Q., et al.: Indoor object recognition using pre-trained convolutional neural network. In : 2017 23rd International Conference on Automation and Computing (ICAC). IEEE, pp. 1–6 (2017)

Download references

Acknowledgements

The authors extend their appreciation to the Deputyship for Research and Innovation, Ministry of Education in Saudi Arabia for funding this research work through the project number “IF_2020_NBU_210”.

Author information

Authors and Affiliations

  1. Laboratory of Electronics and Microelectronics (EμE), Faculty of Sciences of Monastir, University of Monastir, Monastir, Tunisia

    Mouna Afif & Riadh Ayachi

  2. Electrical Engineering Department, College of Engineering, Northern Border University, Arar, Saudi Arabia

    Yahia Said

  3. College of Computer Science, King Khalid University, Abha, Saudi Arabia

    Mohamed Atri

Authors
  1. Mouna Afif
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Riadh Ayachi
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Yahia Said
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Mohamed Atri
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Mouna Afif.

Ethics declarations

Conflict of interest

Authors declare that there is no conflict of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Afif, M., Ayachi, R., Said, Y. et al. An evaluation of EfficientDet for object detection used for indoor robots assistance navigation. J Real-Time Image Proc 19, 651–661 (2022). https://doi.org/10.1007/s11554-022-01212-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-022-01212-4

Keywords