Skip to main content
SpringerLink
Log in

A hybrid approach for search and rescue using 3DCNN and PSO

  • S. I : Hybridization of Neural Computing with Nature Inspired Algorithms
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Search and rescue are essential applications of disaster management in which people are evacuated from the disaster-prone area to a safer place. This overall process of search and rescue can be more efficient if an automated system can quickly locate the human or area where rescue is required. To provide a faster and accurate search of those places, this paper proposes a novel approach to search and rescue using automated drone surveillance. In this paper, a complex scene classification problem is solved using the proposed 3DCNN model. The proposed model uses spatial as well as temporal features of the video for the classification of the scene as help or non-help in the natural disaster. Due to the unavailability of such kind of dataset, it is impossible to train the model. Therefore, it is essential to develop a dataset for search and rescue. The proposed dataset is a first and unique dataset for scene classification using drone surveillance. The major contribution of this paper is (1) a novel 3DCNN powered model for scene classification in drone surveillance, (2) to develop the required dataset for the training of scene classification model, and (3) particular swarm optimization (PSO)-based hyper-parameter tuning for getting the best value of multiple parameters used for training the model. Our hybridization of parameter tuning with PSO helps for the convergence of parameter values of proposed 3DCNN model, and the proposed scene classification model (3DCNN+PSO) is applied to the dataset. The proposed model gives an impressive performance to help situation identification with 98% training and 99% validation accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Banerjee B, Murino V (2017) Efficient pooling of image based cnn features for action recognition in videos. In: 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2637–2641. IEEE

  2. Barekatain M, Martí M, Shih H-F, Murray S, Nakayama K, Matsuo Y, Prendinger H.(2017) Okutama-action: an aerial view video dataset for concurrent human action detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 28–35

  3. Burney A, Syed TQ (2016) Crowd video classification using convolutional neural networks. In: International conference on frontiers of information technology (FIT), pp 247–251. IEEE

  4. Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448

  5. Junyou B (2007) Stock price forecasting using PSO-trained neural networks. In: IEEE congress on evolutionary computation, pp 2879–2885. IEEE

  6. Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732

  7. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of international conference on neural networks, ICNN’95, vol 4, pp 1942–1948. IEEE

  8. Kollias D, Zafeiriou S (2019) Exploiting multi-CNN features in CNN-RNN based dimensional emotion recognition on the omg in-the-wild dataset. arXiv preprint arXiv:1910.01417

  9. Mantovani RG, Horváth T, Cerri R, Vanschoren J, de Carvalho AC (2016) Hyper-parameter tuning of a decision tree induction algorithm. In: 5th Brazilian conference on intelligent systems (BRACIS), pp 37–42. IEEE

  10. Mishra VK, Sengupta A (2014) MO-PSE: adaptive multi-objective particle swarm optimization based design space exploration in architectural synthesis for application specific processor design. Adv Eng Softw 67:111–124

    Article  Google Scholar 

  11. Murphy RR, Tadokoro S, Nardi D, Jacoff A, Fiorini P, Choset H, Erkmen AM (2008) Search and rescue robotics. Springer handbook of robotics. Springer, Berlin, pp 1151–1173

    Google Scholar 

  12. Padierna LC, Carpio M, Rojas A, Puga H, Baltazar R, Fraire H (2017) Hyper-parameter tuning for support vector machines by estimation of distribution algorithms. In: Nature-inspired design of hybrid intelligent systems, pp 787–800. Springer, Berlin

  13. Perera AG, Wei Law Y, Chahl J (2018) UAV-gesture: a dataset for uav control and gesture recognition. In: Proceedings of the European conference on computer vision (ECCV)

  14. Purkait P, Zhao C, Zach C (2017) SPP-net: deep absolute pose regression with synthetic views. arXiv preprint arXiv:1712.03452

  15. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99

  16. Rojas-Domínguez A, Padierna LC, Valadez JMC, Puga-Soberanes HJ, Fraire HJ (2017) Optimal hyper-parameter tuning of SVM classifiers with application to medical diagnosis. IEEE Access 6:7164–7176

    Article  Google Scholar 

  17. Sheikhan M, Mohammadi N (2013) Time series prediction using PSO-optimized neural network and hybrid feature selection algorithm for IEEE load data. Neural Comput Appl 23(3–4):1185–1194

    Article  Google Scholar 

  18. Soleimani A, Nasrabadi NM (2018). Convolutional neural networks for aerial multi-label pedestrian detection. In: 21st international conference on information fusion (FUSION), pp 1005–1010. IEEE

  19. Subasi A (2013) Classification of EMG signals using pso optimized SVM for diagnosis of neuromuscular disorders. Comput Biol Med 43(5):576–586

    Article  Google Scholar 

  20. Tian D, Shi Z (2018) MPSO: Modified particle swarm optimization and its applications. Swarm Evol Comput 41:49–68

    Article  Google Scholar 

  21. Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171

    Article  Google Scholar 

  22. Wang Y, Zhang H, Zhang G (2019) cPSO-CNN: an efficient pso-based algorithm for fine-tuning hyper-parameters of convolutional neural networks. Swarm Evol Comput 49:114–123

    Article  Google Scholar 

  23. Zhao Y, Peng Y (2017) Saliency-guided video classification via adaptively weighted learning. In: IEEE international conference on multimedia and expo (ICME), pp 847–852. IEEE

Download references

Author information

Authors and Affiliations

  1. Bennett University, Greater Noida, India

    Balmukund Mishra, Deepak Garg & Vipul Mishra

  2. BITS Pilani, Pilani, India

    Pratik Narang

Authors
  1. Balmukund Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Deepak Garg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pratik Narang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vipul Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Balmukund Mishra.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mishra, B., Garg, D., Narang, P. et al. A hybrid approach for search and rescue using 3DCNN and PSO. Neural Comput & Applic 33, 10813–10827 (2021). https://doi.org/10.1007/s00521-020-05001-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05001-7

Keywords

Search

Navigation