Abstract
Image processing has led its applications to scale to almost all areas encompassing the emergent interdisciplinary fields of computers, electronics, mechanical, civil, and more. There are several discrete models in image processing to identify characteristic of an object under surveillance. In smart emergency applications, accuracy and precision on attributes of these objects are paramount. Hence there is a need to enhance the image processing algorithms used to measure an object’s distance, size, and color from any altitude. The paper demonstrates Hybrid Image Processing Model (HIPM) using Triangle similarity, Pixel Per Metric (PPM), CIELAB color space, and Douglas-Peucker algorithm to compute the distance of an object from the camera, the size, color, and shape of an object from the image, respectively. This work emphasises on leveraging image processing techniques for assisting emergency aircraft landing. Results were obtained with five real-time image sets, each consisting of 50 images, and proved HIPM is efficient and reliable, with an accuracy of 99.84% and a mean error rate of 0.08. This work also discusses the model’s capability to function in accordance with the need of autonomous vehicles and military events.
Similar content being viewed by others
Data availibility
The authors declare data will be made available on reasonable request.
References
Ahmed MS, Aurpa TT, Azad MAK (2021) Fish disease detection using image based machine learning technique in aquaculture. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2021.05.003
Akbar J, Shahzad M, Malik MI, Ul-Hasan A, Shafait F (2019) Runway detection and localization in aerial images using deep learning. Tech Appl Dig Image Comput. https://doi.org/10.1109/DICTA47822.2019.8945889
Albin S, Rougeron G, Peroche B, Tremeau A (2002) Quality image metrics for synthetic images based on perceptual color differences. IEEE Trans. Image Process. 11(9):961–971. https://doi.org/10.1109/TIP.2002.802544
An D, Hao J, Wei Y, Wang Y, Yu X (2021) Application of computer vision in fish intelligent feeding system-a review. Aquaculture Res 52(2):423–437. https://doi.org/10.1111/are.14907
Anilkumar KK, Manoj VJ, Sagi TM (2021) Efficacy of cielab and cmyk color spaces in leukemia image analysis: a comparison by statistical techniques. Biomed Eng Appl Basis Commun 33(06):2150042. https://doi.org/10.4015/S1016237221500423
Astafyeva E, Yasyukevich Y, Maksikov A, Zhivetiev I (2014) Deomagnetic storms, super-storms and their impacts on gps-based navigation systems. Space Weather. https://doi.org/10.1002/2014SW001072
Aytekin O, Zöngür U, Halici U (2013) Texture-based airport runway detection. IEEE Geosci Remote Sens Lett 10(3):471–475. https://doi.org/10.1109/LGRS.2012.2210189
Baculo MJC, Marcos N (2018) Automatic mango detection using image processing and hog-svm. In: Proceedings of the 2018 vii International Conference on Network, Communication and Computing. Association for Computing Machinery, New York, NY, USA, pp 211-215 Retrieved from https://doi.org/10.1145/3301326.3301358
Balbuzanov TG, Evstatiev BI (2019) Pedestrian presence detection system based on image processing. In: 2019 IEEE 25th International Symposium for Design and Technology in Electronic Packaging (siitme), pp 110-113. https://doi.org/10.1109/SIITME47687.2019.8990821
Bloudíček R, Leuchter J, Polášek M, Hon L (2018) The use of airport lighting systems in an instrument part of approaching manoeuvre. In: IEEE/aiaa 37th Digital Avionics Systems Conference, pp 1-5. https://doi.org/10.1109/DASC.2018.8569258
Boeing Commercial Airplanes (2018) Statistical summary of commercial jet airplane accidents-worldwide operations (Tech. Rep. No. 1959-2017). Seattle, WA, USA. Retrieved from https://flightsafety.org/asw-article/reversal-2/
Borys C (2017) The world’s biggest plane may have a new mission - soviet union’s antonov an-225. Retrieved from https://www.bbc.com/future/article/20170503-the-worlds-biggestplane-may-have-a-new-mission
Cai B, Jiang Z, Zhang H, Yao Y, Huang J (2017) Training deep convolution neural network with hard example mining for airport detection. In: 2017 IEEE International Geoscience and Remote Sensing Symposium (igarss), pp 862-865. https://doi.org/10.1109/IGARSS.2017.8127089
Chen X, Wang X, Zhang K, Zhang R, Fung K, Thai TC, Qiu Y (2021) Recent advances and clinical applications of deep learning in medical image analysis. CoRR, abs/2105.13381. Retrieved from https://arxiv.org/abs/2105.13381
Cong W, Li Z, Wang T, Xu X, Xiaoshuan Z, Li D (2021) Intelligent fish farm-the future of aquaculture. Aquac Int. https://doi.org/10.1007/s10499-021-00773-8
Correspondent BN (2020) Iran plane crash: ukrainian jet was ‘unintentionally’ shot down. Retrieved from https://www.bbc.com/news/world-middle-east-51073621
Cruz JE, Shiguemori EH, Guimarães LN (2013) Concrete and asphalt runway detection in high resolution images using lbp cascade classifier. In: Brics Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence, pp 465-469. https://doi.org/10.1109/BRICS-CCI-CBIC.2013.83
Dong Y, Yuan B, Wang H, Shi Z (2011) A runway recognition algorithm based on heuristic line extraction. In: International Conference on Image Analysis and Signal Processing, pp 292-296. https://doi.org/10.1109/IASP.2011.6109049
European Aviation Staff Plan (2016) Developing standardized fdm-based indicators easa (Tech. Rep. No.2012-2015 Version-2). Cologne, Germany. Retrieved from https://www.easa.europa.eu/sites/default/files/dfu/EAFDMstandardisedFDM-basedindicatorsv2Ed2017.pdf
European Union Aviation Safety Agency (2020) Easa artificial intelligence roadmap 1.0 (Tech. Rep. No. Roadmap 1.0). Cologne, Germany. Retrieved from https://www.easa.europa.eu/newsroom-andevents/news/easa-artificial-intelligence-roadmap-10-published
Fadaei S (2021) Comparision of color spaces in dcd-based content-based image retrieval systems. In: 2021 7th International Conference on Signal Processing and Intelligent Systems (icspis), pp 1-4. https://doi.org/10.1109/ICSPIS54653.2021.9729360
Federal Aviation Administration (2014) Ac 91-79a - mitigating the risks of a runway overrun upon landing (include chg 1) document information (Tech. Rep. No. 91-79A). Washington, DC, US. Retrieved from https://www.faa.gov/regulations policies/advisory circulars/
Ferdaus MM, Anavatti SG, Pratama M, Garratt MA (2020) Towards the use of fuzzy logic systems in rotary wing unmanned aerial vehicle: a review. Artificial intelligence review. Springer, Cham, pp 257–290
Fujiyoshi H, Hirakawa T, Yamashita T (2019) Deep learning-based image recognition for autonomous driving. IATSS Res 43(4):244–252. https://doi.org/10.1016/j.iatssr.2019.11.008
Fukuda M, Okuno T, Yuki S (2020) Central object segmentation by deep learning for fruits and other roundish objects. CoRR, abs/2008.01251 . Retrieved from https://arxiv.org/abs/2008.01251
Gil D, Hernàndez-Sabaté A, Enconniere J, Asmayawati S, Folch P, Borrego-Carazo J, Piera MN (2022) E-pilots: a system to predict hard landing during the approach phase of commercial flights. IEEE Access 10:7489–7503. https://doi.org/10.1109/ACCESS.2021.3138167
Hariyono J, Jo K-H (2015) Detection of pedestrian crossing road. In: 2015 IEEE International Conference on Image Processing (icip), pp 4585-4588. https://doi.org/10.1109/ICIP.2015.7351675
Jian M, Liu X, Luo H, Lu X, Yu H, Dong J (2021) Underwater image processing and analysis: a review. Signal Process Image Commun 91:116088. https://doi.org/10.1016/j.image.2020.116088
Laliberte A, Rango A, Herrick J, Fredrickson EL, Burkett L (2007) An object-based image analysis approach for determining fractional cover of senescent and green vegetation with digital plot photography. J Arid Environ 69(1):1–14. https://doi.org/10.1016/j.jaridenv.2006.08.016
Li M, Lafarge F, Marlet R (2020) Approximating shapes in images with low-complexity polygons. In: 2020 IEEE/cvf Conference on Computer Vision and Pattern Recognition (cvpr), pp 8630-8638. https://doi.org/10.1109/CVPR42600.2020.00866
Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng 19:100625. https://doi.org/10.1016/j.csite.2020.100625
Lin S-Y, Lin H-Y (2022) A two-stage framework for diverse traffic light recognition based on individual signal detection. In: Djeddi C, Siddiqi I, Jamil A, Ali-Hameed A, Kucuk I (eds) Pattern recognition and artificial intelligence. Springer, Cham, pp 265–278
Liu B, Liu X, Li D, Shi Y, Fernandez G, Wang Y (2020) A vector line simplification algorithm based on the douglas-peucker algorithm, monotonic chains and dichotomy. ISPRS Int J Geoinf. https://doi.org/10.3390/ijgi9040251
Liu X, Gao K, Liu B, Pan C, Liang K, Yan L, Yu Y (2021) Advances in deep learning-based medical image analysis. Health Data Sci. https://doi.org/10.34133/2021/8786793
Liu X, Zhao D, Jia W, Ji W, Sun Y (2019) A detection method for apple fruits based on color and shape features. IEEE Access 7:67923–67933. https://doi.org/10.1109/ACCESS.2019.2918313
Luo MR (2014) Cielab. In: Luo R (ed) Encyclopedia of color science and technology. Springer, Berlin, Heidelberg, pp 1–7
Ly B, Dyer E, Feig J, Chien A, Del Bino S (2020) Research techniques made simple: cutaneous colorimetry: a reliable technique for objective skin color measurement. J Invest Dermatol 140(1):3–12. https://doi.org/10.1016/j.jid.2019.11.003
Mallissery S, Wu M-C, Bau C-A, Huang G-Z, Yang C-Y, Lin W-C, Wu Y-S (2020) Poster: data leakage detection for health information system based on memory introspection. In: Proceedings of the 15th ACM Asia Conference on Computer and Communications Security, Association for Computing Machinery, New York, NY, USA, pp 898-900. Retrieved from https://doi.org/10.1145/3320269.3405437
Milde MB, Blum H, Dietmüller A, Sumislawska D, Conradt J, Indiveri G, Sandamirskaya Y (2017) Obstacle avoidance and target acquisition for robot navigation using a mixed signal analog/digital neuromorphic processing system. Front Neurorobot. https://doi.org/10.3389/fnbot.2017.00028
Müller AC, Guido S (2016) Introduction to machine learning with python: a guide for data scientists. O’Reilly, Sebastapol, CA, USA
Obajemu O, Mahfouf M, Maiyar LM, He C, Allerton DJA, Chen J, Weiszer M (2020) Fuzzy modelling of fuel consumptions and emissions for optimal navigation of a boeing-747 aircraft. In: 2020 IEEE Aerospace Conference, pp 1-7. https://doi.org/10.1109/AERO47225.2020.9172354
Pratama M, Budi W, Dimyani SA, Praptijanto A, Nur A, Putrasari Y (2019) Performance of inter-vehicular distance estimation: pose from orthography and triangle similarity. In: 2019 International Conference on Sustainable Energy Engineering and Application (icseea), pp 37-41. https://doi.org/10.1109/ICSEEA47812.2019.8938648
Qu Y, Li C, Zheng N (2005) Airport detection base on support vector machine from a single image. In: 2005 5th International Conference on Information Communications Signal Processing, pp 546-549. https://doi.org/10.1109/ICICS.2005.1689106
Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards realtime object detection with region proposal networks. In: Proceedings of the 28th International Conference on Neural Information Processing Systems, vol 1. MIT Press, Cambridge, MA, USA, pp 91-99
Rogel-Salazar J (2017) Data science and analytics with python (chapman and hall/crc data mining and knowledge discovery series), Edition. CRC Press, Florida, USA
Sadewa RP, Irawan B, Setianingsih C (2019) Fire detection using image processing techniques with convolutional neural networks. In: 2019 International Seminar on Research of Information Technology and Intelligent Systems (isriti), pp 290-295. https://doi.org/10.1109/ISRITI48646.2019.9034642
Saharia C, Ho J, Chan W, Salimans T, Fleet DJ, Norouzi M (2021) Image super-resolution via iterative refinement. arXiv. Retrieved from https://arxiv.org/abs/2104.07636
Saracco R (2020) Eventually anybody can land a plane. IEEE future directions. Retrieved from https://cmte.ieee.org/futuredirections/2020/05/21/eventuallyanybody-can-land-a-plane/
Saracco R (2021) This is your airplane speaking: I am going to land now. IEEE future directions. Retrieved from https://cmte.ieee.org/futuredirections/2021/02/07/thisis-your-airplane-speaking-i-am-going-to-land-now/
Shaik KB, Ganesan P, Kalist V, Sathish B, Jenitha JMM (2015) Comparative study of skin color detection and segmentation in hsv and ycbcr color space. Procedia Comput Sci 57:41–48. https://doi.org/10.1016/j.procs.2015.07.362
Shao M, Sui X (2015) Study on differential gps positioning methods. In: 2015 International Conference On Computer Science and Mechanical Automation (csma), pp 223-225. https://doi.org/10.1109/CSMA.2015.51
Tao C, Tan Y, Cai H, Tian J (2011) Airport detection from large ikonos images using clustered sift keypoints and region information. IEEE Geosci Remote Sens Lett 8(1):128–132. https://doi.org/10.1109/LGRS.2010.2051792
Theuma K, Mangion DZ (2015) An image processing algorithm for ground navigation of aircraft. In: Bordeneuve-Guibe J, Drouin A, Roos C (eds) Advances in aerospace guidance, navigation and control. Springer, Cham, pp 381–399
Tsarouchi P, Matthaiakis S-A, Michalos G, Makris S, Chryssolouris G (2016) A method for detection of randomly placed objects for robotic handling. CIRP J Manuf Sci Technol 14:20–27. https://doi.org/10.1016/j.cirpj.2016.04.005
US Government Accountability Office (GAO) (2013) National airspace system: persistent problems in faa’s new navigation system highlight need for periodic reevaluation (Tech. Rep. No.Rced/Aimd-00-130). New York, NY, USA. Retrieved from https://www.govinfo.gov/content/pkg/GAOREPORTS-RCED-AIMD-00-130/html/GAOREPORTS-RCED-AIMD-00-130.htm
Velastegui R, Pedersen M (2021) The impact of using different color spaces in histological image classification using convolutional neural networks. In: 2021 9th European Workshop on Visual Information Processing (euvip), pp 1-6. https://doi.org/10.1109/EUVIP50544.2021.9484035
Waldschmidt C, Hasch J, Menzel W (2021) Automotive radar-from first efforts to future systems. IEEE J Microw 1(1):135–148. https://doi.org/10.1109/JMW.2020.3033616
Walter T (2021) Satellite-based augmentation systems (sbass). In: Morton J (ed) Position, navigation, and timing technologies in the 21st century: integrated satellite navigation, sensor systems, and civil applications. Wiley-IEEE Press, New York, NY, USA, pp 277–306
Wang J, Cheng Y, Xie J, Niu W (2015) A real-time sensor guided runway detection method for forward-looking aerial images. In: 2015 11th International Conference on Computational Intelligence and Security (cis), p 150-153. https://doi.org/10.1109/CIS.2015.44
Wu S-T, Marquez M (2003) A non-self-intersection douglas-peucker algorithm. In: 16th Brazilian Symposium on Computer Graphics and Image Processing (sibgrapi 2003), pp 60-66. https://doi.org/10.1109/SIBGRA.2003.1240992
Yang M, Hu J, Li C, Rohde G, Du Y, Hu K (2019) An in-depth survey of underwater image enhancement and restoration. IEEE Access 7:123638–123657. https://doi.org/10.1109/ACCESS.2019.2932611
Ye C, Qian X (2018) 3-D object recognition of a robotic navigation aid for the visually impaired. IEEE Trans Neural Syst Rehabil Eng 26(2):441–450. https://doi.org/10.1109/TNSRE.2017.2748419
You Y, Qin K, Yu Y (2020) Heavy landing detection and prediction based on qar data. In: 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology (iccasit), pp 1066-1071. https://doi.org/10.1109/ICCASIT50869.2020.9368604
Yu J, Chen G, Zhang X, Chen W, Pu Y (2013) An improved douglaspeucker algorithm aimed at simplifying natural shoreline into directionline. In: 21st International Conference on Geoinformatics, p 1-5. https://doi.org/10.1109/Geoinformatics.2013.6626177
Zhang P, Niu X, Dou Y, Xia F (2017) Airport detection on optical satellite images using deep convolutional neural networks. IEEE Geosci Remote Sens Lett 14(8):1183–1187. https://doi.org/10.1109/LGRS.2017.2673118
Zhuang H, Low KS (2014) Real time runway detection in satellite images using multi-channel pcnn. In: 2014 9th IEEE Conference on Industrial Electronics and Applications, p 253-257. https://doi.org/10.1109/ICIEA.2014.6931168
Funding
The authors declare no funding for this work.
Author information
Authors and Affiliations
Contributions
Gunish Gunish - Ideation, and algorithimic analysis. Sheema Madhusudhanan - data analysis, experimentation, and manuscript writing. Arun Cyril Jose - guidance and review.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Ethical approval
The authors declare ethical approval was not required for this study or not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gunish, G., Madhusudhanan, S. & Jose, A.C. Hybrid image processing model: a base for smart emergency applications. J Supercomput 79, 13119–13141 (2023). https://doi.org/10.1007/s11227-023-05174-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-023-05174-7