Skip to main content
SpringerLink
Log in

Automatic lane marking prediction using convolutional neural network and S-Shaped Binary Butterfly Optimization

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Lane detection is a technique that uses geometric features as an input to the autonomous vehicle to automatically distinguish lane markings. To process the intricate features present in the lane images, traditional computer vision (CV) techniques are typically time-consuming, need more computing resources, and use complex algorithms. To address this problem, this paper presents a deep convolutional neural network (CNN) architecture that prevents the complexities of traditional CV techniques. CNN is regarded as a reasonable method for lane marking prediction, while improved performance requires hyperparameter tuning. To enhance the initial parameter setting of the CNN, an S-Shaped Binary Butterfly Optimization Algorithm (SBBOA) is utilized in this paper. In this way, the relative parameters of CNN are selected for accurate lane marking. To evaluate the performance of the proposed SBBOA-CNN model, extensive experiments are conducted using the TUSimple and CULane datasets. The experimental results obtained show that the proposed approach outperforms other state-of-the-art techniques in terms of classification accuracy, precision, F1-score, and recall. The proposed model also considerably outperforms the CNN in terms of classification accuracy, average elapsed time, and receiver operating characteristics curve measure. This result demonstrates that the SBBOA optimized CNN exhibits higher robustness and stability than CNN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Availability of data and material

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

References

  1. Taeihagh A, Lim HSM (2019) Governing autonomous vehicles: emerging responses for safety, liability, privacy, cybersecurity, and industry risks. Transp Rev 39(1):103–128

    Article  Google Scholar 

  2. Zou Q, Jiang H, Dai Q, Yue Y, Chen L, Wang Q (2019) Robust lane detection from continuous driving scenes using deep neural networks. IEEE Trans Veh Technol 69(1):41–54

    Article  Google Scholar 

  3. Garnett N, Cohen R, Pe'er T, Lahav R, Levi D (2019) 3D-LaneNet: end-to-end 3D multiple lane detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2921–2930

  4. Zhang X, Zhu X (2019) Autonomous path tracking control of intelligent electric vehicles based on lane detection and optimal preview method. Expert Syst Appl 121:38–48

    Article  Google Scholar 

  5. Philion J (2019) FastDraw: addressing the long tail of lane detection by adapting a sequential prediction network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 11582–11591

  6. Kuo CY, Lu YR, Yang SM (2019) On the image sensor processing for lane detection and control in vehicle lane keeping systems. Sensors 19(7):1665

    Article  Google Scholar 

  7. Jung S, Choi S, Khan MA, Choo J (2020) Towards Lightweight Lane Detection by Optimizing Spatial Embedding". arXiv preprint,2020

  8. Muthalagu R, Bolimera A, Kalaichelvi V (2020) "Lane detection technique based on perspective transformation and histogram analysis for self-driving cars". Comput Electr Eng 85: 106653

  9. Li M, Li Y, Jiang M (2018) "Lane detection based on connection of various feature extraction methods". Adv Multimed 2018

  10. Dinakaran K, Sagayaraj AS, Kabilesh SK, Mani T, Anandkumar A, Chandrasekaran G (2021) "Advanced lane detection technique for structural highway based on computer vision algorithm." Mater Today Proc 45: 2073–2081

  11. Muthalagu R, Bolimera A, Kalaichelvi V (2020) Lane detection technique based on perspective transformation and histogram analysis for self-driving cars. Comput Electr Eng 85: 106653

  12. El Hajjouji I, Mars S, Asrih Z, El Mourabit A (2020) A novel FPGA implementation of Hough transform for straight lane detection. Eng Sci Technol Int J 23(2):274–280

    Google Scholar 

  13. Mirjalili S (2015) The ant lion optimizer. Adv Eng Softw 83:80–98

    Article  Google Scholar 

  14. Wang W, Lin H, Wang J (2020) CNN based lane detection with instance segmentation in edge-cloud computing. J Cloud Comput 9:1–10

    Google Scholar 

  15. Yang X, Zhang Y, Lv W, Wang D (2021) Image recognition of wind turbine blade damage based on a deep learning model with transfer learning and an ensemble learning classifier. Renew Energy 163:386–397

  16. Sundararaj V, Muthukumar S, Kumar RS (2018) An optimal cluster formation based energy efficient dynamic scheduling hybrid MAC protocol for heavy traffic load in wireless sensor networks. Comput Secur 77:277–288

    Article  Google Scholar 

  17. Sundararaj V (2016) An efficient threshold prediction scheme for wavelet based ECG signal noise reduction using variable step size firefly algorithm. Int J Intell Eng Syst 9(3):117–126

    Google Scholar 

  18. Sundararaj V (2019) Optimised denoising scheme via opposition-based self-adaptive learning PSO algorithm for wavelet-based ECG signal noise reduction. Int J Biomed Eng Technol 31(4):325

    Article  Google Scholar 

  19. Sundararaj V, Anoop V, Dixit P, Arjaria A, Chourasia U, Bhambri P, Rejeesh MR, Sundararaj R (2020) CCGPA-MPPT: cauchy preferential crossover-based global pollination algorithm for MPPT in photovoltaic system. Prog Photovolt Res Appl 28(11): 1128–1145

  20. Ravikumar S, Kavitha D (2021) CNN‐OHGS: CNN‐oppositional‐based Henry gas solubility optimization model for autonomous vehicle control system. J Field Robot

  21. Ravikumar S, Kavitha D (2020) IoT based home monitoring system with secure data storage by Keccak–Chaotic sequence in cloud server. J Ambient Intell Humanized Comput 1–13

  22. Rejeesh MR (2019) Interest point based face recognition using adaptive neuro fuzzy inference system. Multimed Tools Appl 78(16):22691–22710

    Article  Google Scholar 

  23. Kavitha D, Ravikumar S (2021) IOT and context‐aware learning‐based optimal neural network model for real‐time health monitoring. Trans Emerg Telecommun Technol 32(1): e4132

  24. Hassan BA, Rashid TA (2020) Datasets on statistical analysis and performance evaluation of backtracking search optimisation algorithm compared with its counterpart algorithms. Data Br 28: 105046

  25. Hassan BA (2020) CSCF: a chaotic sine cosine firefly algorithm for practical application problems. Neural Comput Appl 33: 7011–7030

  26. Hassan BA, Rashid TA, Mirjalili S (2021) Formal context reduction in deriving concept hierarchies from corpora using adaptive evolutionary clustering algorithm star. Compl Intell Syst 1–16

  27. Haseena KS, Anees S, Madheswari N (2014) Power optimization using EPAR protocol in MANET. Int J Innov Sci Eng Technol 6:430–436

    Google Scholar 

  28. Gowthul Alam MM, Baulkani S (2019) Local and global characteristics-based kernel hybridization to increase optimal support vector machine performance for stock market prediction. Knowl Inf Syst 60(2):971–1000

    Article  Google Scholar 

  29. Gowthul Alam MM, Baulkani S (2017) Reformulated query-based document retrieval using optimised kernel fuzzy clustering algorithm. Int J Bus Intell Data Min 12(3):299

    Google Scholar 

  30. Gowthul Alam MM, Baulkani S (2019) Geometric structure information based multi-objective function to increase fuzzy clustering performance with artificial and real-life data. Soft Comput 23(4):1079–1098

    Article  Google Scholar 

  31. Nisha S, Madheswari AN (2016) Secured authentication for internet voting in corporate companies to prevent phishing attacks. Int J Emerg Technol Comput Sci Electron (IJETCSE) 22(1):45–49

    Google Scholar 

  32. Sundararaj V, Selvi M (2021) Opposition grasshopper optimizer based multimedia data distribution using user evaluation strategy. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-021-11123-4

  33. Nisha S, Madheswari AN (2016) Prevention of phishing attacks in voting system using visual cryptography. In 2016 International Conference on Emerging Trends in Engineering, Technology and Science (ICETETS), IEEE, pp 1–4

  34. Bryar A., Hassan Tarik A., Rashid (2020) Operational framework for recent advances in backtracking search optimisation algorithm: A systematic review and performance evaluation. Appl Math Comput 370:124919. https://doi.org/10.1016/j.amc.2019.124919

    Article  MathSciNet  MATH  Google Scholar 

  35. Johnson F, Valderrama A, Valle C, Crawford B, Soto R, Ñanculef R (2020) Automating configuration of convolutional neural network hyperparameters using genetic algorithm. IEEE Access 8:156139–156152

    Article  Google Scholar 

  36. Han D, Liu Q, Fan W (2018) A new image classification method using CNN transfer learning and web data augmentation. Expert Syst Appl 95:43–56

    Article  Google Scholar 

  37. Sadeghian Z, Akbari E, Nematzadeh H (2021) A hybrid feature selection method based on information theory and binary butterfly optimization algorithm. Eng Appl Artif Intell 97:104079

  38. Liu J (2019) Learning full-reference quality-guided discriminative gradient cues for lane detection based on neural networks. J V Commun Image Represent 65: 102675

  39. Xiao D, Yang X, Li J, Islam M (2020) Attention deep neural network for lane marking detection. Knowledge-Based Syst 194: 105584

  40. Zakaria NJ, Shapiai MI, Fauzi H, Elhawary HM, Yahya WJ, Rahman MA, Kassim KA, Bahiuddin I, Ariff MH (2020) "Gradient-based edge effects on lane marking detection using a deep learning-based approach". Arab J Sci Eng 1–18

  41. Tabelini L, Berriel R, Paixao TM, Badue C, De Souza AF, Oliveira-Santos T (2020) "Keep your Eyes on the Lane: Attention-guided Lane Detection". arXiv preprint arXiv:2010.12035

  42. Ko Y, Jiwon J, Donghwuy K, Jeon M (2020) "Key points estimation and point instance segmentation approach for lane detection". arXiv preprint arXiv:2002.06604

  43. Lee S, Kim J, Shin Yoon J, Shin S, Bailo O, Kim N, Lee TH, Seok Hong H, Han SH, So Kweon I (2017) "Vpgnet: vanishing point guided network for lane and road marking detection and recognition". In: Proceedings of the IEEE International Conference on Computer Vision, pp 1947–1955

  44. Muthalagu R, Bolimera A, Kalaichelvi V (2021) Vehicle lane markings segmentation and keypoint determination using deep convolutional neural networks. Multimed Tools Appl 80: 11201–11215

  45. Wang W, Qie T, Yang C, Liu W, Xiang C, Huang K (2021) "An intelligent lane-changing behavior prediction and decision-making strategy for an autonomous vehicle." IEEE Trans Ind Electr

  46. Mahajan V, Katrakazas C, Antoniou C (2020) Prediction of lane-changing maneuvers with automatic labeling and deep learning. Transp Res Rec 2674(7):336–347

    Article  Google Scholar 

  47. Arora S, Singh S (2019) Butterfly optimization algorithm: a novel approach for global optimization. Soft Comput 23(3):715–734

    Article  Google Scholar 

  48. Kumar P, Hati AS (2021) "Deep convolutional neural network based on adaptive gradient optimizer for fault detection in SCIM." ISA Trans 111: 350–359

  49. Pan S, Guan H, Chen Y, Yu Y, Gonçalves WN, Junior JM, Li J (2020) "Land-cover classification of multispectral LiDAR data using CNN with optimized hyper-parameters." ISPRS J Photogramm Remote Sens 166: 241–254

  50. Pan X, Shi J, Luo P, Wang X, Tang X (2017) "Spatial as deep: spatial cnn for traffic scene understanding". arXiv preprint axXiv:1712.06080

  51. Shirke S, Udayakumar R (2019) "Lane Datasets for Lane Detection". In: 2019 International Conference on Communication and Signal Processing (ICCSP), IEEE, pp 0792–0796

  52. Marini F, Walczak B (2015) Particle swarm optimization (PSO). A tutorial. Chemom Intell Lab Syst 149:153–165

    Article  Google Scholar 

  53. Mirjalili S (2019) "Genetic algorithm." In: Evolutionary algorithms and neural networks, Springer, Cham, pp 43–55

Download references

Author information

Authors and Affiliations

  1. Self-Development Skills Department, Common First Year Deanship, King Saud University, Riyadh, Saudi Arabia

    Abrar Mohammed Alajlan

  2. College of Computing and Informatics, Saudi Electronic University, Riyadh, Saudi Arabia

    Marwah Mohammad Almasri

Authors
  1. Abrar Mohammed Alajlan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marwah Mohammad Almasri
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AMA agreed on the content of the study. AMA and MMA collected all the data for analysis. AMA agreed on the methodology. AMA and MMA completed the analysis based on agreed steps. Results and conclusions are discussed and written together. The author read and approved the final manuscript.

Corresponding author

Correspondence to Abrar Mohammed Alajlan.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human or Animal Rights

This article does not contain any studies with human or animal subjects performed by any of the authors.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alajlan, A.M., Almasri, M.M. Automatic lane marking prediction using convolutional neural network and S-Shaped Binary Butterfly Optimization. J Supercomput 78, 3715–3745 (2022). https://doi.org/10.1007/s11227-021-03988-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03988-x

Keywords

Search

Navigation