skip to main content
10.1145/3606042.3616457acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Plug-and-Play Multi-class Lane Detection Module

Published:29 October 2023Publication History

ABSTRACT

Lanes play a crucial role in visual navigation systems for Autonomous driving. Several studies have employed deep learning technology to design networks for lane detection. However, most methods simply detect lanes area, ignoring that different types of lanes as traffic signs carry different high-level semantic meanings. In this paper, we propose a plug-and-play multi-class lane detection module (MLDM) aimed at distinguishing different kinds of lanes. The module identifies lane regions based on the coordinates of the lanes as predicted by the network. It then uses pixel density and lane length to detect color and determine whether a lane is solid or dashed. In addition, to demonstrate the practical value of MLDM, we devise a lane departure warning system that integrates the detection results of MLDM. Experimental results demonstrate the efficacy of the proposed method.

References

  1. Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 580--587.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In Proceedings of the IEEE International Conference on Computer Vision. 2961--2969.Google ScholarGoogle Scholar
  3. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778.Google ScholarGoogle ScholarCross RefCross Ref
  4. Yeongmin Ko, Younkwan Lee, Shoaib Azam, Farzeen Munir, Moongu Jeon, and Witold Pedrycz. 2021. Key points estimation and point instance segmentation approach for lane detection. IEEE Transactions on Intelligent Transportation Systems, Vol. 23, 7 (2021), 8949--8958.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems , Vol. 25 (2012).Google ScholarGoogle Scholar
  6. Xiang Li, Jun Li, Xiaolin Hu, and Jian Yang. 2019. Line-CNN: End-to-end traffic line detection with line proposal unit. IEEE Transactions on Intelligent Transportation Systems, Vol. 21, 1 (2019), 248--258.Google ScholarGoogle ScholarCross RefCross Ref
  7. Xinpeng Li and Xiaojiang Peng. 2022. Rail Detection: An Efficient Row-based Network and a New Benchmark. In Proceedings of the 30th ACM International Conference on Multimedia. 6455--6463.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Tsung-Yi Lin, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. 2017. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2117--2125.Google ScholarGoogle ScholarCross RefCross Ref
  9. Lizhe Liu, Xiaohao Chen, Siyu Zhu, and Ping Tan. 2021. CondLaneNet: a top-to-down lane detection framework based on conditional convolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 3773--3782.Google ScholarGoogle ScholarCross RefCross Ref
  10. Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431--3440.Google ScholarGoogle ScholarCross RefCross Ref
  11. Chan Yee Low, Hairi Zamzuri, and Saiful Amri Mazlan. 2014. Simple robust road lane detection algorithm. In 2014 5th International Conference on Intelligent and Advanced Systems (ICIAS). Ieee, 1--4.Google ScholarGoogle ScholarCross RefCross Ref
  12. Xingang Pan, Jianping Shi, Ping Luo, Xiaogang Wang, and Xiaoou Tang. 2018. Spatial as deep: Spatial cnn for traffic scene understanding. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.Google ScholarGoogle ScholarCross RefCross Ref
  13. Avishek Parajuli, Mehmet Celenk, H Bryan Riley, et al. 2013. Robust lane detection in shadows and low illumination conditions using local gradient features. Open Journal of Applied Sciences , Vol. 3, 01 (2013), 68.Google ScholarGoogle ScholarCross RefCross Ref
  14. Zequn Qin, Huanyu Wang, and Xi Li. 2020. Ultra fast structure-aware deep lane detection. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceedings, Part XXIV 16. Springer, 276--291.Google ScholarGoogle Scholar
  15. Jinming Su, Chao Chen, Ke Zhang, Junfeng Luo, Xiaoming Wei, and Xiaolin Wei. 2021. Structure guided lane detection. arXiv preprint arXiv:2105.05403 (2021).Google ScholarGoogle Scholar
  16. Lucas Tabelini, Rodrigo Berriel, Thiago M Paixao, Claudine Badue, Alberto F De Souza, and Thiago Oliveira-Santos. 2021a. Keep your eyes on the lane: Real-time attention-guided lane detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 294--302.Google ScholarGoogle ScholarCross RefCross Ref
  17. Lucas Tabelini, Rodrigo Berriel, Thiago M Paixao, Claudine Badue, Alberto F De Souza, and Thiago Oliveira-Santos. 2021b. Polylanenet: Lane estimation via deep polynomial regression. In 2020 25th International Conference on Pattern Recognition (ICPR). IEEE, 6150--6156.Google ScholarGoogle ScholarCross RefCross Ref
  18. TuSimple. 2017. TuSimple Lane Detection. https://github.com/TuSimple/tusimple-benchmark/.Google ScholarGoogle Scholar
  19. Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. Non-local neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7794--7803.Google ScholarGoogle ScholarCross RefCross Ref
  20. Tu Zheng, Hao Fang, Yi Zhang, Wenjian Tang, Zheng Yang, Haifeng Liu, and Deng Cai. 2021. RESA: Recurrent feature-shift aggregator for lane detection. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 3547--3554.Google ScholarGoogle ScholarCross RefCross Ref
  21. Tu Zheng, Yifei Huang, Yang Liu, Wenjian Tang, Zheng Yang, Deng Cai, and Xiaofei He. 2022. ClRNet: Cross layer refinement network for lane detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 898--907.Google ScholarGoogle ScholarCross RefCross Ref
  22. Di Zhu, Rui Song, Hui Chen, Reinhard Klette, and Yanyan Xu. 2021. Moment-based multi-lane detection and tracking. Signal Processing: Image Communication , Vol. 95 (2021), 116230. ioGoogle ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Plug-and-Play Multi-class Lane Detection Module

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      AMC-SME '23: Proceedings of the 2023 Workshop on Advanced Multimedia Computing for Smart Manufacturing and Engineering
      October 2023
      83 pages
      ISBN:9798400702730
      DOI:10.1145/3606042

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 October 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia
    • Article Metrics

      • Downloads (Last 12 months)34
      • Downloads (Last 6 weeks)6

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader