Skip to main content

Pixel-Wise Detection of Road Obstacles on Drivable Areas by Introducing Maximized Entropy to Synboost Framework

  • Conference paper
  • First Online:
Pattern Recognition (ACPR 2023)

Abstract

Semantic segmentation plays a crucial role in understanding the surroundings of a vehicle in the context of autonomous driving. Nevertheless, segmentation networks are typically trained on a closed-set of inliers, leading to misclassification of anomalies as in-distribution objects. This is especially dangerous for obstacles on roads, such as stones, that usually are small and blend well with the background. Numerous frameworks have been proposed to detect out-of-distribution objects in driving scenes. Some of these frameworks use softmax cross-entropy measurements as an attention mechanism for a dissimilarity network to find anomalies. However, a significant limitation arises from the segmentation network’s tendency toward overconfidence in its predictions, resulting in low cross-entropy in regions where anomalies are present. This suggests that normal cross-entropy is a low-quality prior for anomaly detection. Therefore, for the task of detecting stones on roads, we propose utilizing a fined-tuned segmentation network with a changed target, from semantic segmentation to maximize the cross-entropy in anomalous areas. With this, we feed the dissimilarity network with a better prior image. Furthermore, due to the lack of datasets with enough samples of stones for pixel-wise detection, we synthetically added stones on images of driving scenes to create a dataset for fine-tuning and training. The results of our comparative experiments showed that our model attains the highest average precision while having the lowest false positive rate at 95% true positive rate when evaluating on a real-stone image dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rottmann, M., et al.: Prediction error meta classification in semantic segmentation: detection via aggregated dispersion measures of Softmax probabilities. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK, pp. 1–9 (2020)

    Google Scholar 

  2. Lis, K., Nakka, K.K., Fua, P., Salzmann, M.: Detecting the unexpected via image resynthesis. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, South Korea, pp. 2152–2161 (2019)

    Google Scholar 

  3. Di Biase, G., Blum, H., Siegwart, R., Cadena, C.: Pixel-wise anomaly detection in complex driving scenes. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, pp. 16913–16922 (2021)

    Google Scholar 

  4. Chan, R., Rottmann, M., Gottschalk, H.: Entropy maximization and meta classification for out-of- distribution detection in semantic segmentation. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, pp. 5108–5117 (2021)

    Google Scholar 

  5. Cordts, M. et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, pp. 3213–3223 (2016)

    Google Scholar 

  6. Zhu, Y. et al.: Improving semantic segmentation via video propagation and label relaxation. In: 2019 IEEE/ CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp. 8848–8857 (2019)

    Google Scholar 

  7. Liu, X., Yin, G., Shao, J., Wang, X.: Learning to predict layout-to-image conditional convolutions for semantic image synthesis. In: Advances in Neural Information Processing Systems, Red Hook, NY, USA (2019)

    Google Scholar 

  8. Bogdoll, D., Uhlemeyer, S., Kowol, K., Zollner, M.: Perception datasets for anomaly detection in autonomous driving: a survey. In: 2023 IEEE Intelligent Vehicles Symposium (IV), Anchorage, AK, USA, pp. 1–8 (2023)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Carlos David Ardon Munoz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ardon Munoz, C.D., Nishiyama, M., Iwai, Y. (2023). Pixel-Wise Detection of Road Obstacles on Drivable Areas by Introducing Maximized Entropy to Synboost Framework. In: Lu, H., Blumenstein, M., Cho, SB., Liu, CL., Yagi, Y., Kamiya, T. (eds) Pattern Recognition. ACPR 2023. Lecture Notes in Computer Science, vol 14408. Springer, Cham. https://doi.org/10.1007/978-3-031-47665-5_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47665-5_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47664-8

  • Online ISBN: 978-3-031-47665-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics