Skip to main content

Towards Exploring Adversarial Learning for Anomaly Detection in Complex Driving Scenes

  • Conference paper
  • First Online:
Deep Learning Theory and Applications (DeLTA 2023)

Abstract

One of the many Autonomous Systems (ASs), such as autonomous driving cars, performs various safety-critical functions. Many of these autonomous systems take advantage of Artificial Intelligence (AI) techniques to perceive their environment. But these perceiving components could not be formally verified, since, the accuracy of such AI-based components has a high dependency on the quality of training data. So Machine learning (ML) based anomaly detection, a technique to identify data that does not belong to the training data could be used as a safety measuring indicator during the development and operational time of such AI-based components. Adversarial learning, a sub-field of machine learning has proven its ability to detect anomalies in images and videos with impressive results on simple data sets. Therefore, in this work, we investigate and provide insight into the performance of such techniques on a highly complex driving scenes dataset called Berkeley DeepDrive.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akcay, S., Atapour-Abarghouei, A., Breckon, T.P.: GANomaly: semi-supervised anomaly detection via adversarial training. In: Jawahar, C.V., Li, H., Mori, G., Schindler, K. (eds.) ACCV 2018. LNCS, vol. 11363, pp. 622–637. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20893-6_39

    Chapter  Google Scholar 

  2. Alexander, A., et al.: Variational autoencoder for end-to-end control of autonomous driving with novelty detection and training de-biasing, pp. 568–575. IEEE (2018)

    Google Scholar 

  3. An, J., Cho, S.: Variational autoencoder based anomaly detection using reconstruction probability. Spec. Lect. IE 2(1), 1–18 (2015)

    Google Scholar 

  4. Aniculaesei, A., Grieser, J., Rausch, A., Rehfeldt, K., Warnecke, T.: Towards a holistic software systems engineering approach for dependable autonomous systems. In: Stolle, R., Scholz, S., Broy, M. (eds.) Proceedings of the 1st International Workshop on Software Engineering for AI in Autonomous Systems, pp. 23–30. ACM, New York (2018). https://doi.org/10.1145/3194085.3194091

  5. Aniculaesei, A., Griesner, J., Rausch, A., Rehfeldt, K., Warnecke, T.: Graceful degradation of decision and control responsibility for autonomous systems based on dependability cages. In: 5th International Symposium on Future Active Safety Technology toward Zero, Blacksburg, Virginia, USA (2019)

    Google Scholar 

  6. Behere, S., Törngren, M.: A functional architecture for autonomous driving. In: Kruchten, P., Dajsuren, Y., Altinger, H., Staron, M. (eds.) Proceedings of the First International Workshop on Automotive Software Architecture, pp. 3–10. ACM, New York (2015). https://doi.org/10.1145/2752489.2752491

  7. Behere, S., Törngren, M.: A functional reference architecture for autonomous driving. Inf. Softw. Technol. 73, 136–150 (2016). https://doi.org/10.1016/j.infsof.2015.12.008

    Article  Google Scholar 

  8. Japkowicz, N., Myers, C., Gluck, M.: A novelty detection approach to classification. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence, IJCAI 1995, vol. 1, pp. 518–523. Morgan Kaufmann Publishers Inc., San Francisco (1995)

    Google Scholar 

  9. Krizhevsky, A., Nair, V., Hinton, G.: CIFAR: learning multiple layers of features from tiny images. https://www.cs.toronto.edu/~kriz/cifar.html. Accessed 10 Feb 2023

  10. LeCun, Y., Cortes, C., Burges, C., et al.: MNIST dataset of handwritten digits. https://www.tensorflow.org/datasets/catalog/mnist. Accessed 10 Feb 2023

  11. Mahadevan, V., Li, W.X., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1975–1981 (2010)

    Google Scholar 

  12. Maurer, M., Gerdes, J.C., Lenz, B., Winner, H. (eds.): Autonomes Fahren. Springer, Heidelberg (2015). https://doi.org/10.1007/978-3-662-45854-9

    Book  Google Scholar 

  13. Mauritz, M., Rausch, A., Schaefer, I.: Dependable ADAS by combining design time testing and runtime monitoring. In: FORMS/FORMAT 2014–10th Symposium on Formal Methods for Automation and Safety in Railway and Automotive Systems (2014)

    Google Scholar 

  14. Raulf, C., et al.: Dynamically configurable vehicle concepts for passenger transport. In: 13. Wissenschaftsforum Mobilität “Transforming Mobility - What Next”, Duisburg, Germany (2021)

    Google Scholar 

  15. Rausch, A., Sedeh, A.M., Zhang, M.: Autoencoder-based semantic novelty detection: towards dependable AI-based systems. Appl. Sci. 11(21), 9881 (2021). https://doi.org/10.3390/app11219881

    Article  Google Scholar 

  16. Rushby, J.: Quality measures and assurance for AI software, vol. 18 (1988)

    Google Scholar 

  17. Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018)

    Google Scholar 

  18. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training GANs. Adv. Neural Inf. Process. Syst. 29 (2016)

    Google Scholar 

  19. Schlegl, T., Seeböck, P., Waldstein, S.M., Schmidt-Erfurth, U., Langs, G.: Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. CoRR abs/1703.05921 (2017). https://arxiv.org/abs/1703.05921

  20. Sintini, L., Kunze, L.: Unsupervised and semi-supervised novelty detection using variational autoencoders in opportunistic science missions. In: BMVC (2020)

    Google Scholar 

  21. Wang, H., Li, X., Zhang, T.: Generative adversarial network based novelty detection usingminimized reconstruction error. Front. Inf. Technol. Electron. Eng. 19(1), 116–125 (2018). https://doi.org/10.1631/FITEE.1700786

    Article  Google Scholar 

  22. Youtie, J., Porter, A.L., Shapira, P., Woo, S., Huang, Y.: Autonomous systems: a bibliometric and patent analysis. Technical report, Exptertenkommission Forschung und Innovation (2017)

    Google Scholar 

  23. Yu, F., Chen, H., Wang, X., Xian, W., et al.: BDD100K: a diverse driving dataset for heterogeneous multitask learning (2020). https://bdd-data.berkeley.edu/. Accessed 10 Feb 2023

  24. Zenati, H., Foo, C.S., Lecouat, B., Manek, G., Chandrasekhar, V.R.: Efficient GAN-based anomaly detection. CoRR abs/1802.06222 (2018). https://arxiv.org/abs/1802.06222

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Nour Habib , Yunsu Cho , Abhishek Buragohain or Andreas Rausch .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Habib, N., Cho, Y., Buragohain, A., Rausch, A. (2023). Towards Exploring Adversarial Learning for Anomaly Detection in Complex Driving Scenes. In: Conte, D., Fred, A., Gusikhin, O., Sansone, C. (eds) Deep Learning Theory and Applications. DeLTA 2023. Communications in Computer and Information Science, vol 1875. Springer, Cham. https://doi.org/10.1007/978-3-031-39059-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-39059-3_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-39058-6

  • Online ISBN: 978-3-031-39059-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics