skip to main content
10.1145/3581783.3612531acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Cross-Illumination Video Anomaly Detection Benchmark

Published: 27 October 2023 Publication History

Abstract

Video anomaly detection is a critical problem with widespread applications in domains such as security surveillance. Most existing methods focus on video anomaly detection tasks under uniform illumination conditions. However, in the real world, the situation is much more complicated. Video anomalies are widespread across periods and under different illumination conditions, which can lead to the detector model incorrectly reporting high anomaly scores. To address this challenge, we design a benchmark framework for the cross-illumination video anomaly detection task. The framework restores videos under different illumination scales to the same illumination scale. This reduces domain differences between uniformly illuminated training videos and differently illuminated test videos. Additionally, to demonstrate the illumination change problem and evaluate our model, we construct three large-scale datasets with a wide range of illumination variations. We experimentally validate our approach on three cross-illuminance video anomaly detection datasets. Experimental results show that our method outperforms existing methods regarding detection accuracy and is more robust.

Supplemental Material

MP4 File
Welcome to our exploration of Cross-Illumination Video Anomaly Detection. In security and surveillance, detecting anomalies is crucial, yet varying lighting conditions often challenge existing methods. We conducted experiments on Avenue++ dataset, revealing the limitations of traditional VAD models in cross-illumination scenarios. Our motivation led us to propose a novel Cross-Illumination VAD framework that minimizes domain differences, enhancing detection accuracy. This framework incorporates an Illumination Discrimination Network, Video Illumination Enhancement Network, and VAD Network. Our experiments demonstrated substantial performance gains over baseline methods. In qualitative tests, our approach consistently outperformed baseline models, showcasing its effectiveness in challenging cross-illumination scenarios. Ablation experiments further validated our method's robustness.

References

[1]
Davide Abati, Angelo Porrello, Simone Calderara, and Rita Cucchiara. 2019. Latent space autoregression for novelty detection. In Proceedings of the IEEE/CVF conf. on computer vision and pattern recognition. 481--490.
[2]
Borislav Antić and Björn Ommer. 2011. Video parsing for abnormality detection. IEEE, 2415--2422.
[3]
Marcella Astrid, Muhammad Zaigham Zaheer, and Seung-Ik Lee. 2021. Synthetic Temporal Anomaly Guided End-to-End Video Anomaly Detection. In IEEE/CVF International Conf. on Computer Vision Workshops, ICCVW 2021, Montreal, BC, Canada, October 11-17, 2021. IEEE, 207--214. https://doi.org/10.1109/ICCVW54120.2021.00028
[4]
Ruichu Cai, Hao Zhang, Wen Liu, Shenghua Gao, and Zhifeng Hao. 2021. Appearance-motion memory consistency network for video anomaly detection. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35. 938--946.
[5]
Congqi Cao, Yue Lu, and Yanning Zhang. 2022. Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detection. arXiv preprint arXiv:2209.02899 (2022).
[6]
Chi-Mao Fan, Tsung-Jung Liu, and Kuan-Hsien Liu. 2022. Half wavelet attention on M-Net for low-light image enhancement. In 2022 IEEE International Conf. on Image Processing (ICIP). IEEE, 3878--3882.
[7]
Mariana-Iuliana Georgescu, Antonio Barbalau, Radu Tudor Ionescu, Fahad Shahbaz Khan, Marius Popescu, and Mubarak Shah. 2021. Anomaly Detection in Video via Self-Supervised and Multi-Task Learning. In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021. Computer Vision Foundation / IEEE, 12742--12752. https://doi.org/10.1109/CVPR46437.2021.01255
[8]
Dong Gong, Lingqiao Liu, Vuong Le, Budhaditya Saha, Moussa Reda Mansour, Svetha Venkatesh, and Anton van den Hengel. 2019. Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection. In 2019 IEEE/CVF International Conf. on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019. IEEE, 1705--1714. https://doi.org/10.1109/ICCV.2019.00179
[9]
Chunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy, Junhui Hou, Sam Kwong, and Runmin Cong. 2020. Zero-reference deep curve estimation for low-light image enhancement. In Proceedings of the IEEE/CVF Conf. on computer vision and pattern recognition. 1780--1789.
[10]
Xiaojie Guo and Qiming Hu. 2023. Low-light image enhancement via breaking down the darkness. International Journal of Computer Vision, Vol. 131, 1 (2023), 48--66.
[11]
Xiaojie Guo, Yu Li, and Haibin Ling. 2016. LIME: Low-light image enhancement via illumination map estimation. IEEE Transactions on image processing, Vol. 26, 2 (2016), 982--993.
[12]
Mahmudul Hasan, Jonghyun Choi, Jan Neumann, Amit K. Roy-Chowdhury, and Larry S. Davis. 2016. Learning Temporal Regularity in Video Sequences. In 2016 IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016. IEEE Computer Society, 733--742. https://doi.org/10.1109/CVPR.2016.86
[13]
Yukun Huang, Zheng-Jun Zha, Xueyang Fu, and Wei Zhang. 2019. Illumination-invariant person re-identification. In Proceedings of the 27th ACM international conf. on multimedia. 365--373.
[14]
Radu Tudor Ionescu, Fahad Shahbaz Khan, Mariana-Iuliana Georgescu, and Ling Shao. 2019. Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In Proceedings of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition. 7842--7851.
[15]
Yifan Jiang, Xinyu Gong, Ding Liu, Yu Cheng, Chen Fang, Xiaohui Shen, Jianchao Yang, Pan Zhou, and Zhangyang Wang. 2021. Enlightengan: Deep light enhancement without paired supervision. IEEE transactions on image processing, Vol. 30 (2021), 2340--2349.
[16]
Yeong-Taeg Kim. 1997. Contrast enhancement using brightness preserving bi-histogram equalization. IEEE transactions on Consumer Electronics, Vol. 43, 1 (1997), 1--8.
[17]
Yuandu Lai, Yahong Han, and Yaowei Wang. 2021. Anomaly Detection with Prototype-Guided Discriminative Latent Embeddings. In IEEE International Conf. on Data Mining, ICDM 2021, Auckland, New Zealand, December 7-10, 2021, James Bailey, Pauli Miettinen, Yun Sing Koh, Dacheng Tao, and Xindong Wu (Eds.). IEEE, 300--309. https://doi.org/10.1109/ICDM51629.2021.00040
[18]
Chulwoo Lee, Chul Lee, and Chang-Su Kim. 2013. Contrast enhancement based on layered difference representation of 2D histograms. IEEE transactions on image processing, Vol. 22, 12 (2013), 5372--5384.
[19]
Sam Leroux, Bo Li, and Pieter Simoens. 2022. Multi-branch neural networks for video anomaly detection in adverse lighting and weather conditions. In Proceedings of the IEEE/CVF Winter Conf. on Applications of Computer Vision. 2358--2366.
[20]
Jinjiang Li, Xiaomei Feng, and Zhen Hua. 2021. Low-Light Image Enhancement via Progressive-Recursive Network. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 11 (2021), 4227--4240. https://doi.org/10.1109/TCSVT.2021.3049940
[21]
Weixin Li, Vijay Mahadevan, and Nuno Vasconcelos. 2013. Anomaly detection and localization in crowded scenes., Vol. 36, 1 (2013), 18--32.
[22]
Wen Liu, Weixin Luo, Dongze Lian, and Shenghua Gao. 2018. Future frame prediction for anomaly detection--a new baseline. 6536--6545.
[23]
Xiaokai Liu, Weihao Ma, Xiaorui Ma, and Jie Wang. 2023. LAE-Net: a locally-adaptive embedding network for low-light image enhancement. Pattern Recognition, Vol. 133 (2023), 109039.
[24]
Zhian Liu, Yongwei Nie, Chengjiang Long, Qing Zhang, and Guiqing Li. 2021. A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Prediction. In 2021 IEEE/CVF International Conf. on Computer Vision, ICCV 2021, Montreal, QC, Canada, October 10-17, 2021. IEEE, 13568--13577. https://doi.org/10.1109/ICCV48922.2021.01333
[25]
Kin Gwn Lore, Adedotun Akintayo, and Soumik Sarkar. 2017. LLNet: A deep autoencoder approach to natural low-light image enhancement. Pattern Recognition, Vol. 61 (2017), 650--662.
[26]
Cewu Lu, Jianping Shi, and Jiaya Jia. 2013. Abnormal event detection at 150 fps in matlab. 2720--2727.
[27]
Weixin Luo, Wen Liu, and Shenghua Gao. 2017a. Remembering history with convolutional LS™ for anomaly detection. In 2017 IEEE International Conf. on Multimedia and Expo, ICME 2017, Hong Kong, China, July 10-14, 2017. IEEE Computer Society, 439--444. https://doi.org/10.1109/ICME.2017.8019325
[28]
Weixin Luo, Wen Liu, and Shenghua Gao. 2017b. A revisit of sparse coding based anomaly detection in stacked rnn framework. In Proceedings of the IEEE international conf. on computer vision. 341--349.
[29]
Feifan Lv, Yu Li, and Feng Lu. 2021. Attention guided low-light image enhancement with a large scale low-light simulation dataset. International Journal of Computer Vision, Vol. 129, 7 (2021), 2175--2193.
[30]
Long Ma, Tengyu Ma, Risheng Liu, Xin Fan, and Zhongxuan Luo. 2022. Toward fast, flexible, and robust low-light image enhancement. In Proceedings of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition. 5637--5646.
[31]
Asim Munawar, Phongtharin Vinayavekhin, and Giovanni De Magistris. 2017. Limiting the reconstruction capability of generative neural network using negative learning. In 27th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2017, Tokyo, Japan, September 25-28, 2017, Naonori Ueda, Shinji Watanabe, Tomoko Matsui, Jen-Tzung Chien, and Jan Larsen (Eds.). IEEE, 1--6. https://doi.org/10.1109/MLSP.2017.8168155
[32]
Hyunjong Park, Jongyoun Noh, and Bumsub Ham. 2020. Learning Memory-Guided Normality for Anomaly Detection. In 2020 IEEE/CVF Conf. on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. Computer Vision Foundation / IEEE, 14360--14369. https://doi.org/10.1109/CVPR42600.2020.01438
[33]
Stephen M Pizer, E Philip Amburn, John D Austin, Robert Cromartie, Ari Geselowitz, Trey Greer, Bart ter Haar Romeny, John B Zimmerman, and Karel Zuiderveld. 1987. Adaptive histogram equalization and its variations. Computer vision, graphics, and image processing, Vol. 39, 3 (1987), 355--368.
[34]
Zia-ur Rahman, Daniel J Jobson, and Glenn A Woodell. 1996. Multi-scale retinex for color image enhancement. In Proceedings of 3rd IEEE international Conf. on image processing, Vol. 3. IEEE, 1003--1006.
[35]
Mohammad Sabokrou, Mahmood Fathy, Mojtaba Hoseini, and Reinhard Klette. 2015. Real-time anomaly detection and localization in crowded scenes. In Proceedings of the IEEE conf. on computer vision and pattern recognition workshops. 56--62.
[36]
Mohammad Sabokrou, Mohsen Fayyaz, Mahmood Fathy, Zahra Moayed, and Reinhard Klette. 2018a. Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes. Computer Vision and Image Understanding, Vol. 172 (2018), 88--97.
[37]
Mohammad Sabokrou, Mohammad Khalooei, Mahmood Fathy, and Ehsan Adeli. 2018b. Adversarially learned one-class classifier for novelty detection. In Proceedings of the IEEE Conf. on computer vision and pattern recognition. 3379--3388.
[38]
Venkatesh Saligrama and Zhu Chen. 2012. Video anomaly detection based on local statistical aggregates. IEEE, 2112--2119.
[39]
Yao Tang, Lin Zhao, Shanshan Zhang, Chen Gong, Guangyu Li, and Jian Yang. 2020. Integrating prediction and reconstruction for anomaly detection. Pattern Recognition Letters, Vol. 129 (2020), 123--130.
[40]
Namrata Vaswani, Amit K Roy-Chowdhury, and Rama Chellappa. 2005. "Shape Activity": a continuous-state HMM for moving/deforming shapes with application to abnormal activity detection., Vol. 14, 10 (2005), 1603--1616.
[41]
Shuhang Wang, Jin Zheng, Hai-Miao Hu, and Bo Li. 2013. Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE transactions on image processing, Vol. 22, 9 (2013), 3538--3548.
[42]
Yufei Wang, Renjie Wan, Wenhan Yang, Haoliang Li, Lap-Pui Chau, and Alex Kot. 2022. Low-light image enhancement with normalizing flow. In Proceedings of the AAAI Conf. on Artificial Intelligence, Vol. 36. 2604--2612.
[43]
Dan Xu, Elisa Ricci, Yan Yan, Jingkuan Song, and Nicu Sebe. 2015. Learning Deep Representations of Appearance and Motion for Anomalous Event Detection. In Proceedings of the British Machine Vision Conf. 2015, BMVC 2015, Swansea, UK, September 7-10, 2015, Xianghua Xie, Mark W. Jones, and Gary K. L. Tam (Eds.). BMVA Press, 8.1--8.12. https://doi.org/10.5244/C.29.8
[44]
Qing Xu, Hailin Jiang, Riccardo Scopigno, and Mateu Sbert. 2014. A novel approach for enhancing very dark image sequences. Signal processing, Vol. 103 (2014), 309--330.
[45]
Muhammad Zaigham Zaheer, Jin-Ha Lee, Marcella Astrid, and Seung-Ik Lee. 2020. Old Is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigm. In 2020 IEEE/CVF Conf. on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. Computer Vision Foundation / IEEE, 14171--14181. https://doi.org/10.1109/CVPR42600.2020.01419
[46]
Zelong Zeng, Zhixiang Wang, Zheng Wang, Yinqiang Zheng, Yung-Yu Chuang, and Shin'ichi Satoh. 2020. Illumination-adaptive person re-identification. IEEE Transactions on Multimedia, Vol. 22, 12 (2020), 3064--3074.
[47]
Cheng Zhang, Qingsen Yan, Yu Zhu, Xianjun Li, Jinqiu Sun, and Yanning Zhang. 2020. Attention-based network for low-light image enhancement. In 2020 IEEE International Conf. on Multimedia and Expo (ICME). IEEE, 1--6.
[48]
Guoqing Zhang, Zhiyuan Luo, Yuhao Chen, Yuhui Zheng, and Weisi Lin. 2022. Illumination unification for person re-identification. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 32, 10 (2022), 6766--6777.
[49]
Bo Zong, Qi Song, Martin Renqiang Min, Wei Cheng, Cristian Lumezanu, Dae-ki Cho, and Haifeng Chen. 2018. Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. In 6th International Conf. on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conf. Track Proceedings. OpenReview.net. https://openreview.net/forum?id=BJJLHbb0-

Cited By

View all
  • (2025)IPAD: Industrial Process Anomaly Detection DatasetIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.346551735:1(380-393)Online publication date: Jan-2025
  • (2024)Alignment-Free RGBT Salient Object Detection: Semantics-Guided Asymmetric Correlation Network and a Unified BenchmarkIEEE Transactions on Multimedia10.1109/TMM.2024.341054226(10692-10707)Online publication date: 1-Jan-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '23: Proceedings of the 31st ACM International Conference on Multimedia
October 2023
9913 pages
ISBN:9798400701085
DOI:10.1145/3581783
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cross-domain video anomaly detection
  2. cross-illumination video anomaly detection
  3. low-light image enhancement

Qualifiers

  • Research-article

Funding Sources

Conference

MM '23
Sponsor:
MM '23: The 31st ACM International Conference on Multimedia
October 29 - November 3, 2023
Ottawa ON, Canada

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)66
  • Downloads (Last 6 weeks)6
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)IPAD: Industrial Process Anomaly Detection DatasetIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.346551735:1(380-393)Online publication date: Jan-2025
  • (2024)Alignment-Free RGBT Salient Object Detection: Semantics-Guided Asymmetric Correlation Network and a Unified BenchmarkIEEE Transactions on Multimedia10.1109/TMM.2024.341054226(10692-10707)Online publication date: 1-Jan-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media