research-article

Visible-Infrared Cross-Modal Person Re-identification based on Positive Feedback

Authors:

Xin XuAuthors Info & Claims

MMAsia '21: Proceedings of the 3rd ACM International Conference on Multimedia in Asia

Article No.: 73, Pages 1 - 6

https://doi.org/10.1145/3469877.3497693

Published: 10 January 2022 Publication History

Abstract

Visible-infrared person re-identification (VI-ReID) is undoubtedly a challenging cross-modality person retrieval task with increasing appreciation. Compared to traditional person ReID that focuses on person images in a single RGB mode, VI-ReID suffers from additional cross-modality discrepancy due to the different imaging processes of spectrum cameras. Several effective attempts have been made in recent years to narrow cross-modality gap aiming to improve the re-identification performance, but rarely study the key problem of optimizing the search results combined with relevant feedback. In this paper, we present the idea of cross-modality visible-infrared person re-identification combined with human positive feedback. This method allows the user to quickly optimize the search performance by selecting strong positive samples during the re-identification process. We have validated the effectiveness of our method on a public dataset, SYSU-MM01, and results confirmed that the proposed method achieved superior performance compared to the current state-of-the-art methods.

References

[1]

Yeong-Jun Cho and Kuk-Jin Yoon. 2016. Improving person re-identification via pose-aware multi-shot matching. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, Las Vegas, 1354–1362.

[2]

Michela Farenzena, Loris Bazzani, Alessandro Perina, Vittorio Murino, and Marco Cristani. 2010. Person re-identification by symmetry-driven accumulation of local features. In 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, San Francisco, 2360–2367.

[3]

Zhanxiang Feng, Jianhuang Lai, and Xiaohua Xie. 2019. Learning modality-specific representations for visible-infrared person re-identification. IEEE Transactions on Image Processing 29 (2019), 579–590.

Digital Library

[4]

Douglas Gray and Hai Tao. 2008. Viewpoint invariant pedestrian recognition with an ensemble of localized features. In European conference on computer vision. Springer, Springer, Marseille, 262–275.

Digital Library

[5]

Martin Hirzer, Csaba Beleznai, Peter M Roth, and Horst Bischof. 2011. Person re-identification by descriptive and discriminative classification. In Scandinavian conference on Image analysis. Springer, 91–102.

[6]

Martin Hirzer, Peter M Roth, Martin Köstinger, and Horst Bischof. 2012. Relaxed pairwise learned metric for person re-identification. In European conference on computer vision. Springer, 780–793.

Digital Library

[7]

Yukun Huang, Zheng-Jun Zha, Xueyang Fu, and Wei Zhang. 2019. Illumination-invariant person re-identification. In Proceedings of the 27th ACM International Conference on Multimedia. 365–373.

Digital Library

[8]

Martin Koestinger, Martin Hirzer, Paul Wohlhart, Peter M Roth, and Horst Bischof. 2012. Large scale metric learning from equivalence constraints. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2288–2295.

[9]

Diangang Li, Xing Wei, Xiaopeng Hong, and Yihong Gong. 2020. Infrared-visible cross-modal person re-identification with an x modality. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 4610–4617.

[10]

Wei Li, Rui Zhao, Tong Xiao, and Xiaogang Wang. 2014. Deepreid: Deep filter pairing neural network for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 152–159.

Digital Library

[11]

Xiang Li, Wei-Shi Zheng, Xiaojuan Wang, Tao Xiang, and Shaogang Gong. 2015. Multi-scale learning for low-resolution person re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 3765–3773.

Digital Library

[12]

Shengcai Liao, Yang Hu, Xiangyu Zhu, and Stan Z Li. 2015. Person re-identification by local maximal occurrence representation and metric learning. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2197–2206.

[13]

Shengcai Liao and Stan Z Li. 2015. Efficient psd constrained asymmetric metric learning for person re-identification. In Proceedings of the IEEE international conference on computer vision. 3685–3693.

Digital Library

[14]

Chunxiao Liu, Chen Change Loy, Shaogang Gong, and Guijin Wang. 2013. Pop: Person re-identification post-rank optimisation. In Proceedings of the IEEE International Conference on Computer Vision. 441–448.

Digital Library

[15]

Fangcen Liu, Chenqiang Gao, Yongqing Sun, Yue Zhao, Feng Yang, Anyong Qin, and Deyu Meng. 2021. Infrared and Visible Cross-Modal Image Retrieval through Shared Features. IEEE Transactions on Circuits and Systems for Video Technology 31 (2021), 4485–4496.

Digital Library

[16]

Tetsu Matsukawa, Takahiro Okabe, Einoshin Suzuki, and Yoichi Sato. 2016. Hierarchical gaussian descriptor for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, 1363–1372.

[17]

M Saquib Sarfraz, Arne Schumann, Andreas Eberle, and Rainer Stiefelhagen. 2018. A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 420–429.

[18]

Chunfeng Song, Yan Huang, Wanli Ouyang, and Liang Wang. 2018. Mask-guided contrastive attention model for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1179–1188.

[19]

Hanxiao Wang, Shaogang Gong, Xiatian Zhu, and Tao Xiang. 2016. Human-in-the-loop person re-identification. In European conference on computer vision. Springer, 405–422.

[20]

Xiaogang Wang, Gianfranco Doretto, Thomas Sebastian, Jens Rittscher, and Peter Tu. 2007. Shape and appearance context modeling. In 2007 ieee 11th international conference on computer vision. IEEE, 1–8.

[21]

Yan Wang, Lequn Wang, Yurong You, Xu Zou, Vincent Chen, Serena Li, Gao Huang, Bharath Hariharan, and Kilian Q Weinberger. 2018. Resource aware person re-identification across multiple resolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8042–8051.

[22]

Zheng Wang, Ruimin Hu, Chao Liang, Qingming Leng, and Kaimin Sun. 2014. Region-based interactive ranking optimization for person re-identification. In Pacific Rim Conference on Multimedia. Springer, 1–10.

Digital Library

[23]

Zhixiang Wang, Zheng Wang, Yinqiang Zheng, Yung-Yu Chuang, and Shin’ichi Satoh. 2019. Learning to reduce dual-level discrepancy for infrared-visible person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 618–626.

[24]

Longhui Wei, Shiliang Zhang, Wen Gao, and Qi Tian. 2018. Person transfer gan to bridge domain gap for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 79–88.

[25]

Mikolaj Wieczorek, Barbara Rychalska, and Jacek Dabrowski. 2021. On the Unreasonable Effectiveness of Centroids in Image Retrieval. arXiv preprint arXiv:2104.13643(2021).

[26]

Ancong Wu, Wei-Shi Zheng, Hong-Xing Yu, Shaogang Gong, and Jianhuang Lai. 2017. RGB-infrared cross-modality person re-identification. In Proceedings of the IEEE international conference on computer vision. IEEE, 5380–5389.

[27]

Pengyu Xie, Xin Xu, Zheng Wang, and Toshihiko Yamasaki. 2021. Unsupervised Video Person Re-Identification via Noise and Hard Frame Aware Clustering. In 2021 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1–6.

[28]

Fei Xiong, Mengran Gou, Octavia Camps, and Mario Sznaier. 2014. Person re-identification using kernel-based metric learning methods. In European conference on computer vision. Springer, 1–16.

[29]

Xin Xu, Shiqin Wang, Zheng Wang, Xiaolong Zhang, and Ruimin Hu. 2021. Exploring Image Enhancement for Salient Object Detection in Low Light Images. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17, 1s (2021), 1–19.

Digital Library

[30]

Yang Yang, Jimei Yang, Junjie Yan, Shengcai Liao, Dong Yi, and Stan Z Li. 2014. Salient color names for person re-identification. In European conference on computer vision. Springer, 536–551.

[31]

Mang Ye, Xiangyuan Lan, and Qingming Leng. 2019. Modality-aware collaborative learning for visible thermal person re-identification. In Proceedings of the 27th ACM International Conference on Multimedia. 347–355.

Digital Library

[32]

Mang Ye, Xiangyuan Lan, Zheng Wang, and Pong C Yuen. 2019. Bi-directional center-constrained top-ranking for visible thermal person re-identification. IEEE Transactions on Information Forensics and Security 15 (2019), 407–419.

Digital Library

[33]

Mang Ye, Jianbing Shen, David J. Crandall, Ling Shao, and Jiebo Luo. 2020. Dynamic dual-attentive aggregation learning for visible-infrared person re-identification. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVII 16. Springer, 229–247.

[34]

Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, and Steven CH Hoi. 2021. Deep learning for person re-identification: A survey and outlook. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).

[35]

Mang Ye, Zheng Wang, Xiangyuan Lan, and Pong C Yuen. 2018. Visible thermal person re-identification via dual-constrained top-ranking. In IJCAI, Vol. 1. 2.

[36]

Hong-Xing Yu, Ancong Wu, and Wei-Shi Zheng. 2018. Unsupervised person re-identification by deep asymmetric metric embedding. IEEE transactions on pattern analysis and machine intelligence 42, 4(2018), 956–973.

[37]

Haiyu Zhao, Maoqing Tian, Shuyang Sun, Jing Shao, Junjie Yan, Shuai Yi, Xiaogang Wang, and Xiaoou Tang. 2017. Spindle net: Person re-identification with human body region guided feature decomposition and fusion. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1077–1085.

[38]

Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian. 2015. Scalable person re-identification: A benchmark. In Proceedings of the IEEE international conference on computer vision. 1116–1124.

[39]

Wei-Shi Zheng, Shaogang Gong, and Tao Xiang. 2011. Person re-identification by probabilistic relative distance comparison. In CVPR 2011. IEEE, 649–656.

Digital Library

[40]

Zhedong Zheng, Liang Zheng, and Yi Yang. 2017. Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In Proceedings of the IEEE international conference on computer vision. 3754–3762.

[41]

Xian Zhong, Tianyou Lu, Wenxin Huang, Mang Ye, Xuemei Jia, and Chia-Wen Lin. 2021. Grayscale enhancement colorization network for visible-infrared person re-identification. IEEE Transactions on Circuits and Systems for Video Technology (2021), 1.

[42]

Xian Zhong, Tianyou Lu, Wenxin Huang, Jingling Yuan, Wenxuan Liu, and Chia-Wen Lin. 2020. Visible-infrared Person Re-identification via Colorization-based Siamese Generative Adversarial Network. In Proceedings of the 2020 International Conference on Multimedia Retrieval. 421–427.

Digital Library

Cited By

Zhang MLiu SOuyang YGuo JTang ZLi YCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Explore Hybrid Modeling for Moving Infrared Small Target DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680887(6172-6181)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680887
Zhang MYue KZhang JLi YGao XMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Exploring Feature Compensation and Cross-level Correlation for Infrared Small Target DetectionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548264(1857-1865)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548264
Zhang MBai HZhang JZhang RWang CGuo JGao XMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)RKformer: Runge-Kutta Transformer with Random-Connection Attention for Infrared Small Target DetectionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547817(1730-1738)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3547817

Index Terms

Visible-Infrared Cross-Modal Person Re-identification based on Positive Feedback
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Index terms have been assigned to the content through auto-classification.

Recommendations

Hybrid Modality Metric Learning for Visible-Infrared Person Re-Identification
Visible-infrared person re-identification (Re-ID) has received increasing research attention for its great practical value in night-time surveillance scenarios. Due to the large variations in person pose, viewpoint, and occlusion in the same modality, as ...
Cross-Modality Transformer for Visible-Infrared Person Re-Identification
Computer Vision – ECCV 2022
Abstract
Visible-infrared person re-identification (VI-ReID) is a challenging task due to the large cross-modality discrepancies and intra-class variations. Existing works mainly focus on learning modality-shared representations by embedding different ...
Modality-aware Collaborative Learning for Visible Thermal Person Re-Identification
MM '19: Proceedings of the 27th ACM International Conference on Multimedia

Visible thermal person re-identification (VT-ReID) is a cross-modality pedestrian retrieval problem, which automatically searches persons between day-time visible images and night-time thermal images. Despite the extensive progress in single-modality ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMAsia '21: Proceedings of the 3rd ACM International Conference on Multimedia in Asia

December 2021

508 pages

ISBN:9781450386074

DOI:10.1145/3469877

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 January 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Natural Science Foundation of China

Conference

MMAsia '21

Sponsor:

SIGMM

MMAsia '21: ACM Multimedia Asia

December 1 - 3, 2021

Gold Coast, Australia

Acceptance Rates

Overall Acceptance Rate 59 of 204 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
129
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)4

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang MLiu SOuyang YGuo JTang ZLi YCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Explore Hybrid Modeling for Moving Infrared Small Target DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680887(6172-6181)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680887
Zhang MYue KZhang JLi YGao XMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Exploring Feature Compensation and Cross-level Correlation for Infrared Small Target DetectionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548264(1857-1865)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548264
Zhang MBai HZhang JZhang RWang CGuo JGao XMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)RKformer: Runge-Kutta Transformer with Random-Connection Attention for Infrared Small Target DetectionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547817(1730-1738)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3547817

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten