Cross-modal Pretraining and Matching for Video Understanding
Abstract
Reference
Index Terms
- Cross-modal Pretraining and Matching for Video Understanding
Recommendations
Semi-supervised cross-modal hashing via modality-specific and cross-modal graph convolutional networks
Highlights- MCGCN for the first time builds cross-modal graph and jointly learns modality-specific and modality-shared features for semi-supervised cross-modal hashing.
- MCGCN provides a three-channel network architecture, including two modality-...
AbstractCross-modal hashing maps heterogeneous multimedia data into Hamming space for retrieving relevant samples across modalities, which has received great research interests due to its rapid retrieval and low storage cost. In real-world applications, ...
Self-Paced Cross-Modal Subspace Matching
SIGIR '16: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information RetrievalCross-modal matching methods match data from different modalities according to their similarities. Most existing methods utilize label information to reduce the semantic gap between different modalities. However, it is usually time-consuming to manually ...
Deep Video Understanding with a Unified Multi-Modal Retrieval Framework
MM '22: Proceedings of the 30th ACM International Conference on MultimediaIn this paper, we propose a unified multi-modal retrieval framework to tackle two typical video understanding tasks, i.e., matching movie scenes and text descriptions, and scene sentiment classification. For the task of matching movie scenes and text ...
Comments
Information & Contributors
Information
Published In

- General Chairs:
- Bei Liu,
- Jianlong Fu,
- Shizhe Chen,
- Qin Jin,
- Alexander Hauptmann,
- Yong Rui
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Author Tags
Qualifiers
- Keynote
Funding Sources
- National Natural Science Foundation of China
Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 116Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in