Convolutional Method for Modeling Video Temporal Context Effectively in Transformer
Abstract
References
Index Terms
- Convolutional Method for Modeling Video Temporal Context Effectively in Transformer
Recommendations
Dual-Spatial Normalized Transformer for image captioning
AbstractSelf-attention modules have shown dominance in image captioning. However, current self-attention modules insufficiently consider spatial correlations between objects in an image and easily suffer from distribution shifts. In this work, we aim to ...
Highlights- A Spatial-Enhanced Attention (SEA) module is proposed to enhance spatial relevance.
- A Gated-Normalized Attention (GNA) module is proposed to fix distributions.
- SEA and GNA module are applied to a Transformer architecture for image ...
Token Shift Transformer for Video Classification
MM '21: Proceedings of the 29th ACM International Conference on MultimediaTransformer achieves remarkable successes in understanding 1 and 2-dimensional signals (e.g., NLP and Image Content Understanding). As a potential alternative to convolutional neural networks, it shares merits of strong interpretability, high ...
Self-attention-based long temporal sequence modeling method for temporal action detection
AbstractTemporal Action Detection (TAD) is a basic and complex task in video understanding. It aims at detecting both the localization and category of actions in a video. The anchor-free TAD methods directly predict the action classes at each location ...
Highlights- Model long temporal sequence for TAD.
- Build a novel framework to model temporal semantics.
- Save computational resource overhead for untrimmed videos in TAD.
- Expensive experiments prove the effectiveness of our method.
Comments
Information & Contributors
Information
Published In
- Conference Chairs:
- Jiman Hong,
- Maart Lanperne,
- Program Chairs:
- Juw Won Park,
- Tomas Cerny,
- Publication Chair:
- Hossain Shahriar
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Author Tags
Qualifiers
- Poster
Conference
Acceptance Rates
Upcoming Conference
- Sponsor:
- sigapp
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 69Total Downloads
- Downloads (Last 12 months)37
- Downloads (Last 6 weeks)0
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in