Karteek Alahari
ABSTRACT
Several theories in cognitive neuroscience suggest that when people interact with the world, or simulate interactions, they do so from a first-person egocentric perspective, and seamlessly transfer knowledge between third-person (observer) and first-person (actor). Despite this, learning such models for human action recognition has not been well studied. We address this challenge by introducing Charades-Ego, a large-scale dataset of paired first-person and third-person videos, and presenting a formulation to learn a joint representation of actions from these two perspectives. This talk will present this dataset and our actor-observer model.
Index Terms
- Actor and Observer: Joint Modeling of First and Third-Person Videos
Recommendations
TurtleGO: Application with Cubes for Children’s Spatial Ability Based on AR Technology
Virtual, Augmented and Mixed Reality. Applications and Case StudiesAbstractIn this paper, we introduce a new application called TurtleGO that uses augmented reality (AR) technology, with which K-2 children can experience a geometric sense of the egocentric perspective. This application was developed with the concept of ...
Performer vs. observer: whose comfort level should we consider when examining the social acceptability of input modalities for head-worn display?
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyThe popularity of head-worn displays (HWD) technologies such as Virtual Reality (VR) and Augmented Reality (AR) headsets is growing rapidly. To predict their commercial success, it is essential to understand the acceptability of these new technologies, ...
Seeing is Feeling: A Novel Haptic Display for Wearer-Observer Mutual Haptic Understanding
SA '22: SIGGRAPH Asia 2022 Emerging TechnologiesWe propose a new haptic display that enables mutual understanding of haptic sensation between the wearer and an observer. In addition to presenting haptic sensations by inducing skin deformation, we have achieved creating a mutual understanding of the ...
Comments