Wan-Ting Hsu
ABSTRACT
In this paper, we present a prototype system that is capable of associating real objects with virtual models and turning the table top into imaginary virtual scenes. A user can interact with these objects when she or he is immersed in the virtual environment. To accomplish this goal, a vision-based system is developed to online recognize and track the real objects in the scene. The corresponding virtual models are retrieved based on their tactile shapes. They are displayed and moved on a head-mounted display (HMD) according to tracked object poses. The experiment demonstrates that our prototype system can find reasonable association between real and virtual objects, and users are interested in the novel interaction.
Supplemental Material
- Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proc. ACM CHI Conference on Human Factors in Computing Systems. 1957–1967.Google Scholar
Digital Library
- Wei-Lun Huang, Chun-Yi Hung, and I-Chen Lin. 2021. Confidence-based 6D Object Pose Estimation. IEEE Transactions on Multimedia(2021).Google ScholarDigital Library
- Walter Wohlkinger and Markus Vincze. 2011. Ensemble of shape functions for 3D object classification. In IEEE Intl. Conf. on Robotics and Biomimetics. 2987–2992.Google ScholarCross Ref
- Li-Chen Wu, I-Chen Lin, and Ming-Han Tsai. 2016. Augmented Reality Instruction for Object Assembly Based on Markerless Tracking. In Proc. ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games(I3D ’16). 95–102.Google ScholarDigital Library
Recommendations
Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality Interaction
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing SystemsImmersive Virtual Reality typically requires a head-mounted display (HMD) to visualize the environment and hand-held controllers to interact with the virtual objects. Recently, many applications display full-body avatars to represent the user and animate ...
A lightweight and efficient system for tracking handheld objects in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyWhile the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and ...
Funneling and saltation effects for tactile interaction with virtual objects
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsFunneling and saltation are two major illusory feedback techniques for vibration-based tactile feedback. They are often put into practice e.g. to reduce the number of vibrators to be worn on the body and thereby build a less cumbersome feedback device. ...
Comments