Testing VR headset cameras for capturing written content
Pages 153 - 156
Abstract
Virtual reality (VR) has become an important tool for providing immersive and collaborative teleprensence experiences. The technology has the possibility of bringing people in different geographical places together in an immersive way and makes sharing knowledge, ideas and experience easier. An important evolution in the immersive experience is the introduction of items from the real world into the virtual environment and the creation of a mixed reality experience. We present a pilot study in the use of the built-in head mounted display (HMD) cameras, for capturing parts of the environment and presenting them in VR. Particular emphasis is put on capturing physical written content on flat surfaces and visualizing it in VR for sharing with other users. We test the HTC Vive and Valve Index cameras and compare them to two external solutions by applying optical character recognition (OCR) on captured and rectified images from them. We demonstrate that the Valve Index camera has the potential to be used for capturing readable text for use in shared VR.
References
[1]
Azadeh Bashiri, Marjan Ghazisaeedi, and Leila Shahmoradi. 2017. The opportunities of virtual reality in the rehabilitation of children with attention deficit hyperactivity disorder: a literature review. Korean journal of pediatrics 60, 11 (2017), 337.
[2]
Adrian Borrego, Jorge Latorre, Mariano Alcañiz, and Roberto Llorens. 2018. Comparison of Oculus Rift and HTC Vive: feasibility for virtual reality-based exploration, navigation, exergaming, and rehabilitation. Games for health journal 7, 3 (2018), 151--156.
[3]
Abbie Brown and Tim Green. 2016. Virtual reality: Low-cost tools and resources for the classroom. TechTrends 60, 5 (2016), 517--519.
[4]
Abraham G Campbell, Thomas Holz, Jonny Cosgrove, Mike Harlick, and Tadhg O'Sullivan. 2019. Uses of Virtual Reality for Communication in Financial Services: A Case Study on Comparing Different Telepresence Interfaces: Virtual Reality Compared to Video Conferencing. In Future of Information and Communication Conference. Springer, 463--481.
[5]
Google. 2016. Daydream View. https://vr.google.com/daydream/smartphonevr/. Accessed: 2019-11-05.
[6]
Jeremy Hartmann, Christian Holz, Eyal Ofek, and Andrew D Wilson. 2019. RealityCheck: Blending Virtual Environments with Situated Physical Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 347.
[7]
HTC. 2016. VIVE. https://www.vive.com/eu/. Accessed: 2019-11-05.
[8]
Intel. 2018. RealSense D415. https://www.intelrealsense.com/depth-camera-d415/. Accessed: 2019-11-05.
[9]
Kohei Kanamori, Nobuchika Sakata, Tomu Tominaga, Yoshinori Hijikata, Kensuke Harada, and Kiyoshi Kiyokawa. 2018. Obstacle avoidance method in real space for virtual reality immersion. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 80--89.
[10]
Christopher Kenworthy. 2011. Master Shots Vol 1: 100 Advanced Camera Techniques to Get an Expensive Look on Your Low-Budget Movie. Vol. 100. Michael Wiese Productions.
[11]
Hao Li, Laura Trutoiu, Kyle Olszewski, Lingyu Wei, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls, and Chongyang Ma. 2015. Facial performance sensing head-mounted display. ACM Transactions on Graphics (ToG) 34, 4 (2015),47.
[12]
Jia-Wei Lin, Ping-Hsuan Han, Jiun-Yu Lee, Yang-Sheng Chen, Ting-Wei Chang, Kuan-Wen Chen, and Yi-Ping Hung. 2017. Visualizing the keyboard in virtual reality for enhancing immersive experience. In ACM SIGGRAPH 2017 Posters. ACM, 35.
[13]
Logitech. 2010. C270 HD. https://www.logitech.com/en-roeu/product/hd-webcam-c270. Accessed: 2019-11-05.
[14]
Will Molloy, Edward Huang, and Burkhard C Wünsche. 2019. Mixed Reality Piano Tutor: A Gamified Piano Practice Environment. In 2019 International Conference on Electronics, Information, and Communication (ICEIC). IEEE, 1--7.
[15]
Diederick C Niehorster, Li Li, and Markus Lappe. 2017. The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research. i-Perception 8, 3 (2017), 2041669517708205.
[16]
Oculus. 2019. Quest. https://www.oculus.com/quest/?locale=en_US. Accessed: 2019-11-05.
[17]
Oculus. 2019. Rift-S. https://www.oculus.com/rift-s/?locale=en_US. Accessed: 2019-11-05.
[18]
Thomas D Parsons, Tyler Duffield, and Justin Asbee. 2019. A Comparison of Virtual Reality Classroom Continuous Performance Tests to Traditional Continuous Performance Tests in Delineating ADHD: a Meta-Analysis. Neuropsychology review (2019), 1--19.
[19]
Daniel Pohl and Carlos Fernandez de Tejada Quemada. 2016. See what I see: Concepts to improve the social acceptance of HMDs. In 2016 IEEE Virtual Reality (VR). IEEE, 267--268.
[20]
Adrian Rosebrock. 2016. Practical python and opencv. Miami: pyimageseach (2016).
[21]
Bektur Ryskeldiev, Michael Cohen, and Jens Herder. 2018. Streamspace: Pervasive mixed reality telepresence for remote collaboration on mobile devices. Journal of Information Processing 26 (2018), 177--185.
[22]
Samsung. 2015. Gear VR. https://www.samsung.com/global/galaxy/gear-vr/. Accessed: 2019-11-05.
[23]
Ray Smith.2007. An overview of the Tesseract OCR engine. In Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), Vol. 2. IEEE, 629--633.
[24]
Mirko Suznjevic, Matija Mandurov, and Maja Matijasevic. 2017. Performance and QoE assessment of HTC Vive and Oculus Rift for pick-and-place tasks in VR. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1--3.
[25]
Georgios Tsaramirsis, Seyed M Buhari, Khalid Obaid Al-Shammari, Saud Ghazi, Mohd Saleem Nazmudeen, and Kostandinos Tsaramirsis. 2016. Towards simulation of the classroom learning experience: Virtual reality approach. In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). IEEE, 1343--1346.
[26]
Valve. 2019. Index. https://www.valvesoftware.com/en/index. Accessed: 2019-11-05.
[27]
VisionSource. [n. d.]. Eye Chart. https://visionsource.com/patients/free-eye-chart-download/. Accessed: 2019-11-05.
[28]
Junchen Wang, Hideyuki Suenaga, Liangjing Yang, Etsuko Kobayashi, and Ichiro Sakuma. 2017. Video see-through augmented reality for oral and maxillofacial surgery. The International Journal of Medical Robotics and Computer Assisted Surgery 13, 2 (2017), e1754.
[29]
Jackie Junrui Yang, Christian Holz, Eyal Ofek, and Andrew D Wilson. 2019. DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM, 1093--1107.
[30]
Yuchen Zhao, Maurizio Forte, and Regis Kopper. 2018. VR touch museum. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 741--742.
Index Terms
- Testing VR headset cameras for capturing written content
Recommendations
Building and Employing Cross-Reality
This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...
Social VR Platform: Building 360-degree Shared VR Spaces
TVX '17 Adjunct: Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online VideoVirtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. In this demo, we present our ongoing efforts towards social and shared VR; ...
Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment
Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Comments
Information & Contributors
Information
Published In
Copyright © 2020 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 February 2020
Check for updates
Author Tags
Qualifiers
- Poster
Conference
AcademicMindtrek '20
Acceptance Rates
AcademicMindtrek '20 Paper Acceptance Rate 24 of 45 submissions, 53%;
Overall Acceptance Rate 110 of 207 submissions, 53%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 158Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in