Henry Furquim Rocha
ABSTRACT
A challenge in Spatial Computing considering markerless Augmented Reality is to anchor virtual objects relative to a physical space so that objects positions are stable across different tracking and augmented reality devices. This process must be stable in conditions that distinct devices can identify a real space by different strategies and that later the virtual objects appear in the same absolute location. This will also enable user to remotely edit an augmented environment using as reference a real environment. The goal of this research project is a platform that allows to remotely edit an augmented reality scenario referenced in a space previously digitized by a point cloud scan. Editing augmented environments allows users to add new virtual objects in a previously scanned physical space context remotely, enabling a new experience for the user who is interacting in augmented reality locally. A functional prototype of a desktop editor and a mobile application was developed that allows the visualization of environments remotely edited for Augmented Reality. Tests and simulations showed the feasibility of the proposed solution.
- E. Brasil. Computação Espacial: Formatando o Futuro. Available at: <https://everisbrasil.medium.com/computa%C3%A7%C3%A3o-espacial-formatando-o-futuro-564d32ba22fb>. Accessed in sept. 2021.Google Scholar
- V. Agulhon. What is spatial computing ?. Available at: <https://medium.com/@victoragulhon/what-is-spatial-computing-777fae84a499>. Accessed in sept. 2021.Google Scholar
- What is Spatial Computing? Available at: <https://www.fieldbit.net/what-is-spatial-computing/>. Accessed set. 2021.Google Scholar
- US Department of Commerce, National Oceanic; Atmospheric Administration. What is LIDAR. 1 out. 2012.Google Scholar
- Simon Greenwold, 2003. Spatial computing. Massachusetts Institute of Technology, Master.Google Scholar
- A. P. Placitelli and L. Gallo, 2011. Low-Cost Augmented Reality Systems via 3D Point Cloud Sensors, Seventh International Conference on Signal Image Technology & Internet-Based Systems, pp. 188-192, DOI: 10.1109/SITIS.2011.43.Google ScholarDigital Library
- E. Alexiou, E. Upenik and T. Ebrahimi, 2017. Towards subjective quality assessment of point cloud imaging in augmented reality, IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), pp. 1-6, DOI: 10.1109/MMSP.2017.8122237.Google ScholarCross Ref
- Mahmood, Bilawal, SangUk Han, and Dong-Eun Lee. 2020. BIM-Based Registration and Localization of 3D Point Clouds of Indoor Scenes Using Geometric Features for Augmented Reality Remote Sensing 12, no. 14: 2302. DOI: https://doi.org/10.3390/rs12142302.Google ScholarCross Ref
- V. Dudhee, and V. Vukovic, 2021. Building information model visualisation in augmented reality, Smart and Sustainable Built Environment, DOI: https://doi.org/10.1108/SASBE-02-2021-0021.Google ScholarCross Ref
- Géodésien, Devrim Akca, and Institut für Geodäsie und Photogrammetrie (Zürich). 2003. Full Automatic Registration of Laser Scanner Point Clouds.Google Scholar
- Arun, K. S., T. S. Huang, and S. D. Blostein. 1987. “Least-Squares Fitting of Two 3-D Point Sets.” IEEE Transactions on Pattern Analysis and Machine Intelligence 9 (5): 698–700.Google Scholar
- Zhang, Zhengyou. 1994. “Iterative Point Matching for Registration of Free-Form Curves and Surfaces.” International Journal of Computer Vision. DOI: https://doi.org/10.1007/bf01427149.Google ScholarDigital Library
- Low, Kok-Lim. 2004. "Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration". Comp.nys.edu.sg. Technical Report TR04-004, Department of Computer Science, University of North Carolina at Chapel Hill. Retrieved 2017-02-27Google Scholar
- Pomerleau, François, Francis Colas, and Roland Siegwart. 2015. “A Review of Point Cloud Registration Algorithms for Mobile Robotics.” DOI: https://doi.org/10.1561/9781680830255.Google ScholarCross Ref
- Rusinkiewicz, S., and M. Levoy. n.d. “Efficient Variants of the ICP Algorithm.” Proceedings Third International Conference on 3-D Digital Imaging and Modeling. DOI: https://doi.org/10.1109/im.2001.924423.Google ScholarCross Ref
- Visualix. Available at: <https://www.visualix.com>. Accessed in sept. 2021.Google Scholar
- Croquet - Collaboration Library and Framework. Available at: <https://www.croquet.studio>. Accessed in sept. 2021.Google Scholar
- Unity Technologies. n.d. “Unity.” Accessed in November 2021. https://unity.com/pt/frontpage.Google Scholar
- The PCD (Point Cloud Data) file format Point Cloud Library documentation. <http://pointclouds.org/documentation/tutorials/pcd_file_format.html.Google Scholar
- UNITY TECHNOLOGIES. Mesh. Available at: <https://docs.unity3d.com/ScriptReference/Mesh.html>. Accessed in sept. 2021.Google Scholar
- UNITY TECHNOLOGIES. MeshTopology.Points. Available at: <https://docs.unity3d.com/ScriptReference/MeshTopology.Points.html>. Accessed in 27 set. 2021b.Google Scholar
- “Hull Outlines.” 2018. July 21, 2018. https://www.ronja-tutorials.com/post/020-hull-outline/.Google Scholar
- Redirect Notice. Available in: <https://bgolus.medium.com/the-quest-for-very-wide-outlines-ba82ed442cd9>. Accessed in sept. 2021.Google Scholar
- UNITY3DAZURE. GitHub - Unity3dAzure/RESTClient: REST Client for Unity with JSON and XML parsing. (Features JSON helper to handle nested arrays and deserializing abstract types). Available at: <https://github.com/Unity3dAzure/RESTClient>. Accessed in 27 set. 2021.Google Scholar
- CYSHARP. GitHub - Cysharp/UniTask: Provides an efficient allocation free async/await integration for Unity. Available at: <https://github.com/Cysharp/UniTask>. Accessed in sept. 2021.Google Scholar
- UNITY TECHNOLOGIES. UnityWebRequest. Available at: <https://www.google.com/url?q=https://docs.unity3d.com/ScriptReference/Networking.UnityWebRequest.html&sa=D&source=editors&ust=1632782357463000&usg=AOvVaw0Mhr8182lM9mxTysu0BtlM>. Accessed in 27 set. 2021c.Google Scholar
- Fastify, Fast and low overhead web framework, for Node.js. Available at: <https://www.fastify.io/>. Accessed in sept. 2021.Google Scholar
- Next-generation Node.js and TypeScript ORM. Available at: <https://www.prisma.io>. Accessed in sept. 2021.Google Scholar
- HOYOS, M. What is an ORM and Why You Should Use it - Bits and Pieces. Available at: <https://blog.bitsrc.io/what-is-an-orm-and-why-you-should-use-it-b2b6f75f5e2a>. Accessed in 27 set. 2021.Google Scholar
- MySQL. Available at: <https://www.mysql.com>. Accessed in 27 set. 2021.Google Scholar
- Armazenamento S3 - Simple Storage Service - Amazon Web Services. Available at: <https://aws.amazon.com/pt/s3/>. Accessed in 27 set. 2021.Google Scholar
- NestJS - A progressive Node.js framework. Available at: <https://nestjs.com>. Accessed in 27 set. 2021.Google Scholar
- API Documentation & Design Tools for Teams. Available at: <https://swagger.io>. Accessed in sept. 2021.Google Scholar
- About AR Foundation. Available at: <https://docs.unity3d.com/Packages/[email protected]/manual/index.html>. Accessed in sept. 2021.Google Scholar
- Point Cloud Library. n.d. “Point Cloud Library.” Accessed November 24, 2021. https://pointcloudlibrary.github.io/.Google Scholar
- Lindeberg, Tony. 2012. “Scale Invariant Feature Transform.” Scholarpedia. https://doi.org/10.4249/scholarpedia.10491.Google ScholarCross Ref
- Rusu, Radu Bogdan, Nico Blodow, and Michael Beetz. 2009. “Fast Point Feature Histograms (FPFH) for 3D Registration.” 2009 IEEE International Conference on Robotics and Automation. https://doi.org/10.1109/robot.2009.5152473.Google ScholarCross Ref
- Pham, Quang-Hieu, Mikaela Angelina Uy, Binh-Son Hua, Duc Thanh Nguyen, Gemma Roig, and Sai-Kit Yeung. 2020. “LCD: Lear ned Cross-Domain Descriptors for 2D-3D Matching.” Proceedings of the AAAI Conference on Artificial Intelligence. DOI:https://doi.org/10.1609/aaai.v34i07.6859.Google ScholarCross Ref
Recommendations
The Role of Augmented Reality within Ambient Intelligence
An Augmented Reality (AR) is a technology which provides the user with a real time 3D enhanced perception of a physical environment with addition virtual elements-either virtual scenery, information regarding surroundings, other contextual information-...
SIG: Spatiality of Augmented Reality User Interfaces
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsAugmented reality and spatial information manipulation is being increasingly used as part of environ- ment integrated form factors and wearable device such as head-mounted displays. The integration of this exciting technology in many aspects of peoples' ...
Mixed Reality Spatial Computing in a Remote Learning Classroom
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User InteractionWe present a case study on the use of mixed reality (MR) spatial computing in a fully remote classroom. We conducted a 10-week undergraduate class fully online, using a combination of traditional teleconferencing software and MR spatial computing (...
Comments