Giovanni Pintore
Enrico Gobbetti
ABSTRACT
We report on the 3DNSITE system, a web-based client-server 3D visualization tool for streaming and visualizing large tridimensional hybrid data (georeferenced point clouds and photographs with associated viewpoints and camera parameters). The system is motivated by the need to simplify data acquisition and location recognition for crisis managers and first responders during emergency operations or training sessions. In this peculiar context, it is very important to easily share 3D environment data among people in a distributed environment, accessing huge 3D models with embedded photographs on devices with heterogenous hardware capabilities and interconnected on different network types. Moreover, since the specific end-users are not necessary skilled with virtual reality and 3D objects interaction, the navigation interface must be simple and intuitive. Taking into account these constraints, we propose a mixel object-based/image-based system, which enhances the current state-of-the-art by exploiting a multi-resolution representation for the 3D model and a multi-level cache system for both the images and 3D models structure. A novel low-degree-of-freedom user interface is presented to navigate in the scenario with touchscreen devices. The proposed implementation, included in a more general training and decision framework for emergency operations, is evaluated on real-world datasets.
Supplemental Material
- Bettio, F., Gobbetti, E., Marton, F., and Pintore, G. 2007. High-quality networked terrain rendering from compressed bitstreams. In Proc. ACM Web3D International Symposium, New York, NY, USA, ACM Press, 37--44. Google Scholar
Digital Library
- Boin, A. 2009. The new world of crises and crisis management: Implications for policymaking and research. Review of Policy Research 26, 4, 367--377.Google ScholarCross Ref
- Brivio, P., Tarini, M., Cignoni, P., and Scopigno, R. 2012. Joint interactive visualization of 3D models and pictures in walkable scenes. In Eurographics 2012 - Posters, Eurographics Association.Google Scholar
- Capel, D. 2005. An effective bail-out test for ransac consensus scoring. In BMVC British Machine Vision Conf, 629--638.Google Scholar
- Carver, L., and Turoff, M. 2007. Human-computer interaction: the human and computer as a team in emergency management information systems. Commun. ACM 50, 3 (Mar.), 33--38. Google ScholarDigital Library
- Chum, O., Matas, J., and Kittler, J. 2003. Locally optimized ransac. In DAGM-Symposium, 236--243.Google Scholar
- Cignoni, P., Ganovelli, F., Gobbetti, E., Marton, F., Ponchio, F., and Scopigno, R. 2004. Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models. ACM Trans. Graph. 23, 3, 796--803. Google ScholarDigital Library
- Cignoni, P., Ganovelli, F., Gobbetti, E., Marton, F., Ponchio, F., and Scopigno, R. 2005. Batched multi triangulation. In Proc. IEEE Visualization, 207--214.Google Scholar
- Dugdale J., Bellamine-Ben Saoud N., P. B., and N., P. 2010. Simulation and emergency management. Information Systems for Emergency Management, 229--253.Google Scholar
- Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (June), 381--395. Google ScholarDigital Library
- Gobbetti, E., and Marton, F. 2004. Layered point clouds: a simple and efficient multiresolution structure for distributing and rendering gigantic point-sampled models. Computers & Graphics 28, 6 (Dec.), 815--826. Google ScholarDigital Library
- Goesele, M., Ackermann, J., Fuhrmann, S., Haubold, C., Klowsky, R., Steedly, D., and Szeliski, R. 2010. Ambient point clouds for view interpolation. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 95:1--95:6. Google ScholarDigital Library
- Kasik, D., Dietrich, A., Gobbetti, E., Marton, F., Manocha, D., Slusallek, P., Stephens, A., and Yoon, S.-E. 2008. Massive model visualization techniques: course notes. In ACM SIGGRAPH 2008 classes, ACM, New York, NY, USA, SIGGRAPH '08, 40:1--40:188. Google ScholarDigital Library
- Kopf, J., Chen, B., Szeliski, R., and Cohen, M. 2010. Street slide: browsing street level imagery. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 96:1--96:8. Google ScholarDigital Library
- Lanfranchi, V., and Ireson, N. 2009. User requirements for a collective intelligence emergency response system. In Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology, British Computer Society, Swinton, UK, UK, BCS-HCI '09, 198--203. Google ScholarDigital Library
- Lippman, A. 1980. Movie-maps: An application of the optical videodisc to computer graphics. SIGGRAPH Comput. Graph. 14 (July), 32--42. Google ScholarDigital Library
- Marvie, J.-E., Gautron, P., Lecocq, P., Mocquard, O., and Gérard, F. 2011. Streaming and synchronization of multi-user worlds through http/1.1. In Proceedings of the 16th International Conference on 3D Web Technology, ACM, New York, NY, USA, Web3D '11, 111--120. Google ScholarDigital Library
- Microsoft, 2007. Photosynth. http://photosynth.net.Google Scholar
- Mouton, C., Sons, K., and Grimstead, I. 2011. Collaborative visualization: current systems and future trends. In Proceedings of the 16th International Conference on 3D Web Technology, ACM, New York, NY, USA, Web3D '11, 101--110. Google ScholarDigital Library
- Palen, L., Hiltz, S. R., and Liu, S. B. 2007. Online forums supporting grassroots participation in emergency preparedness and response. Commun. ACM 50, 3 (Mar.), 54--58. Google ScholarDigital Library
- Pintus, R., Gobbetti, E., and Callieri, M. 2011. Fast low-memory seamless photo blending on massive point clouds using a streaming framework. J. Comput. Cult. Herit. 4, 2 (Nov.), 6:1--6:15. Google ScholarDigital Library
- Pintus, R., Gobbetti, E., and Combet, R. 2011. Fast and robust semi-automatic registration of photographs to 3d geometry. In The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, 9--16. Google ScholarDigital Library
- Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. In ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, SIGGRAPH '06, 835--846. Google ScholarDigital Library
- Snavely, N., Garg, R., Seitz, S. M., and Szeliski, R. 2008. Finding paths through the world's photos. In ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, SIGGRAPH '08, 15:1--15:11. Google ScholarDigital Library
- Torr, P. H. S., and Zisserman, A. 2000. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78, 138--156. Google ScholarDigital Library
- Tuite, K., Snavely, N., Hsiao, D.-y., Tabing, N., and Popovic, Z. 2011. Photocity: training experts at large-scale image acquisition through a competitive game. In Proceedings of the 2011 annual conference on Human factors in computing systems, ACM, New York, NY, USA, CHI '11, 1383--1392. Google ScholarDigital Library
- UN, 2009. United nations population division world urbanization prospects (the 2009 revision).Google Scholar
- Vincent, L. 2007. Taking online maps down to street level. Computer 40 (December), 118--120. Google ScholarDigital Library
- Wan, G., Snavely, N., Cohen-Or, D., Zheng, Q., Chen, B., and Li, S. 2012. Sorting unorganized photo sets for urban reconstruction. Graph. Models 74, 1 (Jan.), 14--28. Google ScholarDigital Library
- Yoon, S., Salomon, B., Gayle, R., and Manocha, D. 2004. Quick-vdr: Interactive view-dependent rendering of massive models. In Visualization, 2004. IEEE, IEEE, 131--138. Google ScholarDigital Library
Index Terms
- 3DNSITE: a networked interactive 3D visualization system to simplify location awareness in crisis management
Recommendations
VEA 2012: Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique
We report on a virtual environment for natural immersive exploration of extremely detailed surface models on multi-projector light field displays, which give multiple, freely moving, naked-eye viewers the illusion of seeing and manipulating 3D objects ...
Beyond: collapsible input device for direct 3D manipulation beyond the screen
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyWhat would it be like to reach into a screen and manipulate or design virtual objects as in real world? We present Beyond, a collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and ...
FOX: the focus sliding surface metaphor for natural exploration of massive models on large-scale light field displays
VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in IndustryWe report on a virtual environment for natural immersive exploration of extremely detailed surface models on light field displays. Our specialized 3D user interface allows casual users to inspect 3D objects at various scales, integrating panning, ...
Comments