ABSTRACT
We present a system for luggage visualization where any object is clearly distinguishable from its neighbors. It supports virtual unpacking by visually moving any object away from its original pose. To achieve these, we first apply a volume segmentation guided by a confidence measure that recursively splits connected regions until semantically meaningful objects are obtained, and a label volume whose voxels specifying the object IDs is generated. The original luggage dataset and the label volume are visualized by volume rendering. Through an automatic coloring algorithm, any pair of objects whose projections are adjacent in an image are assigned distinct hues that are modulated onto a transfer function to both reduce rendering cost as well as to improve the smoothness across object boundaries. We have designed a layered framework to efficiently render a scene mixed with packed luggage, animated unpacking objects, and already unpacked objects put aside for further inspection. The system uses GPU to quickly select unpackable objects that are not blocked by others to make the unpacking plausible.
Supplemental Material
- Beyer, J., Hadwiger, M., Wolfsberger, S., and Bhler, K., 2007. High-quality multimodal volume rendering for preoperative planning of neurosurgical interventions.Google Scholar
- Bruckner, S., and Gröller, M. E. 2005. Volumeshop: An interactive system for direct volume illustration. In Visualization, H. R. C. T. Silva, E. Gröller, Ed., 671--678.Google ScholarDigital Library
- Bruckner, S., and Gröller, M. E. 2006. Exploded views for volume data. IEEE Transactions on Visualization and Computer Graphics 12, 5 (9), 1077--1084. Google ScholarDigital Library
- Callahan, S., Comba, J., Shirley, P., and Silva, C. 2005. Interactive rendering of large unstructured grids using dynamic level-of-detail. In IEEE Visualization, 199--206.Google Scholar
- Chan, M.-Y., Wu, Y., Mak, W.-H., Chen, W., and Qu, H. 2009. Perception-based transparency optimization for direct volume rendering. IEEE Transactions on Visualization and Computer Graphics 15, 6 (November), 1283--1290. Google ScholarDigital Library
- Everitt, C. 2001. Interactive order-independent transparency. NVIDIA white paper.Google Scholar
- Govindaraju, N. K., Redon, S., Lin, M. C., and Manocha, D. 2003. Cullide: interactive collision detection between complex models in large environments using graphics hardware. In Graphics hardware, 25--32. Google ScholarDigital Library
- Govindaraju, N. K., Henson, M., Lin, M. C., and Manocha, D. 2005. Interactive visibility ordering and transparency computations among geometric primitives in complex environments. In Interactive 3D Graphics and Games, 49--56. Google ScholarDigital Library
- Grady, L., and Alvino, C. The piecewise smooth mumford-shah function on an arbitrary graph. IEEE Transactions on Image Processing 18, 11, 2547--2561. Google ScholarDigital Library
- Grady, L., and Schwartz, E. L. 2006. Isoperimetric graph partitioning for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 3 (March), 469--475. Google ScholarDigital Library
- Grady, L., Singh, V., Kohlberger, T., Alvino, C., and Bahlmann, C. 2012. Automatic segmentation of unknown objects, with application to baggage security. In European Conference on Computer Vision (ECCV). Google ScholarDigital Library
- Grimm, S., Bruckner, S., Kanitsar, A., and Gröller, M. E., 2004. Flexible direct multi-volume rendering in interactive scenes, Oct.Google Scholar
- Hadwiger, M., Berger, C., and Hauser, H. 2003. High-quality two-level volume rendering of segmented data sets on consumer graphics hardware. Visualization, 301--308.Google Scholar
- Kainz, B., Grabner, M., Bornik, A., Hauswiesner, S., Muehl, J., and Schmalstieg, D. 2009. Ray casting of multiple volumetric datasets with polyhedral boundaries on many-core gpus. In ACM SIGGRAPH Asia, 152:1--152:9. Google ScholarDigital Library
- Li, W., Agrawala, M., Curless, B., and Salesin, D. 2008. Automated generation of interactive 3d exploded view diagrams. In ACM SIGGRAPH, 101:1--101:7. Google ScholarDigital Library
- Li, W. 2010. Multi-layer volume ray casting on gpu. In Volume Graphics, 5--12. Google ScholarDigital Library
- Nagy, Z., and Klein, R. 2003. Depth-peeling for texture-based volume rendering. In Pacific Graphics, 429. Google ScholarDigital Library
- Zhou, J., and Takatsuka, M. 2009. Automatic transfer function generation using contour tree controlled residue flow model and color harmonics. IEEE Transactions on Visualization and Computer Graphics 15, 6 (November), 1481--1488. Google ScholarDigital Library
Index Terms
- Luggage visualization and virtual unpacking
Recommendations
Application of virtual reality in volumetric cellular visualization
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industryRecent advancement in high-resolution confocal imaging has provided valuable novel insights into structural relationships within cells and tissues in vitro and in vivo. Development in volume rendering technique enables visualization of 3D dataset in ...
Multi-Modal Image Processing and Visualization: Application to PET-CT
CGI '16: Proceedings of the 33rd Computer Graphics InternationalMulti-modality medical imaging, such as positron emission tomography and computed tomography (PET-CT) depicts biological and physiological functions (from PET) within a higher resolution anatomical reference frame (from CT). Although it may seem counter-...
An immersive virtual environment for DT-MRI volume visualization applications: a case study
VIS '01: Proceedings of the conference on Visualization '01We describe a virtual reality environment for visualizing tensor-valued volumetric datasets acquired with diffusion tensor magnetic resonance imaging (DT-MRI). We have prototyped a virtual environment that displays geometric representations of the ...
Comments