Xiaowu Chen
ABSTRACT
We propose a style transformation system to transform a 3D room into one that resembles the style of a photograph. We focus on two major components of interior scene style: layout and color. Using an interior image database, we learn the related style guidelines. Given a reference image and a 3D room of two different interior rooms, we first establish semantic correspondence between the two scenes. The styles of the reference image are then extracted in the form of layout constraints and color schemes. Finally, our framework performs layout rearrangement followed by recoloring of the scene to match the learned style of the reference image. We show style transformation results on numerous examples to demonstrate the effectiveness and efficiency of our system.
- ARTSPARX. http://www.artsparx.com/.Google Scholar
- J. Chen, Y. Han, X. Cao, and Q. Tian. Object coding on the semantic graph for scene classification. In ACM Multimedia, pages 493--496, 2013. Google ScholarDigital Library
- K. Chen, Y.-K. Lai, Y.-X. Wu, R. Martin, and S.-M. Hu. Automatic semantic modeling of indoor scenes from low-quality RGB-D data using contextual information. ACM Trans. Graph., 33(6):208:1--208:12, 2014. Google ScholarDigital Library
- X. Chen, D. Zou, J. Li, X. Cao, Q. Zhao, and H. Zhang. Sparse dictionary learning for edit propagation of high-resolution images. In CVPR, pages 2854--2861, 2014. Google ScholarDigital Library
- X. Chen, D. Zou, Q. Zhao, and P. Tan. Manifold preserving edit propagation. ACM Trans. Graph., 31(6):132:1--7, 2012. Google ScholarDigital Library
- W. Choi, Y.-W. Chao, C. Pantofaru, and S. Savarese. Understanding indoor scenes using 3d geometric phrases. In CVPR, pages 33--40, 2013. Google ScholarDigital Library
- L. Chu, S. Jiang, S. Wang, Y. Zhang, and Q. Huang. Robust spatial consistency graph model for partial duplicate image retrieval. IEEE TMM, 15(8):1982--1996, 2013. Google ScholarDigital Library
- D. Cohen-Or, O. Sorkine, R. Gal, T. Leyvand, and Y.-Q. Xu. Color harmonization. ACM Trans. Graph., 25(3):624--630, 2006. Google ScholarDigital Library
- M. Fisher, D. Ritchie, M. Savva, T. Funkhouser, and P. Hanrahan. Example-based synthesis of 3d object arrangements. ACM Trans. Graph., 31(6):135:1--11, 2012. Google ScholarDigital Library
- M. Fisher, M. Savva, and P. Hanrahan. Characterizing structural relationships in scenes using graph kernels. ACM Trans. Graph., 30(4):34, 2011. Google ScholarDigital Library
- T. Germer and M. Schwarz. Procedural arrangement of furniture for Real-Time walkthroughs. Computer Graphics Forum, 28(8):2068--2078, 2009.Google ScholarCross Ref
- Y. Han, F. Wu, J. Shao, Q. Tian, and Y. Zhuang. Graph-guided sparse reconstruction for region tagging. In CVPR, pages 2981--2988, 2012. Google ScholarDigital Library
- V. Hedau, D. Hoiem, and D. Forsyth. Recovering the spatial layout of cluttered rooms. In ICCV, pages 1849--1856, 2009.Google ScholarCross Ref
- V. Hedau, D. Hoiem, and D. A. Forsyth. Recovering free space of indoor scenes from a single image. In CVPR, pages 2807--2814, 2012. Google ScholarDigital Library
- A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin. Image analogies. In SIGGRAPH, pages 327--340, 2001. Google ScholarDigital Library
- Y. M. Kim, N. J. Mitra, D.-M. Yan, and L. Guibas. Acquiring 3d indoor environments with variability and repetition. ACM Trans. Graph., 31(6):138:1--138:11, 2012. Google ScholarDigital Library
- H. Li, H. Zhang, Y. Wang, J. Cao, A. Shamir, and D. Cohen-or. Curve style analysis in a set of shapes. Computer Graphics Forum, 32(6):77--88, 2013. Google ScholarDigital Library
- Q. Li, X. Chen, Y. Song, Y. Zhang, X. Jin, and Q. Zhao. Geodesic propagation for semantic labeling. IEEE Trans. Image Process., 23(11):4812--4825, 2014.Google ScholarCross Ref
- S. Liu, S. Yan, T. Zhang, C. Xu, J. Liu, and H. Lu. Weakly supervised graph propagation towards collective image parsing. IEEE TMM, 14(2):361--373, 2012. Google ScholarDigital Library
- X. Liu, D. Zhao, J. Zhou, W. Gao, and H. Sun. Image interpolation via graph-based bayesian label propagation. 23(3):1084--1096, 2014. Google ScholarDigital Library
- Y. Matsuda. Color Design. Asakura Shoten, 1995.Google Scholar
- P. Merrell, E. Schkufza, Z. Li, M. Agrawala, and V. Koltun. Interactive furniture layout using interior design guidelines. ACM Trans. Graph., 30(4):87:1--87:10, 2011. Google ScholarDigital Library
- L. Nan, K. Xie, and A. Sharf. A search-classify approach for cluttered indoor scene understanding. ACM Trans. Graph., 31(6):137:1--137:10, 2012. Google ScholarDigital Library
- L. Neumann, A. Nemcsics, and A. Neumann. Computational color harmony based on coloroid system. In Computational Aesthetics, pages 231--240, 2005. Google ScholarDigital Library
- P. O'Donovan, A. Agarwala, and A. Hertzmann. Color compatibility from large datasets. ACM Trans. Graph., 30(4):63:1--63:12, 2011. Google ScholarDigital Library
- E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley. Color transfer between images. IEEE Comput. Graph. Appl., 21(5):34--41, 2001. Google ScholarDigital Library
- S. Roweis and L. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290:2323--2326, 2000.Google ScholarCross Ref
- S. Sanchez, O. L. Roux, H. Luga, and V. Gaildrat. Constraint-based 3d-object layout using a genetic algorithm. In 3IA, 2003.Google Scholar
- T. Shao, W. Xu, K. Zhou, J. Wang, D. Li, and B. Guo. An interactive approach to semantic modeling of indoor scenes with an RGBD camera. ACM Trans. Graph., 31(6):136:1--11, 2012. Google ScholarDigital Library
- L. Wang, Y. Yu, K. Zhou, and B. Guo. Example-based hair geometry synthesis. ACM Trans. Graph., 28(3):56:1--9, 2009. Google ScholarDigital Library
- J. Xiao, T. Fang, P. Zhao, M. Lhuillier, and L. Quan. Image-based street-side city modeling. ACM Trans. Graph., 28(5):114:1--114:12, 2009. Google ScholarDigital Library
- K. Xu, H. Zheng, H. Zhang, D. Cohen-Or, L. Liu, and Y. Xiong. Photo-inspired model-driven 3d object modeling. ACM Trans. Graph., 30(4):80:1--80:10, 2011. Google ScholarDigital Library
- Y.-T. Yeh, L. Yang, M. Watson, N. D. Goodman, and P. Hanrahan. Synthesizing open worlds with constraints using locally annealed reversible jump MCMC. ACM Trans. Graph., 31(4):56, 2012. Google ScholarDigital Library
- L.-F. Yu, S. K. Yeung, C.-K. Tang, D. Terzopoulos, T. F. Chan, and S. Osher. Make it home: automatic optimization of furniture arrangement. ACM Trans. Graph., 30(4):86, 2011. Google ScholarDigital Library
- H. Zhang, J. Xiao, and L. Quan. Supervised label transfer for semantic segmentation of street scenes. In ECCV, pages 561--574, 2010. Google ScholarDigital Library
- B. Zhou, X. Chen, Q. Fu, K. Guo, and P. Tan. Garment modeling from a single image. Computer Graphics Forum, 32(7):85--91, 2013.Google ScholarCross Ref
Index Terms
- Image2Scene: Transforming Style of 3D Room
Recommendations
Automatic natural language style classification and transformation
IRSG'08: Proceedings of the 2008 BCS-IRSG conference on Corpus ProfilingStyle is an integral part of natural language in written, spoken or machine generated forms. Humans have been dealing with style in language since the beginnings of language itself, but computers and machine processes have only recently begun to process ...
Jigsaw puzzles with pieces of unknown orientation
CVPR '12: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)This paper introduces new types of square-piece jigsaw puzzles: those for which the orientation of each jigsaw piece is unknown. We propose a tree-based reassembly that greedily merges components while respecting the geometric constraints of the puzzle ...
Multifocal Projection: A Multiprojector Technique for Increasing Focal Depth
In this paper, we describe a novel multifocal projection concept that applies conventional video projectors and camera feedback. Multiple projectors with differently adjusted focal planes, but overlapping image areas are used. They can be either ...
Comments