Karran Pandey
Fanny Chevalier
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We present juxtaform, a novel approach to the interactive summarization of large shape collections for conceptual shape design. We conduct a formative study to ascertain design goals for creative shape exploration tools. Motivated by a mathematical formulation of these design goals, juxtaform integrates the exploration, analysis, selection, and refinement of large shape collections to support an interactive divergence-convergence shape design workflow. We exploit sparse, segmented sketch-stroke visual abstractions of shape and a novel visual summarization algorithm to balance the needs of shape understanding, in-situ shape juxtaposition, and visual clutter. Our evaluation is three-fold: we show that existing shape and stroke clustering algorithms do not address our design goals compared to our proposed shape corpus summarization algorithm; we compare juxtaform against a structured image gallery interface for various shape design and analysis tasks; and we present multiple compelling 2D/3D applications using juxtaform.
Supplemental Material
Available for Download
zip
papers_698-supplemental.zip (132.6 MB)
supplemental material
- Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Colburn, Brian Curless, David Salesin, and Michael Cohen. 2004. Interactive digital photomontage. In ACM SIGGRAPH 2004 Papers. 294--302.Google Scholar
Digital Library
- Andrés Arias-Rosales. 2022. The perceived value of human-AI collaboration in early shape exploration: An exploratory assessment. PloS one 17, 9 (2022), e0274496.Google ScholarCross Ref
- Rahul Arora, Ishan Darolia, Vinay P Namboodiri, Karan Singh, and Adrien Bousseau. 2017. Sketchsoup: Exploratory ideation using design sketches. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 302--312.Google Scholar
- Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. Symbiosissketch: Combining 2d & 3d sketching for designing detailed 3d objects in situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--15.Google ScholarDigital Library
- Jackie Assa, Yaron Caspi, and Daniel Cohen-Or. 2005. Action synopsis: pose selection and illustration. ACM Transactions on Graphics (TOG) 24, 3 (2005), 667--676.Google ScholarDigital Library
- Melinos Averkiou, Vladimir G Kim, Youyi Zheng, and Niloy J Mitra. 2014. Shapesynth: Parameterizing model collections for coupled shape exploration and synthesis. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 125--134.Google Scholar
- Pierre Bénard and Aaron Hertzmann. 2019. Line Drawings from 3D Models: A Tutorial. Found. Trends. Comput. Graph. Vis. 11, 1--2 (sep 2019), 1--159. Google ScholarDigital Library
- Silvia Biasotti, Andrea Cerri, Alex Bronstein, and Michael Bronstein. 2016a. Recent trends, applications, and perspectives in 3d shape similarity assessment. In Computer graphics forum, Vol. 35. Wiley Online Library, 87--119.Google Scholar
- Silvia Biasotti, Bianca Falcidieno, Daniela Giorgi, and Michela Spagnuolo. 2016b. 3D Objects Exploration: Guidelines for Future Research.. In 3DOR@ Eurographics.Google Scholar
- Silvia Biasotti, Elia Moscoso Thompson, and Michela Spagnuolo. 2019. Context-adaptive navigation of 3D model collections. Computers & Graphics 79 (2019), 1--13.Google ScholarDigital Library
- Umberto Castellani and Adrien Bartoli. 2020. 3d shape registration. In 3D Imaging, Analysis and Applications. Springer, 353--411.Google Scholar
- Tony F Chan and Luminita A Vese. 2001. Active contours without edges. IEEE Transactions on image processing 10, 2 (2001), 266--277.Google ScholarDigital Library
- Andy Cockburn, Amy Karlson, and Benjamin B Bederson. 2009. A review of overview+ detail, zooming, and focus+ context interfaces. ACM Computing Surveys (CSUR) 41, 1 (2009), 1--31.Google ScholarDigital Library
- Daniel Cohen-Or and Hao Zhang. 2016. From Inspired Modeling to Creative Modeling. Vis. Comput. 32, 1 (jan 2016), 7--14. Google ScholarDigital Library
- Noa Fish, Melinos Averkiou, Oliver Van Kaick, Olga Sorkine-Hornung, Daniel Cohen-Or, and Niloy J Mitra. 2014. Meta-representation of shape families. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--11.Google ScholarDigital Library
- Jun Gao, Tianchang Shen, Zian Wang, Wenzheng Chen, Kangxue Yin, Daiqing Li, Or Litany, Zan Gojcic, and Sanja Fidler. 2022. GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images. In Advances In Neural Information Processing Systems.Google Scholar
- Lin Gao, Yan-Pei Cao, Yu-Kun Lai, Hao-Zhi Huang, Leif Kobbelt, and Shi-Min Hu. 2014. Active exploration of large 3d model repositories. IEEE transactions on visualization and computer graphics 21, 12 (2014), 1390--1402.Google Scholar
- Yunhao Ge, Sami Abu-El-Haija, Gan Xin, and Laurent Itti. 2021. Zero-shot Synthesis with Group-Supervised Learning. In International Conference on Learning Representations. https://openreview.net/forum?id=8wqCDnBmnrTGoogle Scholar
- Stéphane Grabli, Frédo Durand, and Francois X Sillion. 2004. Density measure for line-drawing simplification. In 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings. IEEE, 309--318.Google ScholarCross Ref
- Yulia Gryaditskaya, Felix Hähnlein, Chenxi Liu, Alla Sheffer, and Adrien Bousseau. 2020. Lifting freehand concept sketches into 3D. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--16.Google ScholarDigital Library
- Felix Hähnlein, Changjian Li, Niloy J Mitra, and Adrien Bousseau. 2022. CAD2Sketch: Generating Concept Sketches from CAD Sequences. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1--18.Google ScholarDigital Library
- Almoctar Hassoumi, María Jesús Lobo, Gabriel Jarry, Vsevolod Peysakhovich, and Christophe Hurter. 2019. Interactive shape based brushing technique for trail sets. (2019).Google Scholar
- James W Hennessey, Han Liu, Holger Winnemöller, Mira Dontcheva, and Niloy J Mitra. 2016. How2Sketch: generating easy-to-follow tutorials for sketching 3D objects. arXiv preprint arXiv:1607.07980 (2016).Google Scholar
- Josh Holinaty, Alec Jacobson, and Fanny Chevalier. 2021. Supporting Reference Imagery for Digital Drawing. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 2434--2442.Google ScholarCross Ref
- Min Hua. 2019. The roles of sketching in supporting creative design. The Design Journal 22, 6 (2019), 895--904.Google ScholarCross Ref
- Ruqi Huang, Panos Achlioptas, Leonidas Guibas, and Maks Ovsjanikov. 2019. Limit Shapes - A Tool for Understanding Shape Differences and Variability in 3D Model Collections. SGP (2019).Google Scholar
- Shi-Sheng Huang, Ariel Shamir, Chao-Hui Shen, Hao Zhang, Alla Sheffer, Shi-Min Hu, and Daniel Cohen-Or. 2013. Qualitative organization of collections of shapes via quartet analysis. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1--10.Google ScholarDigital Library
- Moos Hueting, Maks Ovsjanikov, and Niloy J Mitra. 2015. CrossLink: joint understanding of image and 3D model collections through shape and camera pose variations. ACM Transactions on Graphics (ToG) 34, 6 (2015), 1--13.Google ScholarDigital Library
- Arjun Jain, Thorsten Thormählen, Tobias Ritschel, and Hans-Peter Seidel. 2012. Exploring shape variations by 3d-model decomposition and part-based recombination. In Computer Graphics Forum, Vol. 31. Wiley Online Library, 631--640.Google Scholar
- Waqas Javed and Niklas Elmqvist. 2012. Exploring the design space of composite visualization. In 2012 ieee pacific visualization symposium. IEEE, 1--8.Google Scholar
- Vladimir G Kim, Wilmot Li, Niloy J Mitra, Stephen DiVerdi, and Thomas Funkhouser. 2012. Exploring collections of 3d models using fuzzy correspondences. ACM Transactions on Graphics (TOG) 31, 4 (2012), 1--11.Google ScholarDigital Library
- Yanir Kleiman, Noa Fish, Joel Lanir, and Daniel Cohen-Or. 2013. Dynamic maps for exploring and browsing shapes. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 187--196.Google Scholar
- Heidi Lam and Tamara Munzner. 2010. A guide to visual multi-level interface design from synthesis of empirical study evidence. Synthesis Lectures on Visualization 1, 1 (2010), 1--117.Google ScholarCross Ref
- Yong Jae Lee, C Lawrence Zitnick, and Michael F Cohen. 2011. Shadowdraw: real-time user guidance for freehand drawing. ACM Transactions on Graphics (TOG) 30, 4 (2011), 1--10.Google ScholarDigital Library
- You-En Lin, Yong-Liang Yang, and Hung-Kuo Chu. 2018. Scale-aware black-and-white abstraction of 3D shapes. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--11.Google ScholarDigital Library
- Chenxi Liu, Enrique Rosales, and Alla Sheffer. 2018. Strokeaggregator: Consolidating raw sketches into artist-intended curve drawings. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--15.Google ScholarDigital Library
- Y-C Liu, Amaresh Chakrabarti, and T Bligh. 2003. Towards an 'ideal'approach for concept generation. Design studies 24, 4 (2003), 341--355.Google Scholar
- Zhen-Bao Liu, Shu-Hui Bu, Kun Zhou, Shu-Ming Gao, Jun-Wei Han, and Jun Wu. 2013. A survey on partial retrieval of 3D shapes. Journal of Computer Science and Technology 28, 5 (2013), 836--851.Google ScholarCross Ref
- Justin Matejka, Michael Glueck, Erin Bradner, Ali Hashemi, Tovi Grossman, and George Fitzmaurice. 2018. Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--12. Google ScholarDigital Library
- Harry A Nichols. 1954. DESIGN FEATURES OF THE DOUGLAS A3D SKYWARRIOR. Technical Report. SAE Technical Paper.Google Scholar
- Jamie R. Nuñez, Christopher R. Anderton, and Ryan S. Renslow. 2018. Optimizing colormaps with consideration for color vision deficiency to enable accurate interpretation of scientific data. PLOS ONE 13, 7 (08 2018), 1--14.Google Scholar
- Luke Olsen, Faramarz F Samavati, Mario Costa Sousa, and Joaquim A Jorge. 2009. Sketch-based modeling: A survey. Computers & Graphics 33, 1 (2009), 85--103.Google ScholarDigital Library
- Günay Orbay, Mehmet Ersin Yümer, and Levent Burak Kara. 2012. Sketch-based aesthetic product form exploration from existing images using piecewise clothoid curves. Journal of Visual Languages & Computing 23, 6 (2012), 327--339.Google ScholarDigital Library
- Maks Ovsjanikov, Wilmot Li, Leonidas Guibas, and Niloy J Mitra. 2011. Exploration of continuous variability in collections of 3d shapes. ACM Transactions on Graphics (TOG) 30, 4 (2011), 1--10.Google ScholarDigital Library
- Patrick Paczkowski, Min H Kim, Yann Morvan, Julie Dorsey, Holly E Rushmeier, and Carol O'Sullivan. 2011. Insitu: sketching architectural designs in context. ACM Trans. Graph. 30, 6 (2011), 182.Google ScholarDigital Library
- Mark Pauly, Niloy J Mitra, Johannes Wallner, Helmut Pottmann, and Leonidas J Guibas. 2008. Discovering structural regularity in 3D geometry. In ACM SIGGRAPH 2008 papers. 1--11.Google ScholarDigital Library
- Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. the Journal of machine Learning research 12 (2011), 2825--2830.Google Scholar
- Miquel Prats. 2007. Shape exploration in product design: assisting transformation in pictorial representations. Open University (United Kingdom).Google Scholar
- Miquel Prats and Chris F Earl. 2006. Exploration through drawings in the conceptual stage of product design. In Design Computing and Cognition'06. Springer, 83--102.Google Scholar
- Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2021. High-Resolution Image Synthesis with Latent Diffusion Models. arXiv:2112.10752 [cs.CV]Google Scholar
- Ryan M. Schmidt and Karan Singh. 2010. meshmixer: an interface for rapid mesh composition.. In SIGGRAPH Talks, James L. Mohler (Ed.). ACM. http://dblp.unitrier.de/db/conf/siggraph/siggraph2010talks.html#SchmidtS10Google Scholar
- Donald A Schon and Glenn Wiggins. 1992. Kinds of seeing and their functions in designing. Design studies 13, 2 (1992), 135--156.Google Scholar
- Adriana Schulz, Ariel Shamir, Ilya Baran, David IW Levin, Pitchaya Sitthi-Amorn, and Wojciech Matusik. 2017. Retrieval on parametric shape collections. ACM Transactions on Graphics (TOG) 36, 1 (2017), 1--14.Google ScholarDigital Library
- Ben Shneiderman. 1999. User interfaces for creativity support tools. In Proceedings of the 3rd conference on Creativity & cognition. 15--22.Google ScholarDigital Library
- Tim Smithers. 2001. Is sketching an aid to memory or a kind of thinking? (2001).Google Scholar
- Johan WH Tangelder and Remco C Veltkamp. 2008. A survey of content based 3D shape retrieval methods. Multimedia tools and applications 39, 3 (2008), 441--471.Google Scholar
- Erdogan Taskesen. 2021. Python package clustimage is for unsupervised clustering of images. https://erdogant.github.io/clustimageGoogle Scholar
- James T Todd. 2004. The visual perception of 3D shape. Trends in cognitive sciences 8, 3 (2004), 115--121.Google Scholar
- Steve Tsang, Ravin Balakrishnan, Karan Singh, and Abhishek Ranjan. 2004. A Suggestive Interface for Image Guided 3D Sketching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI '04). Association for Computing Machinery, New York, NY, USA, 591--598. Google ScholarDigital Library
- Oliver Van Kaick, Hao Zhang, Ghassan Hamarneh, and Daniel Cohen-Or. 2011. A survey on shape correspondence. In Computer graphics forum, Vol. 30. Wiley Online Library, 1681--1707.Google Scholar
- Dave Pagurek Van Mossel, Chenxi Liu, Nicholas Vining, Mikhail Bessmeltsev, and Alla Sheffer. 2021. StrokeStrip: joint parameterization and fitting of stroke clusters. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1--18.Google ScholarDigital Library
- Remco C Veltkamp. 2001. Shape matching: Similarity measures and algorithms. In Proceedings International Conference on Shape Modeling and Applications. IEEE, 188--197.Google ScholarCross Ref
- Aaron Wolin, Brian Eoff, and Tracy Hammond. 2008. ShortStraw: A Simple and Effective Corner Finder for Polylines. SBIM 8 (2008), 33--40.Google Scholar
- Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015. 3d shapenets: A deep representation for volumetric shapes. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1912--1920.Google Scholar
- Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014a. True2Form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics 33, 4 (2014).Google ScholarDigital Library
- Kai Xu, Rui Ma, Hao Zhang, Chenyang Zhu, Ariel Shamir, Daniel Cohen-Or, and Hui Huang. 2014b. Organizing heterogeneous scene collections through contextual focal points. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--12.Google ScholarDigital Library
- Kai Xu, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2012. Fit and diverse: Set evolution for inspiring 3d shape galleries. ACM Transactions on Graphics (TOG) 31, 4 (2012), 1--10.Google ScholarDigital Library
- Chuan Yan, David Vanderhaeghe, and Yotam Gingold. 2020. A benchmark for rough sketch cleanup. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--14.Google ScholarDigital Library
- Hui Ye, Kin Chung Kwan, and Hongbo Fu. 2021. 3D curve creation on and around physical objects with mobile AR. IEEE transactions on visualization and computer graphics 28, 8 (2021), 2809--2821.Google Scholar
- Jun-Yan Zhu, Yong Jae Lee, and Alexei A Efros. 2014. Averageexplorer: Interactive exploration and alignment of visual data collections. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--11.Google ScholarDigital Library
Index Terms
- Juxtaform: interactive visual summarization for exploratory shape design
Recommendations
Geometric modeling in shape space
SIGGRAPH '07: ACM SIGGRAPH 2007 papersWe present a novel framework to treat shapes in the setting of Riemannian geometry. Shapes -- triangular meshes or more generally straight line graphs in Euclidean space -- are treated as points in a shape space. We introduce useful Riemannian metrics ...
Geometric modeling in shape space
We present a novel framework to treat shapes in the setting of Riemannian geometry. Shapes -- triangular meshes or more generally straight line graphs in Euclidean space -- are treated as points in a shape space. We introduce useful Riemannian metrics ...
Interactive shape design using volumetric implicit PDEs
SM '03: Proceedings of the eighth ACM symposium on Solid modeling and applicationsSolid modeling based on Partial Differential Equations (PDEs) can potentially unify both geometric constraints and functional requirements within a single design framework to model real-world objects via its explicit, direct integration with parametric ...
Comments