Manfred Lau
Takeo Igarashi
ABSTRACT
Existing 3D sketching methods typically allow the user to draw in empty space which is imprecise and lacks tactile feedback. We introduce a shape-stamping interface where users can model with tangible 3D primitive shapes. Each of these shapes represents a copy or a fragment of the construction material. Instead of modeling in empty space, these shapes allow us to use the real-world environment and other existing objects as a tangible guide during 3D modeling. We call this approach Situated Modeling: users can create new real-sized 3D objects directly in 3D space while using the nearby existing objects as the ultimate reference. We also describe a two-handed shape-stamping technique for stamping with tactile feedback. We show a variety of doit-yourself furniture and household products designed with our system, and perform a user study to compare our method with a related AR-based modeling system.
Supplemental Material
- M. Agrawala, D. Phan, J. Heiser, J. Haymaker, J. Klingner, P. Hanrahan, and B. Tversky. Designing effective step-by-step assembly instructions. ACM Transactions on Graphics, 22(3):828--837, 2003. Google Scholar
Digital Library
- D. Anderson, J. L. Frankel, J. Marks, A. Agarwala, P. Beardsley, J. Hodgins, D. Leigh, K. Ryall, E. Sullivan, and J. S. Yedidia. Tangible interaction + graphical interpretation: a new approach to 3d modeling. In ACM Transactions on Graphics, pages 393--402, 2000. Google ScholarDigital Library
- R. Balakrishnan, G. Fitzmaurice, G. Kurtenbach, and W. Buxton. Digital tape drawing. In ACM UIST, pages 161--169, 1999. Google ScholarDigital Library
- P. Baudisch, T. Becker, and F. Rudeck. Lumino: tangible blocks for tabletop computers based on glass fiber bundles. In ACM CHI, pages 1165--1174, 2010. Google ScholarDigital Library
- J. Butterworth, A. Davidson, S. Hench, and M. T. Olano. 3DM: A three dimensional modeler using a head-mounted display. In ACM Symposium on Interactive 3D graphics (I3D), pages 135--138, 1992. Google ScholarDigital Library
- M. F. Deering. HoloSketch: A virtual reality sketching/animation tool. ACM Transactions on Computer-Human Interaction, 2(3):220--238, 1995. Google ScholarDigital Library
- M. Fiorentino, R. de Amicis, G. Monno, and A. Stork. Spacedesign: A mixed reality workspace for aesthetic industrial design. IEEE International Symposium on Mixed and Augmented Reality, pages 86--94, 2002. Google ScholarDigital Library
- FRONT. Sketch furniture, 2006. www.designfront.org.Google Scholar
- M. Gross. Now more than ever: computational thinking and a science of design. Japan Society for the Science of Design, 16(2):50--54, 2007.Google Scholar
- T. Grossman, R. Balakrishnan, G. Kurtenbach, G. Fitzmaurice, A. Khan, and B. Buxton. Creating principal 3d curves with digital tape drawing. In ACM CHI, pages 121--128, 2002. Google ScholarDigital Library
- T. Grossman, R. Balakrishnan, and K. Singh. An interface for creating and manipulating curves using a high degree-of-freedom curve input device. In ACM CHI, pages 185--192, 2003. Google ScholarDigital Library
- K. Hinckley, R. Pausch, D. Proffitt, and N. Kassell. Two-handed virtual manipulation. In ACM Transactions on CHI, pages 260--302, 1998. Google ScholarDigital Library
- J. Landay. Design tools for the rest of us. Communications of the ACM, 52(12):80, 2009. Google ScholarDigital Library
- M. Lau, A. Ohgawara, J. Mitani, and T. Igarashi. Converting 3d furniture models to fabricatable parts and connectors. ACM Transactions on Graphics, 30(4):85, 2011. Google ScholarDigital Library
- M. Lau, G. Saul, J. Mitani, and T. Igarashi. Modeling-in-context: User design of complementary objects with a single photo. In ACM Sketch-Based Interfaces and Modeling, pages 17--24, 2010. Google ScholarDigital Library
- H. Lee, M. Billinghurst, and W. Woo. Two-handed tangible interaction techniques for composing augmented blocks. Virtual Reality, 15:133--146, 2010. Google ScholarDigital Library
- Y. Mori and T. Igarashi. Plushie: an interactive design system for plush toys. ACM Transactions on Graphics, 26(3):45, 2007. Google ScholarDigital Library
- M. Otsuki, K. Sugihara, A. Kimura, F. Shibata, and H. Tamura. Mai painting brush: an interactive device that realizes the feeling of real painting. In ACM UIST, pages 97--100, 2010. Google ScholarDigital Library
- J. Y. Park and J. W. Lee. Tangible augmented reality modeling. In International Conference Entertainment Computing, pages 254--259, 2004.Google ScholarCross Ref
- J. S. Pierce, B. C. Stearns, and R. Pausch. Voodoo dolls: seamless interaction at multiple scales in virtual environments. In ACM I3D, pages 141--145, 1999. Google ScholarDigital Library
- E. Sachs, A. Roberts, and D. Stoops. 3-Draw: A tool for designing 3d shapes. IEEE CG&A, 11(6):18--26, 1991. Google ScholarDigital Library
- G. Saul, M. Lau, J. Mitani, and T. Igarashi. SketchChair: An all-in-one chair design system for end-users. TEI, pages 73--80, 2011. Google ScholarDigital Library
- S. Schkolne, M. Pruett, and P. Schröder. Surface Drawing: Creating organic 3d shapes with the hand and tangible tools. In ACM CHI, pages 261--268, 2001. Google ScholarDigital Library
- Y. Takami, M. Otsuki, A. Kimura, F. Shibata, and H. Tamura. Daichi's artworking: enjoyable painting and handcrafting with new tool devices. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation, pages 64--65, 2009. Google ScholarDigital Library
- T. Thormahlen and H.-P. Seidel. 3D-modeling by ortho-image generation from image sequences. ACM Transactions on Graphics, 27(3):86, 2008. Google ScholarDigital Library
- S. Tsang, R. Balakrishnan, K. Singh, and A. Ranjan. A suggestive interface for image guided 3d sketching. In ACM CHI, pages 591--598, 2004. Google ScholarDigital Library
- M. P. Weller, M. D. Gross, and E. Y.-L. Do. Tangible sketching in 3d with posey. In ACM CHI extended abstracts, pages 3193--3198, 2009. Google ScholarDigital Library
- K. D. Willis, J. Lin, J. Mitani, and T. Igarashi. Spatial Sketch: Bridging between movement and fabrication. In TEI, pages 5--12, 2010. Google ScholarDigital Library
- B. Yee, Y. Ning, and H. Lipson. Augmented reality in-situ 3D sketching of physical objects. In Intelligent UI Workshop on Sketch Recognition, 2009.Google Scholar
Index Terms
- Situated modeling: a shape-stamping interface with tangible primitives
Recommendations
DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays
ISS '19: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and SpacesWe present DesignAR, an augmented design workstation for creating 3D models. Our approach seamlessly integrates an interactive surface displaying 2D views with head-mounted, stereoscopic Augmented Reality (AR). This creates a combined output space that ...
Incorporating Kinesthetic Creativity and Gestural Play into Immersive Modeling
MOCO '17: Proceedings of the 4th International Conference on Movement ComputingThe 3D modeling methods and approach presented in this paper attempt to bring the richness and spontaneity of human kinesthetic interaction in the physical world to the process of shaping digital form, by exploring playfully creative interaction ...
Augmented Displays: Seamlessly Extending Interactive Surfaces With Head-Mounted Augmented Reality
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsWe present Augmented Displays, a new class of display systems combining high-resolution interactive surfaces with head-coupled Augmented Reality. This extends the screen estate beyond the display and enables placing AR content directly at the display's ...
Comments