Antonius Naumann
ABSTRACT
We outline how to improve common 3D-editing workflows such as modeling or character animation by utilizing an acoustic levitation kit as an interactive 3D display. Our proposed system allows users to directly interact with models in 3D space and perform multi-point gestures to manipulate them. Editing of complex 3D objects can be enabled by combining the 3D display with an LCD, projector or HMD to display additional context.
- Autodesk. 2022. Autodesk Maya. Retrieved July 29, 2022 from https://www.autodesk.com/products/maya/Google Scholar
- Autodesk. 2022. Autodesk TinkerCAD. Retrieved July 29, 2022 from https://www.tinkercad.com/3d-designGoogle Scholar
- Patrick Baudisch. 1996. The Cage: Efficient Construction in 3D Using a Cubic Adaptive Grid. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (Seattle, Washington, USA) (UIST ’96). Association for Computing Machinery, New York, NY, USA, 171–172. https://doi.org/10.1145/237091.237117Google ScholarDigital Library
- Patrick Baudisch and Nathaniel Good. 2002. Focus plus Context Screens: Displays for Users Working with Large Visual Documents. In CHI ’02 Extended Abstracts on Human Factors in Computing Systems (Minneapolis, Minnesota, USA) (CHI EA ’02). Association for Computing Machinery, New York, NY, USA, 492–493. https://doi.org/10.1145/506443.506445Google ScholarDigital Library
- Patrick Baudisch and Nathan Good. 2002. Focus plus Context Screens: Visual Context and Immersion on the Desktop. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (San Antonio, Texas) (SIGGRAPH ’02). Association for Computing Machinery, New York, NY, USA, 70. https://doi.org/10.1145/1242073.1242105Google ScholarDigital Library
- Patrick Baudisch, Nathaniel Good, and Paul Stewart. 2001. Focus plus Context Screens: Combining Display Technology with Visualization Techniques. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 31–40. https://doi.org/10.1145/502348.502354Google ScholarDigital Library
- Hrvoje Benko, Andrew D. Wilson, and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). Association for Computing Machinery, New York, NY, USA, 1263–1272. https://doi.org/10.1145/1124772.1124963Google ScholarDigital Library
- Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 505–514. https://doi.org/10.1145/2501988.2502018Google ScholarDigital Library
- Blender Foundation. 2022. Blender. Retrieved July 29, 2022 from http://www.blender.orgGoogle Scholar
- Google. 2022. Google Blocks. Retrieved July 29, 2022 from https://arvr.google.com/blocks/Google Scholar
- Tovi Grossman and Ravin Balakrishnan. 2006. An Evaluation of Depth Perception on Volumetric Displays. In Proceedings of the Working Conference on Advanced Visual Interfaces (Venezia, Italy) (AVI ’06). Association for Computing Machinery, New York, NY, USA, 193–200. https://doi.org/10.1145/1133265.1133305Google ScholarDigital Library
- Tovi Grossman, Daniel Wigdor, and Ravin Balakrishnan. 2004. Multi-Finger Gestural Interaction with 3d Volumetric Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST ’04). Association for Computing Machinery, New York, NY, USA, 61–70. https://doi.org/10.1145/1029632.1029644Google ScholarDigital Library
- Robert Held, Ankit Gupta, Brian Curless, and Maneesh Agrawala. 2012. 3D Puppetry: A Kinect-Based Interface for 3D Animation. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 423–434. https://doi.org/10.1145/2380116.2380170Google ScholarDigital Library
- Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Sijing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, Alexander Popiak, Thomas Bläsius, and Patrick Baudisch. 2017. TrussFab: Fabricating Sturdy Large-Scale Structures on Desktop 3D Printers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 2606–2616. https://doi.org/10.1145/3025453.3026016Google ScholarDigital Library
- Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: Mid-Air Tangible Interaction Enabled by Computer Controlled Magnetic Levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 327–336. https://doi.org/10.1145/2047196.2047239Google ScholarDigital Library
- Asier Marzo, Steven Kockaya, Euan Freeman, and Julie Williamson. 2019. Tangible Interactions with Acoustic Levitation. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3290607.3313265Google ScholarDigital Library
- Microsoft. 2022. Microsoft HoloLens 2. Retrieved July 29, 2022 from https://www.microsoft.com/de-de/hololensGoogle Scholar
- Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, and Hiroyuki Shinoda. 2014. HaptoMime: Mid-Air Haptic Interaction with a Floating Virtual Screen. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 663–667. https://doi.org/10.1145/2642918.2647407Google ScholarDigital Library
- Rafael Morales, Asier Marzo, Sriram Subramanian, and Diego Martínez. 2019. LeviProps: Animating Levitated Optimized Fabric Structures Using Holographic Acoustic Tweezers. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 651–661. https://doi.org/10.1145/3332165.3347882Google ScholarDigital Library
- Patrick Paczkowski, Julie Dorsey, Holly Rushmeier, and Min H. Kim. 2014. Paper3D: Bringing Casual 3D Modeling to a Multi-Touch Interface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 23–32. https://doi.org/10.1145/2642918.2647416Google ScholarDigital Library
- Diego Martinez Plasencia Ryuji Hirayama, Giorgos Christopoulos and Sriram Subramanian. 2022. High-speed acoustic holography with arbitrary scattering objects. Science Advances 8, 24 (2022). https://doi.org/10.1126/sciadv.abn7614 arXiv:https://www.science.org/doi/pdf/10.1126/sciadv.abn7614Google Scholar
- Nobuyuki Masuda Ryuji Hirayama, Diego Martinez Plasencia and Sriram Subramanian. 2019. A volumetric display for visual, tactile and audio presentation using acoustic trapping.Nature 575(2019), 320–323. Issue 24. https://doi.org/10.1038/s41586-019-1739-5Google Scholar
- Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, and Shahram Izadi. 2015. Accurate, Robust, and Flexible Real-Time Hand Tracking. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3633–3642. https://doi.org/10.1145/2702123.2702179Google ScholarDigital Library
- Ben Shneiderman. 1983. Direct Manipulation: A Step Beyond Programming Languages. Computer 16, 8 (1983), 57–69. https://doi.org/10.1109/MC.1983.1654471Google ScholarDigital Library
- Ben Shneiderman. 1997. Direct Manipulation for Comprehensible, Predictable and Controllable User Interfaces. In Proceedings of the 2nd International Conference on Intelligent User Interfaces(Orlando, Florida, USA) (IUI ’97). Association for Computing Machinery, New York, NY, USA, 33–39. https://doi.org/10.1145/238218.238281Google ScholarDigital Library
- Ultraleap. 2022. Leap Motion Controller Datasheet. Retrieved July 29, 2022 from https://www.ultraleap.com/datasheets/Leap_Motion_Controller_Datasheet.pdfGoogle Scholar
Index Terms
- Improving 3D-Editing Workflows via Acoustic Levitation
Recommendations
Tangible Interactions with Acoustic Levitation
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsAcoustic Levitation can hold millimetric objects in mid-air without any physical contact. This capability has been exploited to create displays since being able to position mid-air physical voxels enables for rich data representations. However, most of ...
Tangible Holographic 3D Objects with Virtual Touch
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & SurfacesThis poster describes the design of a display and interaction device that allows a natural mid-air manipulation and feedback of floating, true 3D objects. This so called virtual touch will create a natural feeling of manipulating and touching of the ...
Floating Widgets: Interaction with Acoustically-Levitated Widgets
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and SpacesAcoustic levitation enables new types of human-computer interface, where the content that users interact with is made up from small objects held in mid-air. We show that acoustically-levitated objects can form mid-air widgets that respond to ...
Comments