skip to main content
10.1145/1832838.1832847acmotherconferencesArticle/Chapter ViewAbstractPublication PageschinzConference Proceedingsconference-collections
research-article

Interaction with 3D models on large displays using 3D input techniques

Published: 08 July 2010 Publication History

Abstract

Almost all existing 3D modeling applications rely on 2D input techniques for creating and modifying 3D models by users. This translation of user inputs from a 2D plane into actions in a 3D world often causes problems for modelers when moving, placing, rotating and transforming 3D objects. Although several 3D input techniques have been developed in the past, these have generally relied on expensive technology such as haptic or immersive devices. In this paper we investigate the possibility of using affordable devices, including the Nintendo Wii Controller (Wiimote) and conventional webcams, as means of interacting with 3D models on large displays. A pilot user study of these techniques has also been carried out, and the results are presented here.

References

[1]
ARToolKit. 2010. http://www.hitl.washington.edu/artoolkit/, visited in April 2010.
[2]
ARToolKitPlus. 2010. http://studierstube.icg.tu-graz.ac.at/handheld_ar/artoolkitplus.php, visited in April 2010.
[3]
Autodesk. 2010. http://usa.autodesk.com/, visited in April 2010.
[4]
Baudisch, P., Sinclair, M., and Wilson, A. 2007. Soap: a pointing and gaming device for the living room and anywhere else. In ACM SIGGRAPH 2007 Emerging Technologies (San Diego, California, August 05--09, 2007). SIGGRAPH '07. ACM, New York, NY, 17. DOI= http://doi.acm.org/10.1145/1278280.1278298
[5]
Butterworth, J., Davidson, A., Hench, S., and Olano, M. T. 1992. 3DM: a three dimensional modeler using a head-mounted display. In Proceedings of the 1992 Symposium on interactive 3D Graphics (Cambridge, Massachusetts, United States). I3D '92. ACM, New York, NY, 135--138. DOI= http://doi.acm.org/10.1145/147156.147182
[6]
Buxton, B. 2007. Sketching User Experiences. San Francisco, USA: Morgan Kaufmann.
[7]
Cook, M. T. and Agah, A. 2009. A survey of sketch-based 3D modeling techniques. Interact. Comput. 21, 3 (Jul. 2009), 201--211. DOI= http://dx.doi.org/10.1016/j.intcom.2009.05.004
[8]
Dhawale, P., Masoodian, M., and Rogers, B. 2006. Barehand 3D gesture input to interactive systems. In Proceedings of the 7th ACM SIGCHI New Zealand Chapter's international Conference on Computer-Human interaction: Design Centered HCI (Christchurch, New Zealand, July 06--07, 2006). CHINZ '06, vol. 158. ACM, New York, NY, 25--32. DOI= http://doi.acm.org/10.1145/1152760.1152764
[9]
Duval, T. and Fleury, C. 2009. An asymmetric 2D Pointer/3D Ray for 3D interaction within collaborative virtual environments. In Proceedings of the 14th international Conference on 3D Web Technology (Darmstadt, Germany, June 16--17, 2009). S. N. Spencer, Ed. Web3D '09. ACM, New York, NY, 33--41. DOI= http://doi.acm.org/10.1145/1559764.1559769
[10]
Gallo, L., De Pietro, G., Coronato, A., and Marra, I. 2008. Toward a natural interface to virtual medical imaging environments. In Proceedings of the Working Conference on Advanced Visual interfaces (Napoli, Italy, May 28--30, 2008). AVI '08. ACM, New York, NY, 429--432. DOI= http://doi.acm.org/10.1145/1385569.1385651
[11]
Han, S. and Medioni, G. 1997. 3DSketch: modeling by digitizing with a smart 3D pen. In Proceedings of the Fifth ACM international Conference on Multimedia (Seattle, Washington, United States, November 09--13, 1997). MULTIMEDIA '97. ACM, New York, NY, 41--49. DOI= http://doi.acm.org/10.1145/266180.266331
[12]
Jota, R., Pereira, J. M., and Jorge, J. A. 2009. A comparative study of interaction metaphors for large-scale displays. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04--09, 2009). CHI '09. ACM, New York, NY, 4135--4140. DOI= http://doi.acm.org/10.1145/1520340.1520629
[13]
Lee, J. C. 2010. Tracking your fingers with the Wiimote. http://johnnylee.net/projects/wii/, visited in April 2010.
[14]
Malik, S., Ranjan, A., and Balakrishnan, R. 2005. Interacting with large displays from a distance with vision-tracked multifinger gestural input. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23--26, 2005). UIST '05. ACM, New York, NY, 43--52. DOI= http://doi.acm.org/10.1145/1095034.1095042
[15]
Masoodian, M., McKoy, S., and Rogers, B. 2007. Hands-on sharing: collaborative document manipulation on a tabletop display using bare hands. In Proceedings of the 7th ACM SIGCHI New Zealand Chapter's international Conference on Computer-Human interaction: Design Centered HCI (Hamilton, New Zealand, July 02--04, 2007). CHINZ '07, vol. 254. ACM, New York, NY, 25--31. DOI= http://doi.acm.org/10.1145/1278960.1278964
[16]
Ng, J., Sim, T., Foo, Y., and Yeo, V. 2009. Gesture-based interaction with virtual 3D objects on large display: what makes it fun?. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04--09, 2009). CHI '09. ACM, New York, NY, 3751--3756. DOI= http://doi.acm.org/10.1145/1520340.1520566
[17]
Nintendo Ltd. 2010. http://www.nintendo.com/wii, visited in April 2010.
[18]
Owada, S., Nielsen, F., Nakazawa, K., and Igarashi, T. 2003. A sketching interface for modeling the internal structures of 3D shapes. In Proceedings of the 3rd international Conference on Smart Graphics (Heidelberg, Germany, July 02--04, 2003). A. Butz, A. Krüger, and P. Olivier, Eds. Lecture Notes In Computer Science. Springer-Verlag, Berlin, Heidelberg, 49--57.
[19]
Peek, B. 2007. Coding4Fun: Managed Library for Nintendo's Wiimote. http://blogs.msdn.com/coding4fun/archive/2007/03/14/1879033.aspx, visited in April 2010.
[20]
Pelling, C., Sko, T., and Gardner, H. J. 2009. Be careful how you point that thing: Wiimote aiming for large displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human interaction Special interest Group: Design: Open 24/7 (Melbourne, Australia, November 23--27, 2009). OZCHI '09, vol. 411. ACM, New York, NY, 397--400. DOI= http://doi.acm.org/10.1145/1738826.1738908
[21]
Schlömer, T., Poppinga, B., Henze, N., and Boll, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18--20, 2008). TEI '08. ACM, New York, NY, 11--14. DOI= http://doi.acm.org/10.1145/1347390.1347395
[22]
Shoemaker, G., Findlater, L., Dawson, J. Q., and Booth, K. S. 2009. Mid-air text input techniques for very large wall displays. In Proceedings of Graphics interface 2009 (Kelowna, British Columbia, Canada, May 25--27, 2009). ACM International Conference Proceeding Series, vol. 324. Canadian Information Processing Society, Toronto, Ont., Canada, 231--238.
[23]
Shoemaker, G., Tang, A., and Booth, K. S. 2007. Shadow reaching: a new perspective on interaction for large displays. In Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07--10, 2007). UIST '07. ACM, New York, NY, 53--56. DOI= http://doi.acm.org/10.1145/1294211.1294221
[24]
Vogel, D. and Balakrishnan, R. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23--26, 2005). UIST '05. ACM, New York, NY, 33--42. DOI= http://doi.acm.org/10.1145/1095034.1095041
[25]
WiiBrew Wiki. 2010. http://www.wiibrew.org/wiki/, visited in April 2010.
[26]
Zeleznik, R. 1998. Sketching in 3D. SIGGRAPH Comput. Graph. 32, 4 (Nov. 1998), 45--49. DOI= http://doi.acm.org/10.1145/307710.307727
[27]
Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. SKETCH: an interface for sketching 3D scenes. In Proceedings of the 23rd Annual Conference on Computer Graphics and interactive Techniques SIGGRAPH '96. ACM, New York, NY, 163--170. DOI= http://doi.acm.org/10.1145/237170.237238

Cited By

View all
  • (2012)Bimanual natural user interaction for 3D modelling application using stereo computer visionProceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction10.1145/2379256.2379264(44-51)Online publication date: 2-Jul-2012
  • (2012)Virtual Board: A low cost Multi Touch Human Computer Interaction SystemProcedia Technology10.1016/j.protcy.2012.03.0193(178-186)Online publication date: 2012

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
CHINZ '10: Proceedings of the 11th International Conference of the NZ Chapter of the ACM Special Interest Group on Human-Computer Interaction
July 2010
95 pages
ISBN:9781450301046
DOI:10.1145/1832838
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • New Zealand ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D hand-tracking
  2. 3D input
  3. 3D interaction
  4. 3D modeling
  5. Nintendo Wii™ controller
  6. Wiimote
  7. infrared tracking
  8. interaction techniques
  9. large interactive displays
  10. sketching

Qualifiers

  • Research-article

Conference

CHINZ '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 8 of 23 submissions, 35%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2012)Bimanual natural user interaction for 3D modelling application using stereo computer visionProceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction10.1145/2379256.2379264(44-51)Online publication date: 2-Jul-2012
  • (2012)Virtual Board: A low cost Multi Touch Human Computer Interaction SystemProcedia Technology10.1016/j.protcy.2012.03.0193(178-186)Online publication date: 2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media