research-article

Tracking-based interaction for object creation in mobile augmented reality

Authors:

Wolfgang Hürst,

Joris DekkerAuthors Info & Claims

MM '13: Proceedings of the 21st ACM international conference on Multimedia

Pages 93 - 102

https://doi.org/10.1145/2502081.2502120

Published: 21 October 2013 Publication History

Abstract

In this work, we evaluate the feasibility of tracking-based interaction using a mobile phone's or tablet's camera in order to create and edit 3D objects in augmented reality applications. We present a feasibility study investigating if and how gestures made with your finger can be used to create such objects. A revised interface design is evaluated in a user study with 24 subjects that reveals a high usability and entertainment value, but also identifies issues such as ergonomic discomfort and imprecise input for complex tasks. Hence, our results suggest huge potential for this type of interaction in the entertainment, edutainment, and leisure domain, but limited usefulness for serious applications.

References

[1]

M. Baldauf, S. Zambanini, P. Fröhlich, and P. Reichl. 2011. Markerless visual fingertip detection for natural mobile device interaction. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 539--544.

Digital Library

[2]

O. Bergig, N. Hagbi, J. El-Sana, and M. Billinghurst. 2009. In-place 3D sketching for authoring and augmenting mechanical systems. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09). IEEE Computer Society, Washington, DC, USA, 87--94.

Digital Library

[3]

M. Luz Caballero, T.-R. Chang, M. Menéndez, and V. Occhialini. 2010. Behand: augmented virtuality gestural interaction for mobile phones. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI '10). ACM, New York, NY, USA, 451--454

Digital Library

[4]

J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88). ACM, New York, NY, USA, 95--100.

Digital Library

[5]

J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic. 2011. Augmented reality technologies, systems and applications. Multimedia Tools and Applications, 51(1), January 2011, 341--377.

Digital Library

[6]

S.-U. Cheon and S. Han. 2008. A template-based reconstruction of plane-symmetric 3d models from freehand sketches. Comput. Aided Des. 40(9), September 2008, 975--986.

Digital Library

[7]

K. Dorfmüller-Ulhaas and D. Schmalstieg. 2001. Finger tracking for interaction in augmented environments. In Proceedings of IEEE and ACM International Symposium on Augmented Reality, 2001, 55--64.

Digital Library

[8]

J. L. Crowley, F. Bérard, and J. Coutaz. 1995. Finger Tracking as an Input Device for Augmented Reality. In Proceedings of the International Workshop on Face and Gesture Recognition, Zurich, Switzerland, 195--200.

[9]

EyeSight's Touch Free Interface Technology Software: http://www.eyesight-tech.com/technology/

[10]

Google SketchUp: http://sketchup.google.com/

[11]

N. Hagbi, O. Bergig, J. El-Sana, and M. Billinghurst. 2009. Shape recognition and pose estimation for mobile augmented reality. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09). IEEE Computer Society, Washington, DC, USA, 65--71

Digital Library

[12]

W. Hürst and C. van Wezel. 2013. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools and Applications, Vol. 62(1), January 2013, 233--258.

[13]

T. Igarashi, S. Matsuoka, and H. Tanaka. 1999. Teddy: A sketching interface for 3d freeform design. SIGGRAPH '99, 409--416.

Digital Library

[14]

O. A. Karpenko and J. F. Hughes. 2006. Smoothsketch: 3d free-form shapes from complex sketches. In ACM SIGGRAPH 2006 Papers, SIGGRAPH '06, 589--598.

Digital Library

[15]

H. Koike, Y. Sato, and Y. Kobayashi. 2001. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans. Comput.-Hum. Interact. 8(4), December 2001, 307--322

Digital Library

[16]

M. Lee, R. Green, M. Billinghurst. 2008. 3D Natural Hand Interaction for AR Applications. Image and Vision Computing New Zealand (IVCNZ 2008). 23rd International Conference.

[17]

P. Mistry, P. Maes, and L. Chang. 2009. WUW - wear ur world: a wearable gestural interface. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09). ACM, New York, NY, USA, 4111--4116.

Digital Library

[18]

P. Mistry and P. Maes. 2009. SixthSense: a wearable gestural interface. In ACM SIGGRAPH ASIA 2009 Sketches (SIGGRAPH ASIA '09). ACM, New York, NY, USA, Article 11, 1 page.

Digital Library

[19]

L. Olsen, F. F. Samavati, M. C. Sousa, and J. A. Jorge. 2009. Sketch-based modeling: A survey. Computers & Graphics, 33(1), 85--103.

Digital Library

[20]

S. Schkolne. 2002. Drawing with the hand in free space: Creating 3d shapes with gesture in a semi-immersive environment. Leonardo, Vol. 35(4), August 2002, 371--375.

[21]

O. Shaer and E. Hornecker. 2010. Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends Human-Computer Interaction 3, 1--2 (January 2010), 1--137.

Digital Library

[22]

B.-K. Seo, J. Choi, J.-H. Han, H. Park, and J.-I. Park. 2008. One-handed interaction with augmented virtual objects on mobile devices. In Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI '08). ACM, New York, NY, USA, Article 8, 6 pages

Digital Library

[23]

T. Niikura, Y. Hirobe, A. Cassinelli, Y. Watanabe, T. Komuro, and M. Ishikawa. 2010. In-air typing interface for mobile devices with vibration feedback. In ACM SIGGRAPH 2010 Emerging Technologies (SIGGRAPH '10). ACM, New York, NY, USA, Article 15, 1 page.

Digital Library

[24]

K. Terajima, T. Komuro, and M. Ishikawa. 2009. Fast finger tracking system for in-air typing interface. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09). ACM, New York, NY, USA, 3739--3744.

Digital Library

[25]

M. Xin, E. Sharlin, and M. C. Sousa. 2008. Napkin sketch: handheld mixed reality 3d sketching. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology, VRST '08, pages 223--226.

Digital Library

[26]

B. Yee and Y. Ning. 2009. Augmented reality in-situ 3d sketching of physical objects. In Proceedings of Intelligent User Interfaces (IUI'09), Workshop on Sketch Recognition.

[27]

S. Yousefi, F. A. Kondori, and H. Li. 2011. 3D gestural interaction for stereoscopic visualization on mobile devices. In Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II (CAIP'11), Ainhoa Berciano, Daniel Diaz-Pernil, Helena Molina-Abril, Pedro Real, and Walter Kropatsch (Eds.), Vol. Part II. Springer-Verlag, Berlin, Heidelberg, 555--562

Digital Library

Cited By

Muñoz-Saavedra LMiró-Amarante LDomínguez-Morales M(2020)Augmented and Virtual Reality Evolution and Future TendencyApplied Sciences10.3390/app1001032210:1(322)Online publication date: 1-Jan-2020
https://doi.org/10.3390/app10010322
Lin SCheng HLi WHuang ZHui PPeylo C(2017)UbiiIEEE Transactions on Mobile Computing10.1109/TMC.2016.256737816:3(872-885)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1109/TMC.2016.2567378
Huang ZLi WHui PZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)UbiiProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2806266(341-350)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2806266
Show More Cited By

Index Terms

Tracking-based interaction for object creation in mobile augmented reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Hand-based interaction for object manipulation with augmented reality glasses
VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

An increase number of gesture sensors and AR(augmented reality) displays are emerging these years. There are more and more study working on spatial interaction. In this work, we focus on evaluating the feasibility of hand-based interaction designed for ...
Interaction methods for mobile augmented reality
CHINZ '12: Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction

In recent years mobile phone based Augmented Reality (AR) has become very popular. The current generation of smart phones has cameras, GPS and compass sensors, and significant CPU and GPU power, making them idea for mobile AR applications. Interaction ...
A Review of Augmented Reality-Based Human-Computer Interaction Applications of Gesture-Based Interaction
HCI International 2019 – Late Breaking Papers
Abstract
In recent years, augmented reality (AR) is an extremely growing field in information technology, computer science, and computer engineering. Although there are many recent works that use augmented reality for different purposes, most of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '13: Proceedings of the 21st ACM international conference on Multimedia

October 2013

1166 pages

ISBN:9781450324045

DOI:10.1145/2502081

General Chairs:
Alejandro (Alex) Jaimes
Yahoo!, Spain
,
Nicu Sebe
University of Trento, Italy
,
Nozha Boujemaa
INRIA, France
,
Program Chairs:
Daniel Gatica-Perez
IDIAP & EPFL, Switzerland
,
David A. Shamma
Yahoo!, USA
,
Marcel Worring
University of Amsterdam, The Netherlands
,
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '13

Sponsor:

SIGMM

MM '13: ACM Multimedia Conference

October 21 - 25, 2013

Barcelona, Spain

Acceptance Rates

MM '13 Paper Acceptance Rate 47 of 235 submissions, 20%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
693
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Muñoz-Saavedra LMiró-Amarante LDomínguez-Morales M(2020)Augmented and Virtual Reality Evolution and Future TendencyApplied Sciences10.3390/app1001032210:1(322)Online publication date: 1-Jan-2020
https://doi.org/10.3390/app10010322
Lin SCheng HLi WHuang ZHui PPeylo C(2017)UbiiIEEE Transactions on Mobile Computing10.1109/TMC.2016.256737816:3(872-885)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1109/TMC.2016.2567378
Huang ZLi WHui PZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)UbiiProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2806266(341-350)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2806266
He ZYang XJin XMagnenat-Thalmann NYang HYang XBednarz TFujishiro I(2014)Hand-based interaction for object manipulation with augmented reality glassesProceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/2670473.2670505(227-230)Online publication date: 30-Nov-2014
https://dl.acm.org/doi/10.1145/2670473.2670505
He ZYang X(2014)Object creation based on free virtual grid with ARGlassSIGGRAPH Asia 2014 Posters10.1145/2668975.2669019(1-1)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2668975.2669019
Jamali SShiratuddin MWong K(2014)Educational Tools: A Review of Interfaces of Mobile-Augmented Reality (mAR) ApplicationsInnovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering10.1007/978-3-319-06773-5_76(569-573)Online publication date: 16-Oct-2014
https://doi.org/10.1007/978-3-319-06773-5_76

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten