Abstract
Continued improvements and rising ubiquity in touchscreen and motion-sensing technologies enable users to leverage mid-air input modalities for intelligent surface sketching into the third dimension. However, existing approaches largely either focus on constrained 3D gesture sets, require specialized hardware setups, or do not deviate beyond surface sketching assumptions. We present InvisiShapes, a recognition system for users to sketch 3D geometric primitives in continuous interaction spaces that explore surfaces and mid-air environments. Our system leverages a collection of sketch and gesture recognition techniques and heuristics and takes advantage of easily accessible computing hardware for users to incorporate depth to their sketches. From our interaction study and user evaluations, we observed that our system successfully accomplishes strong recognition and intuitive interaction capabilities on collected sketch+motion data and interactive sketching scenarios, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Anthony, L., Wobbrock, J.O.: $N-protractor: a fast and accurate multistroke recognizer. In: Proceedings of Graphics Interface 2012. Canadian Information Processing Society, Toronto (2012)
Cheema, S., Gulwani, S., LaViola, J.: QuickDraw: improving drawing experience for geometric diagrams. In: 2012 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York (2012)
De Araùjo, B.R., Casiez, G., Jorge, J.A.: Mockup builder: direct 3d modeling on and above the surface in a continuous interaction space. In: Proceedings of Graphics Interface 2012, pp. 173–180. Canadian Information Processing Society, Toronto (2012)
Hammond, T., Davis, R.: LADDER, a sketching language for user interface developers. Comput. Graph. 29, 518–532 (2005)
Hoffman, M., Varcholik, P., LaViola Jr., J.J.: Breaking the status quo: improving 3D gesture recognition with spatially convenient input devices. In: Proceedings of the 2010 IEEE Virtual Reality Conference. IEEE Computer Society, Washington (2010)
Kratz, S., Rohs, M.: A $3 gesture recognizer: simple gesture recognition for devices equipped with 3D acceleration sensors In: Proceedings of the 15th International Conference on Intelligent User Interfaces. ACM, New York (2010)
Kratz, S., Rohs, M.: Protractor3D: a closed-form solution to rotation-invariant 3D gestures In: Proceedings of the 16th International Conference on Intelligent User Interfaces. ACM, New York (2011)
Kratz, S., Rohs, M., Essl, G.: Combining acceleration and gyroscope data for motion gesture recognition using classifiers with dimensionality constraints. In: Proceedings of the 18th International Conference on Intelligent User Interfaces. ACM, New York (2013)
Marquardt, N., Jota, R., Greenberg, S., Jorge, J.A.: The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6948, pp. 461–476. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23765-2_32
Paulson, B., Hammond, T.: PaleoSketch: accurate primitive sketch recognition and beautification. In: Proceedings of the 13th International Conference on Intelligent User Interfaces, pp. 1–10. ACM, New York (2008)
Spindler, M., Martsch, M., Dachselt, R.: Going beyond the surface: studying multi-layer interaction above the tabletop. In: 2012 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1277–1286. ACM, New York (2012)
Steins, C., Gustafson, S., Holz, C., Baudisch, P.: Imaginary devices: gesture-based interaction mimicking traditional input devices. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 123–126. ACM, New York (2013)
Subramanian, S., Aliakseyeu, D., Lucero, A.: Multi-layer interaction for digital tables. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. ACM, New York (2006)
Taele, P., Hammond, T.: Initial approaches for extending sketch recognition to beyond-surface environments. In: Proceedings of the 2012 ACM Annual Conference Extended Abstracts on Human Factors in Computing Systems Extended Abstracts, pp. 2039–2044. ACM, New York (2012)
Taele, P., Hammond, T.: Developing sketch recognition and interaction techniques for intelligent surfaceless sketching user interfaces. In: Proceedings of the Companion Publication of the 19th International Conference on Intelligent User Interfaces, pp. 53–56. ACM, New York (2014)
van Sommers, P.: Drawing and Cognition: Descriptive and Experimental Studies of Graphic Production Processes. Cambridge University Press, Cambridge (1984)
Wolin, A., Eoff, B., Hammond, T.: ShortStraw: a simple and eective corner finder for polylines. In: Proceedings of the Fifth Eurographics Conference on Sketch-Based Interfaces and Modeling, pp. 33–40. ACM, New York (2008)
Xiong, Y., LaViola Jr., J.J.: A ShortStraw-based algorithm for corner finding in sketch-based interfaces. Comput. Graph. 34(5), 513–527 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Taele, P., Hammond, T. (2017). InvisiShapes: A Recognition System for Sketched 3D Primitives in Continuous Interaction Spaces. In: Chen, Y., Christie, M., Tan, W. (eds) Smart Graphics. SG 2015. Lecture Notes in Computer Science(), vol 9317. Springer, Cham. https://doi.org/10.1007/978-3-319-53838-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-53838-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-53837-2
Online ISBN: 978-3-319-53838-9
eBook Packages: Computer ScienceComputer Science (R0)