skip to main content
10.1145/1731903.1731929acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

Simulating grasping behavior on an imaging interactive surface

Published: 23 November 2009 Publication History

Abstract

We present techniques and algorithms to simulate grasping behavior on an imaging interactive surface (e.g., Microsoft Surface). In particular, we describe a contour model of touch contact shape, and show how these contours may be represented in a real-time physics simulation in a way that allows more realistic grasping behavior. For example, a virtual object may be moved by "squeezing" it with multiple contacts undergoing motion. The virtual object is caused to move by simulated contact and friction forces. Previous work [14] uses many small rigid bodies ("particle proxies") to approximate touch contact shape. This paper presents a variation of the particle proxy approach which allows grasping behavior. The advantages and disadvantages of this new approach are discussed.

Supplementary Material

JPG File (185.jpg)
MP4 File (185.mp4)

References

[1]
Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S. 2008. ShapeTouch: Leveraging Contact Shape on Interactive Surfaces, Third IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 129--136
[2]
Chang, F., Chen, C.-J., and Lu, C.-J. 2004. A linear-time component labeling algorithm using contour tracing technique, Computer Vision and Image Understanding, vol. 93, no. 2, 206--220.
[3]
Fröhlich, B., Tramberend, H., Beers, A., Agrawala, M., and Baraff, D. 2000. Physically-based manipulation on the responsive workbench. IEEE VR Conference 2000, 5--11.
[4]
Han, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. UIST '05, 115--118.
[5]
Hilliges, O., Izadi, S., and Wilson, A. 2009. Interactions in the air: adding further depth to interactive tabletops, UIST'09.
[6]
Jerez, J., and Suero, A. Newton Physics Engine. http://www.newtondynamics.com.
[7]
Kruger, R., Carpendale, S., Scott, S., Tang, A. 2005. Fluid integration of rotation and translation. CHI 2005, 601--610.
[8]
MacKenzie, C. L., and Iberall, T. 1994. The grasping hand. Amsterdam, Netherlands: North Holland.
[9]
Microsoft Corporation. Microsoft Surface. http://www.surface.com. 2007.
[10]
Wilson, A. 2004. TouchLight: an imaging touch screen and display for gesture-based interaction. ICMI '04, 69--76.
[11]
Wilson, A. 2005. Play Anywhere: a compact interactive tabletop projection-vision system. UIST'05, 83--92.
[12]
Wilson, A. 2006. Robust computer vision-based detection of pinching for one and two-handed gesture input. UIST'06, 255--258.
[13]
Wilson, A. 2007. Depth-sensing video cameras for 3D Tangible Interaction. Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 201--204.
[14]
Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A. and Kirk, D. 2008. Bringing physics to the surface, UIST'08, 67--76.

Cited By

View all
  • (2022)Squeezy-Feely: Investigating Lateral Thumb-Index Pinching as an Input ModalityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501981(1-15)Online publication date: 29-Apr-2022
  • (2017)Gaze + pinch interaction in virtual realityProceedings of the 5th Symposium on Spatial User Interaction10.1145/3131277.3132180(99-108)Online publication date: 16-Oct-2017
  • (2015)TouchSketchProceedings of the 21st ACM Symposium on Virtual Reality Software and Technology10.1145/2821592.2821606(59-68)Online publication date: 13-Nov-2015
  • Show More Cited By

Index Terms

  1. Simulating grasping behavior on an imaging interactive surface

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
    November 2009
    240 pages
    ISBN:9781605587332
    DOI:10.1145/1731903
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 November 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. game physics engines
    2. interactive surfaces

    Qualifiers

    • Research-article

    Conference

    ITS'09
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Squeezy-Feely: Investigating Lateral Thumb-Index Pinching as an Input ModalityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501981(1-15)Online publication date: 29-Apr-2022
    • (2017)Gaze + pinch interaction in virtual realityProceedings of the 5th Symposium on Spatial User Interaction10.1145/3131277.3132180(99-108)Online publication date: 16-Oct-2017
    • (2015)TouchSketchProceedings of the 21st ACM Symposium on Virtual Reality Software and Technology10.1145/2821592.2821606(59-68)Online publication date: 13-Nov-2015
    • (2014)TouchToolsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557012(2913-2916)Online publication date: 26-Apr-2014
    • (2014)Grasp-Shell vs gesture-speech: A comparison of direct and indirect natural interaction techniques in augmented reality2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2014.6948411(73-82)Online publication date: Sep-2014
    • (2013)Towards user-defined multi-touch gestures for 3D objectsProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512825(231-240)Online publication date: 6-Oct-2013
    • (2012)HoloDeskProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208405(2421-2430)Online publication date: 5-May-2012
    • (2011)Integrated rotation and translation for 3d manipulation on multi-touch interactive surfacesProceedings of the 11th international conference on Smart graphics10.5555/2032567.2032589(146-154)Online publication date: 18-Jul-2011
    • (2011)A multi-touch system for 3D modelling and animationProceedings of the 11th international conference on Smart graphics10.5555/2032567.2032574(48-59)Online publication date: 18-Jul-2011
    • (2011)Tabletop games using real environment and physical simulationProceedings of the 6th International Conference on Foundations of Digital Games10.1145/2159365.2159426(322-324)Online publication date: 29-Jun-2011
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media