Andrew D. Wilson
ABSTRACT
We present techniques and algorithms to simulate grasping behavior on an imaging interactive surface (e.g., Microsoft Surface). In particular, we describe a contour model of touch contact shape, and show how these contours may be represented in a real-time physics simulation in a way that allows more realistic grasping behavior. For example, a virtual object may be moved by "squeezing" it with multiple contacts undergoing motion. The virtual object is caused to move by simulated contact and friction forces. Previous work [14] uses many small rigid bodies ("particle proxies") to approximate touch contact shape. This paper presents a variation of the particle proxy approach which allows grasping behavior. The advantages and disadvantages of this new approach are discussed.
Supplemental Material
- Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S. 2008. ShapeTouch: Leveraging Contact Shape on Interactive Surfaces, Third IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 129--136Google Scholar
- Chang, F., Chen, C.-J., and Lu, C.-J. 2004. A linear-time component labeling algorithm using contour tracing technique, Computer Vision and Image Understanding, vol. 93, no. 2, 206--220. Google ScholarDigital Library
- Fröhlich, B., Tramberend, H., Beers, A., Agrawala, M., and Baraff, D. 2000. Physically-based manipulation on the responsive workbench. IEEE VR Conference 2000, 5--11. Google ScholarDigital Library
- Han, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. UIST '05, 115--118. Google ScholarDigital Library
- Hilliges, O., Izadi, S., and Wilson, A. 2009. Interactions in the air: adding further depth to interactive tabletops, UIST'09. Google ScholarDigital Library
- Jerez, J., and Suero, A. Newton Physics Engine. http://www.newtondynamics.com.Google Scholar
- Kruger, R., Carpendale, S., Scott, S., Tang, A. 2005. Fluid integration of rotation and translation. CHI 2005, 601--610. Google ScholarDigital Library
- MacKenzie, C. L., and Iberall, T. 1994. The grasping hand. Amsterdam, Netherlands: North Holland.Google Scholar
- Microsoft Corporation. Microsoft Surface. http://www.surface.com. 2007.Google Scholar
- Wilson, A. 2004. TouchLight: an imaging touch screen and display for gesture-based interaction. ICMI '04, 69--76. Google ScholarDigital Library
- Wilson, A. 2005. Play Anywhere: a compact interactive tabletop projection-vision system. UIST'05, 83--92. Google ScholarDigital Library
- Wilson, A. 2006. Robust computer vision-based detection of pinching for one and two-handed gesture input. UIST'06, 255--258. Google ScholarDigital Library
- Wilson, A. 2007. Depth-sensing video cameras for 3D Tangible Interaction. Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 201--204.Google ScholarCross Ref
- Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A. and Kirk, D. 2008. Bringing physics to the surface, UIST'08, 67--76. Google ScholarDigital Library
Index Terms
- Simulating grasping behavior on an imaging interactive surface
Recommendations
Bringing physics to the surface
UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technologyThis paper explores the intersection of emerging surface technologies, capable of sensing multiple contacts and of-ten shape information, and advanced games physics engines. We define a technique for modeling the data sensed from such surfaces as input ...
Compliant grasping with passive forces
Because friction is central to robotic grasp, developing an accurate and tractable model of contact compliance, particularly in the tangential direction, and predicting the passive force closure are crucial to robotic grasping and contact analysis. This ...
A theory on grasping objects using effectors with curved contact surfaces and its application to whole-arm grasping
This paper develops a theoretical framework for grasping objects using customized effectors that have curved contact surfaces, and presents its application to the problem of robotic whole-arm grasping. We present a collection of immobilizing grasps and ...
Comments