Neng-Hao Yu
Li-Wei Chan
Lung-Pan Cheng
Mike Chen
ABSTRACT
We present TUIC, a technology that enables tangible interaction on capacitive multi-touch devices, such as iPad, iPhone, and 3M's multi-touch displays, without requiring any hardware modifications. TUIC simulates finger touches on capacitive displays using passive materials and active modulation circuits embedded inside tangible objects, and can be used with multi-touch gestures simultaneously. TUIC consists of three approaches to sense and track objects: spatial, frequency, and hybrid (spatial plus frequency). The spatial approach, also known as 2D markers, uses geometric, multi-point touch patterns to encode object IDs. Spatial tags are straightforward to construct and are easily tracked when moved, but require sufficient spacing between the multiple touch points. The frequency approach uses modulation circuits to generate high-frequency touches to encode object IDs in the time domain. It requires fewer touch points and allows smaller tags to be built. The hybrid approach combines both spatial and frequency tags to construct small tags that can be reliably tracked when moved and rotated. We show three applications demonstrating the above approaches on iPads and 3M's multi-touch displays.
Supplemental Material
- Barrett, G. and Omote, R. Projected-Capacitive Touch Technology. Information Display, March 2010/vol. 26, NO. 3, Society for Information Display, 17--18.Google Scholar
- Baudisch, P., Becker, T., and Rudeck, F. Lumino: tangible blocks for tabletop computers based on glass fiber bundles. In Proc. of CHI 2010, 1165--1174. Google ScholarDigital Library
- Block, F., Haller, M., Gellersen, H., Gutwin, C., and Billinghurst, M. VoodooSketch - extending interactive surfaces with adaptable interface palettes. In Proc. of TEI 2008, 55--58. Google ScholarDigital Library
- Chang, A. Y., Lee, W. C., and Lee, W. Y. 2010. Touchscreen Stylus. U.S. Patent US 2010/0053120 A1. Mar. 2010.Google Scholar
- Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST. 219--226. Google ScholarDigital Library
- Fiala, M. ARTag, a fiducial marker system using digital techniques. In Proc. of IEEE CVPR 2005, 590--596 vol. 2. Google ScholarDigital Library
- Fitzmaurice, W.G., Ishii, H., and Buxton, W. Bricks: laying the foundations for graspable user interfaces. In Proc. of CHI 1995, 442--449. Google ScholarDigital Library
- GestureWorks. http://gestureworks.com.Google Scholar
- Guo, C. and Sharlin, E. Exploring the use of tangible user interfaces for human-robot interaction: a comparative study. In Proc. of CHI 2008, 121--130. Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + touch = new tools. In Proc. of UIST 2010, 27--36. Google ScholarDigital Library
- Ishii, H., Tangible bits: beyond pixels, In Proc. of TEI 2008, xv-xxv. Google ScholarDigital Library
- Ishii, H. The tangible user interface and its evolution. Communications of the ACM 2008, 32--36. Google ScholarDigital Library
- Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, B. ThinSight: integrated optical multi-touch sensing through thin form-factor displays. In Proc. of EDT 2007, Art. NO. 6. Google ScholarDigital Library
- Jordà, S., Geiger, G., Alonso, M., and Kaltenbrunner, M. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. of TEI 2007, 139--146. Google ScholarDigital Library
- Jordà, S., Julià, F. C., and Gallardo, D. Interactive surfaces and tangibles. XRDS: Crossroads, The ACM Magazine for Students 2010, vol. 16 (4), 21--28. Google ScholarDigital Library
- Liu, Y. C. and Tseng, H. H. 2009. Stylus and Electronic Device. U.S. Patent 2009/0167727 A1. Jul. 2009.Google Scholar
- Minami, M., Fukuju, Y., Hirasawa, K., Yokoyama, S., Mizumachi, M., Morikawa, H., and Aoyama, T. Dolphin: A practical approach for implementing a fully distributed indoor ultrasonic positioning system. In Proc. of UBICOMP 2004, 347--356.Google ScholarCross Ref
- NET.2971 - The Microsoft Surface domino tag. http://www.xs4all.nl/~wrb/Main/Index.htm.Google Scholar
- Orit Shaer and Eva Hornecker. Tangible User Interfaces: Past, Present, and Future Directions. In Foundations and Trends in Human-Computer Interaction 3,1 (2010) 1--138. Google ScholarDigital Library
- Patten, J., Ishii, H., Hines, J., and Pangaro, G. Sensetable: A Wireless Object Tracking Platform for Tangible User Interfaces. In Proc. of CHI 2001, 253--260. Google ScholarDigital Library
- Patten, J., Ishii, H., and Recht, B. Audiopad: a tag-based interface for musical performance. In Proc. of NIME 2002, 1--6. Google ScholarDigital Library
- QR code. http://www.qrcode.com/index-e.html.Google Scholar
- Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI. 113--120. Google ScholarDigital Library
- Rice, C. A., Cain, B. C., and Fawcett, K. J. Dependable coding for fiducial tags. In Proc. of UCS 2004, 155--163.Google Scholar
- Rice, C. A., Harle, K. R., and Beresford, R. A. Analysing fundamental properties of marker-based vision system designs. In PerCom 2006, 453--471.Google Scholar
- Ullmer, B., Ishii, H., and Glas, D. mediaBlocks: physical containers, transports, and controls for online media. In Proc. of SIGGRAPH 1998, 379--386. Google ScholarDigital Library
- Ullmer, B., and Ishii, H. The metaDESK: models and prototypes for tangible user interfaces. In Proc. of UIST 1997, 223--232. Google ScholarDigital Library
- Underkoffler, J., and Ishii, H. Urp: a luminous-tangible workbench for urban planning and design. In Proc. of CHI 1999, 386--393. Google ScholarDigital Library
- Vogel, D. and Baudisch, P. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proc. CHI'07, 657--666. Google ScholarDigital Library
- Weiss, M., Wagner, J., Jennings, R., Jansen, Y., Khoshabeh, R., Hollan, D. J., and Borchers, J. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In Proc. of CHI 2009, 3229--3234. Google ScholarDigital Library
- Wilson, D. A. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. of UIST 2005, 83--92. Google ScholarDigital Library
- Xu, D., Read, C. J., Mazzone, E., and Brown, M. Designing and testing a tangible interface prototype. In Proc. of IDC 2007, 25--28. Google ScholarDigital Library
- Zimmerman, D. T., Smith, R. J., Paradiso, A. J., Allport, D. and Gershenfeld, N. Applying electric field sensing to human-computer interfaces. In Proc. of CHI 1995, 280--287. Google ScholarDigital Library
Index Terms
- TUIC: enabling tangible interaction on capacitive multi-touch displays
Recommendations
Using tangible drawing tools on a capacitive multi-touch display
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and ComputersWe present an innovative drawing tool that can detect tangible drawing instruments on a capacitive multi-touch tablet. There are three core components to the system: the tangible hardware, the recognizer used to identify the tangibles, and the drawing ...
Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present an experimental comparison of multi-touch and tangible user interfaces for basic interface actions. Twelve participants completed manipulation and acquisition tasks on an interactive surface in each of three conditions: tangible user ...
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyWe propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...
Comments