Mike Sinclair
Hrvoje Benko
ABSTRACT
This paper presents the design and development of a novel visual+haptic device that co-locates 3D stereo visualization, direct touch and touch force sensing with a robotically actuated display. Our actuated immersive 3D display, called TouchMover, is capable of providing 1D movement (up to 36cm) and force feedback (up to 230N) in a single dimension, perpendicular to the screen plane. In addition to describing the details of our design, we showcase how TouchMover allows the user to: 1) interact with 3D objects by pushing them on the screen with realistic force feedback, 2) touch and feel the contour of a 3D object, 3) explore and annotate volumetric medical images (e.g., MRI brain scans) and 4) experience different activation forces and stiffness when interacting with common 2D on-screen elements (e.g., buttons). We also contribute the results of an experiment which demonstrates the effectiveness of the haptic output of our device. Our results show that people are capable of disambiguating between 10 different 3D shapes with the same 2D footprint by touching alone and without any visual feedback (85% recognition rate, 12 participants).
Supplemental Material
- Badshah, A, Gupta, S., Morris, D., Patel, S.N., and Tan, D. (2012). GyroTab: A Handheld Device that Provides Reactive Trorque Feedback. In Proc. ACM CHI '12. 3153--3156. Google Scholar
Digital Library
- Ballesteros, S. and Heller, M. (2008). Haptic object identification. In Human Haptic Perception, Basics and Applications. Grunwald, M. ed., 207--222.Google Scholar
- Bau, O., Poupyrev, I., Israr, A, Harrison, C. (2010). TeslaTouch: Electrovibration for Touch Surfaces. In Proc. ACM UIST'10. 283--292. Google ScholarDigital Library
- Benko, H. and Wigdor, D. (2010). Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In Tabletops - Horizontal Interactive Displays. Christian Mueller-Tomfelde (ed.) Springer-Verlag London Ltd., April 2010.Google ScholarCross Ref
- Berdahl, E., Smith, J., Weinzierl, S., Niemeyer, G. (2013). Force-Sensitive Detents Improve User Performance for Linear Selection Tasks. IEEE Transactions on Haptics, 2013. Google ScholarDigital Library
- Biggs, S.J. and Srinivasan, M.A. (2002). Haptic Interfaces. Handbook of Virtual Environments. K. Stanney (ed.), Lawrence Erlbaum Associates. 93--115.Google Scholar
- Bouzid, M., Burdea, G., Popescu, G., and Boian, R. (2002). The Rutgers Master II-New Design Force-Feedback Glove. IEEE/ASME Transactions on Mechatronics. Vol. 7. No.2.Google Scholar
- Bowman, D., Kruijff, E., LaViola, J.J., and Poupyrev, I. (2004). 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston, Ma. Google ScholarDigital Library
- Burdea, G.C. (1996). Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY. Google ScholarDigital Library
- Cha, J., Eid, M., Saddik, A. (2009). Touchable 3D Video System. ACM Transactions on Multimedia Computing, Communications and Applications. Google ScholarDigital Library
- Faeth, A., Oren, M., Harding, C. (2008). Combining 3-D geovisualization with force feedback driven user interaction. In Workshop on Advances in Geographic Information Systems '08. Google ScholarDigital Library
- Fukumoto, M. and Sugimura, T. 200 Active click: tactile feedback for touch panels. In ACM CHI '01 Extended Abstracts. 121--122. Google ScholarDigital Library
- Harrison, C. and Hudson, S. E. (2009). Providing Dynamically Changeable Physical Buttons on a Visual Display. In Proc. ACM CHI '09. 299--308. Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. (2009). Interactions in the Air: Adding Further Depth to Interactive Tabletops. In Proc. ACM UIST '09. Google ScholarDigital Library
- Hoshino, T., Minemoto, T., and Tsukada, Y. (2007) Display Unit with Touch Panel. US Patent No. 7312791. Filed Aug. 27, 2003. Issued Dec. 25, 2007.Google Scholar
- Hou, Z., Zhang, Y., Yanf, Y. (2012). Enhancing Touch Screen Games Through a Cable-driven Force Feedback Device. In Proc. Inter. Conference on Virtual Reality and Visualization. Google ScholarDigital Library
- Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. (2001). Project FEELEX: adding haptic surface to graphics. In Proc. ACM SIGGRAPH '01. 469--476. Google ScholarDigital Library
- Kuchenbecker, K., Ferguson, D., Kutzer, M., Moses, M., Okamura, A. (2008). The Touch Thimble: Providing Fingertip Contact Feedback During Point-Force Haptic Interaction. In Proc. Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Google ScholarDigital Library
- Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M. and Ishii, H. (2011). Direct and gestural interaction with relief: a 2.5D shape display. In Proc. ACM UIST '11. 541--548. Google ScholarDigital Library
- Mark, W. R., Randolph, S. D., Finch, M., Van Verth, J.M., and Taylor, R.M. (1996). Adding force feedback to graphics systems: issues and solutions. In Proc. ACM SIGGRAPH '96. 447--452. Google ScholarDigital Library
- Massie,T., and Salisbury, K. (1994). The PHANToM Haptic Interface: A Device for Probing Virtual Objects. In ASME Haptic Interfaces for Virtual Environment and Teleoperator Systems, DSC-Vol.55-1.Google Scholar
- Olsson, P., Nysjo, F., Seipel, S., Carlbom, I. (2012). Physically co-located haptic interaction with 3D displays. In Proc. Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems '12.Google ScholarCross Ref
- Poupyrev, I. and Maruyama, S. (2003). Tactile interfaces for small touch screens. In Proc. ACM UIST '03. 217--220. Google ScholarDigital Library
- Ramos, G., Boulos, M., Balakrishnan, R. (2004). Pressure Widgets. In Proc. ACM CHI '04. 487--494. Google ScholarDigital Library
- Schöning, J., Steinicke, F., Valkov, D., Krüger, A. and Hinrichs, K. H. (2009). Bimanual interaction with interscopic multi-touch surfaces. In Proc. INTERACT '09. 40--53. Google ScholarDigital Library
- Tsang, M., Fitzmaurice, G., Kurtenbach, G. Khan, A., Buxton, B. (2002). Boom Chameleon: Simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. In Proc. ACM UIST '02. Google ScholarDigital Library
- Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. (2009). Bringing Physics to the Surface, In ACM UIST '09. Google ScholarDigital Library
- Valkov, D., Steinicke, F., Bruder, G., Hinrichs, K. (2011). 2D Touching of 3D Stereoscopic Objects. In Proc. ACM CHI '11. Google ScholarDigital Library
- Yang, Y., Zhang, Y., Hou, Z., Chen, Z., Lemaire-Semail, B. (2011). FingViewer: a New Multi-Touch Force Feedback Touch Screen. In Proc. of IEEE International Conference on Consumer Electronics '11.Google ScholarCross Ref
- Zeng, T., Lemaire-Semail, B., Giraud, F., Messaoudi, A., Bouscayrol, A. (2012). Position control of a 3 DOF platform for haptic shape rendering. In Proc. of 15th International Power Electronics and Motion Control Conference.Google ScholarCross Ref
Index Terms
- TouchMover: actuated 3D touchscreen with haptic feedback
Recommendations
CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsCLAW is a handheld virtual reality controller that augments the typical controller functionality with force feedback and actuated movement to the index finger. Our controller enables three distinct interactions (grasping virtual object, touching virtual ...
inFORCE: Bi-directional `Force' Shape Display for Haptic Interaction
TEI '19: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied InteractionWhile previously proposed hardware on pin-based shape display has improved various technical aspects, there has been a clear limitation on the haptic quality of variable 'force' feedback. In this paper, we explore a novel haptic interaction design space ...
Demonstration of CLAW: A Multifunctional Handheld VR Haptic Controller
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsCLAW is a handheld virtual reality controller that augments the typical controller functionality with force feedback and actuated movement to the index finger. Our controller enables three distinct interactions (grasping virtual object, touching virtual ...
Comments