Abstract
Rapid advances in flexible display technologies and the benefits that they provide are promising enough to consider them for futuristic mobile devices. Current prototyping methods lack facilities to simulate such flexible touch screen displays and the interaction with them. In this paper, we present a technique that provides product developers a tool to interactively simulate products featuring flexible displays, using Augmented Reality and Haptics. This GPU-based algorithm is computationally inexpensive and efficient to deform a polygonal mesh in real time while maintaining an acceptable haptic feedback. The implementation of the algorithm has been found to be successful when applied to a variety of product simulations. This simulation tool can enhance or even replace traditional prototyping and facilitate testing of the prototype at various stages of the design cycle.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bullinger HJ, Warschat J, Fischer D (2000) Rapid product development–an overview. Comput Ind 42(2–3):99–108
De Pascale M, De Pascale G, Prattichizzo D, Barbagli F (2004) A GPU-friendly method for haptic and graphic rendering of deformable objects. In: Proceedings of Eurohaptics, pp 44–51
De Pascale M, Sarcuni G, Prattichizzo D (2005) Real-time soft-finger grasping of physically based quasi-rigid objects. In: Proceedings of world haptics conference, pp 545–546
Eink (2005) October press release http://www.eink.com/press/releases/pr87.html
Faeth AJ (2009) Expressive cutting, deforming, and painting of three-dimensional digital shapes through asymmetric bimanual haptic manipulation. MS thesis, Iowa State University
Fujitsu (2005) July press release, http://www.fujitsu.com/global/news/pr/archives/month/2005/20050713-01.html
Georgii J, Westermann R (2005) Interactive simulation and rendering of heterogeneous deformable bodies. In: Proceedings of VMV
Jo D, Yang U, Son W (2007) Design evaluation using virtual reality based prototypes: towards realistic visualization and operations. In: ACM international conference proceeding series, vol 309, proceedings of the 9th international conference on Human computer interaction with mobile devices and services
Kerttula M, Salmela M, Heikkinen M (1997) Virtual reality prototyping—“a framework for the development of electronics and telecommunication products”. In: Proceedings of the 8th international workshop on rapid system prototyping (RSP‘97) shortening the path from specification to prototype, p 2, June 1997
Krause FL, Neumann J (2001) Haptic interaction with non-rigid materials for assembly and dissassembly in product development. Institute for Machine Tools and Factory Management IWF, Technical University Berlin, Germany, CIRP annals—manufacturing technology, 50(1):81–84
Krauß M, Krannich D (2006) Ripcord: rapid interface prototyping for cordless devices. In: ACM international conference proceeding series, vol 159, proceedings of the 8th conference on human-computer interaction with mobile devices and services
Li Y, Brodlie K (2003) Soft object modelling with generalised chainmail—extending the boundaries of web-based graphics. Comput Graph Forum 22(4):717–727
Liukkunen K, Eteläperä M, Oivo M, Soininen J, Pellikka M (2008) Virtual prototypes in developing mobile software applications and devices. Product-Focused Software Process Improvement. Springer, Berlin, pp 174–188
Luciano C, Banerjee P, Florea L, Dawe G (2005) Design of the Immersivetouch™: a high-performance haptic augmented virtual reality system. In: 11th international conference on human-computer interaction, Las Vegas, NV
Luciano CJ, Banerjee PP, Rizzi SHR (2007) GPU-based elastic-object deformation for enhancement of existing haptic applications, Automation Science and Engineering. CASE 2007. IEEE international conference on vol, Issue, 22–25 September 2007, pp 146–151
Mosegaard J, Sørensen TS (2005) GPU accelerated surgical simulators for complex morphology. In: Proceedings of IEEE virtual reality, pp 147–153
Pering C (2002) Interaction design prototyping of communicator devices: towards meeting the hardware–software challenge. Interactions 9(6):36–46
Sá M, Carriço L (2006) Low-fi prototyping for mobile devices, CHI ‘06 extended abstracts on Human factors in computing systems, April 2006
Schill MA, Gibson SFF, Bender HJ, Manner R (1998) Biomechanical simulation of the vitreous humor in the eye using an Enhanced ChainMail Algorithm. LNCS 1496:679–687
Schwesig C, Poupyrev I, Mori E (2003) Gummi: user interface for deformable computers. In: Conference on human factors in computing systems, CHI ‘03 extended abstracts on Human factors in computing systems, Ft. Lauderdale, Florida, USA, pp 954–955
Sørensen TS, Mosegaard J (2006) Haptic feedback for the GPU-based surgical simulator. In: Proceedings of medicine meets virtual reality 14, pp 523–528
TOSHIBA (2002) Press release http://www.toshiba.co.jp/about/press/2002_05/pr2101.htm
Wang G (2002) Definition and review of virtual prototyping, transactions of the ASME. J Comput Inf Sci Eng 2(3):232–236
Ye J, Badiyani S, Raja V, Schlegel T (2007) Applications of virtual reality in product design evaluation. Human-Computer Interaction. HCI applications and services. Springer, Berlin, vol 4553/2007, August 2007, pp 1190–1199
Yoganandan AR, Banerjee PP, Luciano CJ (2009) Applying augmented reality and haptics to evaluate dynamic prototypes of mobile devices. Workshop on cloud-mobile convergence for virtual reality (CMCVR‘09), March 2009
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yoganandan, A.R., Pat Banerjee, P., Luciano, C.J. et al. Prototyping flexible touch screen devices using collocated haptic-graphic elastic-object deformation on the GPU. Virtual Reality 16, 33–43 (2012). https://doi.org/10.1007/s10055-010-0155-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-010-0155-9