ABSTRACT
We make touch input by physically colliding an end effector (e.g., a body part or a stylus) with a touch surface. Prior studies have examined the use of kinematic variables of collision between objects, such as position, velocity, force, and impact. However, the nature of the collision can be understood more thoroughly by considering the known physical relationships that exist between directly measurable variables (i.e., kinetics). Based on this collision kinetics, this study proposes a novel touch technique called FDSense. By simultaneously observing the force and contact area measured from the touchpad, FDSense allows estimation of the Young's modulus and stiffness of the object being contacted. Our technical evaluation showed that FDSense could effectively estimate the Young's modulus of end effectors made of various materials, and the stiffness of each part of the human hand. Two applications using FDSense were demonstrated, for digital painting and digital instruments, where the result of the expression varies significantly depending on the elasticity of the end effector. In a following informal study, participants assessed the technique positively.
Supplemental Material
- Apple. 2014. How to use the Force Touch trackpad. (2014). Retrieved February 20, 2018 from https://support.apple.com/en-us/HT204352.Google Scholar
- Andrea Bianchi and Seungwoo Je. 2017. Disambiguating Touch with a Smart-ring. In Proceedings of the 8th Augmented Human International Conference (AH '17). ACM, New York, NY, USA, Article 27, 5 pages. Google ScholarDigital Library
- David Bonnet, Caroline Appert, and Michel Beaudouin-Lafon. 2013. Extending the Vocabulary of Touch Events with ThumbRock. In Proceedings of Graphics Interface 2013 (GI '13). Canadian Information Processing Society, Toronto, Ontario, Canada, 221--228. http://dl.acm.org/citation.cfm?id=2532129.2532166 Google ScholarDigital Library
- Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 39--48. Google ScholarDigital Library
- William Buxton, Ralph Hill, and Peter Rowley. 1985. Issues and Techniques in Touch-sensitive Tablet Input. SIGGRAPH Comput. Graph. 19, 3 (July 1985), 215--224. Google ScholarDigital Library
- Xiang Cao, A. D. Wilson, R. Balakrishnan, K. Hinckley, and S. E. Hudson. 2008. ShapeTouch: Leveraging contact shape on interactive surfaces. In 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. 129--136.Google Scholar
- Xiang 'Anthony' Chen, Julia Schwarz, Chris Harrison, Jennifer Mankoff, and Scott E. Hudson. 2014. Air+Touch: Interweaving Touch & In-air Gestures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 519--525. Google ScholarDigital Library
- Sangwon Choi, Jaehyun Han, Geehyuk Lee, Narae Lee, and Woohun Lee. 2011. RemoteTouch: Touch-screen-like Interaction in the Tv Viewing Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 393--402. Google ScholarDigital Library
- Thomas R. Cox and Janine T. Erler. 2011. Remodeling and homeostasis of the extracellular matrix: implications for fibrotic diseases and cancer. Disease Models & Mechanisms 4, 2 (2011), 165--178.Google ScholarCross Ref
- James H. Dieterich. 1978. Time-dependent friction and the mechanics of stick-slip. pure and applied geophysics 116, 4 (01 Jul 1978), 790--806.Google Scholar
- Georg Essl, Michael Rohs, and Sven G Kratz. 2010. Use the Force (or something)-Pressure and Pressure-Like Input for Mobile Music Performance. In Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME 2010). 182--185.Google Scholar
- Anthony C Fischer-Cripps. 2000. Introduction to contact mechanics. Springer.Google Scholar
- Hyunjae Gil, DoYoung Lee, Seunggyu Im, and Ian Oakley. 2017. TriTap: Identifying Finger Touches on Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3879--3890. Google ScholarDigital Library
- Jiseong Gu, Seongkook Heo, Jaehyun Han, Sunjun Kim, and Geehyuk Lee. 2013. LongPad: A Touchpad Using the Entire Area Below the Keyboard of a Laptop Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1421--1430. Google ScholarDigital Library
- Anhong Guo, Robert Xiao, and Chris Harrison. 2015. CapAuth: Identifying and Differentiating User Handprints on Commodity Capacitive Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 59--62. Google ScholarDigital Library
- Aakar Gupta, Muhammed Anwar, and Ravin Balakrishnan. 2016. Porous Interfaces for Small Screen Multitasking Using Finger Identification. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 145--156. Google ScholarDigital Library
- Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 59--70. Google ScholarDigital Library
- Jaehyun Han and Geehyuk Lee. 2015. Transture: Continuing a Touch Gesture on a Small Screen into the Air. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1295--1300. Google ScholarDigital Library
- Chris Harrison and Scott Hudson. 2012. Using Shear As a Supplemental Two-dimensional Input Channel for Rich Touchscreen Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 3149--3152. Google ScholarDigital Library
- Chris Harrison, Munehiko Sato, and Ivan Poupyrev. 2012. Capacitive Fingerprinting: Exploring User Differentiation by Sensing Electrical Properties of the Human Body. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 537--544. Google ScholarDigital Library
- Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 627--636. Google ScholarDigital Library
- Chris Harrison, Robert Xiao, Julia Schwarz, and Scott E. Hudson. 2014. TouchTools: Leveraging Familiarity and Skill with Physical Tools to Augment Touch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2913--2916. Google ScholarDigital Library
- Seongkook Heo and Geehyuk Lee. 2011a. Force Gestures: Augmenting Touch Screen Gestures with Normal and Tangential Forces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 621--626. Google ScholarDigital Library
- Seongkook Heo and Geehyuk Lee. 2011b. Forcetap: Extending the Input Vocabulary of Mobile Touch Screens by Adding Tap Gestures. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 113--122. Google ScholarDigital Library
- Seongkook Heo and Geehyuk Lee. 2012. ForceDrag: Using Pressure As a Touch Input Modifier. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12). ACM, New York, NY, USA, 204--207. Google ScholarDigital Library
- Seongkook Heo and Geehyuk Lee. 2013. Indirect Shear Force Estimation for Multi-point Shear Force Operations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 281--284. Google ScholarDigital Library
- Heinrich Hertz. 1881. On the contact of elastic solids. J. Reine Angew Math. 92 (1881), 156--171.Google Scholar
- W. Daniel Hillis. 1982. A High-Resolution Imaging Touch Sensor. The International Journal of Robotics Research 1, 2 (1982), 33--44.Google ScholarCross Ref
- Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth, and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2869--2881. Google ScholarDigital Library
- Ken Hinckley and Hyunyoung Song. 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 801--810. Google ScholarDigital Library
- Christian Holz and Patrick Baudisch. 2013. Fiberio: A Touchscreen That Senses Fingerprints. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 41--50. Google ScholarDigital Library
- Christian Holz, Senaka Buthpitiya, and Marius Knaust. 2015. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3011--3014. Google ScholarDigital Library
- S.C. Hunter. 1957. Energy absorbed by elastic waves during impact. Journal of the Mechanics and Physics of Solids 5, 3 (1957), 162 -- 171.Google ScholarCross Ref
- Sungjae Hwang, Andrea Bianchi, and Kwang-yun Wohn. 2013. VibPress: Estimating Pressure Input Using Vibration Absorption on Mobile Devices. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 31--34. Google ScholarDigital Library
- Curt B. Irwin and Mary E. Sesto. 2012. Performance and touch characteristics of disabled and non-disabled participants during a reciprocal tapping task using touch screen technology. Applied Ergonomics 43, 6 (2012), 1038 -- 1043.Google ScholarCross Ref
- Kenneth Langstreth Johnson and Kenneth Langstreth Johnson. 1987. Contact mechanics. Cambridge university press. 84011346Google Scholar
- Ricardo Jota, Pedro Lopes, Daniel Wigdor, and Joaquim Jorge. 2014. Let's Kick It: How to Stop Wasting the Bottom Third of Your Large Screen Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1411--1414. Google ScholarDigital Library
- Dong-Ki Kim, Jong-Ho Kim, Hyun-Joon Kwon, and Young-Ha Kwon. 2010. A Touchpad for Force and Location Sensing. ETRI Journal 32, 5 (2010), 722--728.Google ScholarCross Ref
- Sunjun Kim, Byungjoo Lee, and Antti Oulasvirta. 2018. Impact Activation Improves Rapid Button Pressing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 571, 8 pages. Google ScholarDigital Library
- Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 321--333. Google ScholarDigital Library
- Nicholas LeCain. 2011. Tutorial of Hertzian Contact Stress Analysis. College of Optical Sciences, University of Arizona, Tucson, pp-1 to 6, 3 (2011).Google Scholar
- Byungjoo Lee and Antti Oulasvirta. 2016. Modelling Error Rates in Temporal Pointing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1857--1868. Google ScholarDigital Library
- Pedro Lopes, Ricardo Jota, and Joaquim A. Jorge. 2011. Augmenting Touch Interaction Through Acoustic Sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 53--56. Google ScholarDigital Library
- Giovanni Magenes. 1997. Tactile Sensors and Systems. In Human and Machine Perception. Springer, 87--107.Google Scholar
- Damien Masson, Alix Goguey, Sylvain Malacria, and Géry Casiez. 2017. WhichFingers: Identifying Fingers on Touch Surfaces and Keyboards Using Vibration Sensors. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 41--48. Google ScholarDigital Library
- Takashi Miyaki and Jun Rekimoto. 2009. GraspZoom: Zooming and Scrolling Control Model for Single-handed Mobile Interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 11, 4 pages. Google ScholarDigital Library
- Ian Oakley, Carina Lindahl, Khanh Le, DoYoung Lee, and MD. Rasel Islam. 2016. The Flat Finger: Exploring Area Touches on Smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4238--4249. Google ScholarDigital Library
- Lijia Pan, Alex Chortos, Guihua Yu, Yaqun Wang, Scott Isaacson, Ranulfo Allen, Yi Shi, Reinhold Dauskardt, and Zhenan Bao. 2014. An ultra-sensitive resistive pressure sensor based on hollow-sphere microstructure induced elasticity in conducting polymer film. Nature communications 5 (2014), 3002.Google Scholar
- Esben Warming Pedersen and Kasper Hornbæk. 2014. Expressive Touch: Studying Tapping Force on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 421--430. Google ScholarDigital Library
- Valentin L Popov. 2010. Contact mechanics and friction. Springer.Google Scholar
- Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 487--494. Google ScholarDigital Library
- Gonzalo A. Ramos and Ravin Balakrishnan. 2007. Pressure Marks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1375--1384. Google ScholarDigital Library
- J Reed. 1985. Energy losses due to elastic wave propagation during an elastic impact. Journal of Physics D: Applied Physics 18, 12 (1985), 2329. http://stacks.iop.org/0022--3727/18/i=12/a=004Google ScholarCross Ref
- Christian Rendl, Patrick Greindl, Kathrin Probst, Martin Behrens, and Michael Haller. 2014. Presstures: Exploring Pressure-sensitive Multi-touch Gestures on Trackpads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 431--434. Google ScholarDigital Library
- Ilya Rosenberg and Ken Perlin. 2009. The UnMousePad: An Interpolating Multi-touch Force-sensing Input Pad. ACM Trans. Graph. 28, 3, Article 65 (July 2009), 9 pages. Google ScholarDigital Library
- Quentin Roy, Yves Guiard, Gilles Bailly, Éric Lecolinet, and Olivier Rioul. 2015. GlassGoogle Scholar
- Skin: An Empirical Evaluation of the Added Value of Finger Identification to Basic Single-Touch Interaction on Touch Screens. In Human-Computer Interaction -- INTERACT 2015. Springer International Publishing.Google Scholar
- Sidharth Sahdev, Clifton Forlines, Ricardo Jota, Bruno De Araujo, Braon Moseley, Jonathan Deber, Steven Sanders, Darren Leigh, and Daniel Wigdor. 2017. GhostID: Enabling Non-Persistent User Differentiation in Frequency-Division Capacitive Multi-Touch Sensors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 15--27. Google ScholarDigital Library
- Samsung. 2016. What is Air View feature in Samsung Galaxy S4 (GT-I9500) (2016). http://www.samsung.com/in/support/skp/faq/871762.Google Scholar
- Dominik Schmidt, Ming Ki Chong, and Hans Gellersen. 2010. HandsDown: Hand-contour-based User Identification for Interactive Surfaces. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10). ACM, New York, NY, USA, 432--441. Google ScholarDigital Library
- Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection Using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2009--2012. Google ScholarDigital Library
- Elaine R. Serina, Eric Mockensturm, C.D. Mote, and David Rempel. 1998. A structural model of the forced compression of the fingertip pulp. Journal of Biomechanics 31, 7 (1998), 639 -- 646.Google ScholarCross Ref
- Synaptics. 2017. Synaptics Brings World's First In-Display Fingerprint Sensors for Smartphones to Mass Production with a Top Five OEM. (2017). https://www.synaptics.com/company/news/Clear-ID-mass-production.Google Scholar
- Youjiro Tamura, Ichiro Hatta, Takashi Matsuda, Haruo Sugi, and Teizo Tsuchiya. 1982. Changes in muscle stiffness during contraction recorded using ultrasonic waves. Nature 299, 5884 (1982), 631.Google Scholar
- Y. C. Tung and K. G. Shin. 2016. ForcePhone: Software Lets Smartphones Sense Touch Force. IEEE Pervasive Computing 15, 4 (Oct 2016), 20--25. Google ScholarDigital Library
- Feng Wang, Xiang Cao, Xiangshi Ren, and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-touch Surfaces. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 23--32. Google ScholarDigital Library
- Andrew M. Webb, Michel Pahud, Ken Hinckley, and Bill Buxton. 2016. Wearables As Context for Guiard-abiding Bimanual Touch. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 287--300. Google ScholarDigital Library
- David Wessel, Rimas Avizienis, Adrian Freed, and Matthew Wright. 2007. A Force Sensitive Multi-touch Array Supporting Multiple 2-D Musical Control Structures. In Proceedings of the 7th International Conference on New Interfaces for Musical Expression (NIME '07). ACM, New York, NY, USA, 41--45. Google ScholarDigital Library
- Daniel Wigdor, Hrvoje Benko, John Pella, Jarrod Lombardo, and Sarah Williams. 2011. Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1581--1590. Google ScholarDigital Library
- Andrew D. Wilson, Shahram Izadi, Otmar Hilliges, Armando Garcia-Mendoza, and David Kirk. 2008. Bringing Physics to the Surface. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 67--76. Google ScholarDigital Library
- Graham Wilson, Craig Stewart, and Stephen A. Brewster. 2010. Pressure-based Menu Selection for Mobile Devices. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 181--190. Google ScholarDigital Library
- Haijun Xia, Ricardo Jota, Benjamin McCanny, Zhe Yu, Clifton Forlines, Karan Singh, and Daniel Wigdor. 2014. Zero-latency Tapping: Using Hover Information to Predict Touch Locations and Eliminate Touchdown Latency. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 205--214. Google ScholarDigital Library
- Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 47--50. Google ScholarDigital Library
Index Terms
- FDSense: Estimating Young's Modulus and Stiffness of End Effectors to Facilitate Kinetic Interaction on Touch Surfaces
Recommendations
MaterialSense: Estimating and utilizing material properties of contact objects in multi-touch interaction
AbstractIn today’s digital art applications, users can play virtual musical instruments or paint on virtual canvas using multi-touch input. Existing touch input devices, however, do not consider that the result of artistic expression changes ...
Highlights- We propose a novel method called MaterialSense that estimates the material properties of objects (i.e., stiffness and friction coefficient) in contact with a ...
Influence of Front Double Wishbone Independent Suspension Performance on Front Rubber Bushing Stiffness of Lower Control Arm
ICMTMA '10: Proceedings of the 2010 International Conference on Measuring Technology and Mechatronics Automation - Volume 02Front double wishbone independent suspension is built according to hard point parameters of a car. After the rubber bushing stiffness of lower control arm is changed, the suspension performance is analyzed and discussed with multi-body dynamics and ...
Performance Analysis of Rear Rubber Bushing Stiffness of Lower Control Arm on Front Double Wishbone Independent Suspension
ICCMS '10: Proceedings of the 2010 Second International Conference on Computer Modeling and Simulation - Volume 04Front double wishbone independent suspension is built according to hard point parameters of a car. After the rubber bushing stiffness of under arm is changed, the suspension performance is analyzed and discussed with multi-body dynamics and Suspension ...
Comments