Brice Parilusyan
Marcos Serrano
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Ubiquitous touch sensing surfaces are largely influenced by touchscreens' look and feel and fail to express the physical richness of existing surrounding materials. We introduce Sensurfaces, a plug-and-play electronic module that allows to rapidly experiment with touch-sensitive surfaces while preserving the original appearance of materials. Sensurfaces is composed of plug-and-play modules that can be connected together to expand the size and number of materials composing a sensitive surface. The combination of Sensurfaces modules allows the creation of small or large multi-material sensitive surfaces that can detect multi-touch but also body proximity, pose, pass, or even human steps. In this paper, we present the design and implementation of Sensurfaces. We propose a design space describing the factors of Sensurfaces interfaces. Then, through a series of technical evaluations, we demonstrate the capabilities of our system. Finally, we report on two workshops validating the usability of our system.
Supplemental Material
Available for Download
zip
parilusyan.zip (148.7 MB)
Supplemental movie, appendix, image and software files for, Sensurfaces: A Novel Approach for Embedded Touch Sensing on Everyday Surfaces
- Rochelle Ackerley, Karin Saar, Francis McGlone, and Helena Backlund Wasling. 2014. Quantifying the sensory and emotional perception of touch: differences between glabrous and hairy skin. Frontiers in behavioral neuroscience 8 (2014), 34.Google Scholar
- Roland Aigner, Andreas Pointner, Thomas Preindl, Patrick Parzer, and Michael Haller. 2020. Embroidered resistive pressure sensors: A novel approach for textile interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Ayah Bdeir. 2009. Electronics as material: littleBits. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. 397--400.Google ScholarDigital Library
- Alan Bränzel, Christian Holz, Daniel Hoffmann, Dominik Schmidt, Marius Knaust, Patrick Lühne, René Meusel, Stephan Richter, and Patrick Baudisch. 2013. GravitySpace: tracking users and their poses in a smart room using a pressure-sensing floor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 725--734.Google ScholarDigital Library
- Jesse Burstyn, Nicholas Fellion, Paul Strohmeier, and Roel Vertegaal. 2015. Printput: Resistive and capacitive input widgets for interactive 3D prints. In IFIP Conference on Human-Computer Interaction. Springer, 332--339.Google ScholarDigital Library
- Tingyu Cheng, Bu Li, Yang Zhang, Yunzhi Li, Charles Ramey, Eui Min Jung, Yepu Cui, Sai Ganesh Swaminathan, Youngwook Do, Manos Tentzeris, et al. 2021. Duco: Autonomous Large-Scale Direct-Circuit-Writing (DCW) on Vertical Everyday Surfaces Using A Scalable Hanging Plotter. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--25.Google ScholarDigital Library
- Sara Colantonio, Giuseppe Coppini, Danila Germanese, Daniela Giorgi, Massimo Magrini, Paolo Marraccini, Massimo Martinelli, Maria Aurora Morales, Maria Antonietta Pascali, Giovanni Raccichini, et al. 2015. A smart mirror to promote a healthy lifestyle. Biosystems Engineering 138 (2015), 33--43.Google ScholarCross Ref
- Artem Dementyev, Hsin-Liu Kao, and Joseph A Paradiso. 2015. Sensortape: Modular and programmable 3d-aware dense sensor network on a tape. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 649--658.Google ScholarDigital Library
- Timothy J Denison. 2011. Capacitive interface circuit for low power sensor system. US Patent 8,000,789.Google Scholar
- Nathaniel Faulkner, Baden Parr, Fakhrul Alam, Mathew Legg, and Serge Demidenko. 2020. CapLoc: Capacitive Sensing Floor for Device-Free Localization and Fall Detection. IEEE Access 8 (2020), 187353--187364.Google ScholarCross Ref
- Jun Gong, Aakar Gupta, and Hrvoje Benko. 2020. Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 406--419.Google ScholarDigital Library
- Nan-Wei Gong, Steve Hodges, and Joseph A Paradiso. 2011. Leveraging conductive inkjet technology to build a scalable and versatile surface for ubiquitous sensing. In Proceedings of the 13th international conference on Ubiquitous computing. 45--54.Google ScholarDigital Library
- Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology. 209--218.Google ScholarDigital Library
- Chris Harrison, Hrvoje Benko, and Andrew D Wilson. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 441--450.Google ScholarDigital Library
- Cedric Honnet, Hannah Perner-Wilson, Marc Teyssier, Bruno Fruchard, Jürgen Steimle, Ana C Baptista, and Paul Strohmeier. 2020. PolySense: Augmenting Textiles with Electrical Functionality using In-Situ Polymerization. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Brett R Jones, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. 2013. IllumiRoom: peripheral projected illusions for interactive experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 869--878.Google ScholarDigital Library
- Runchang Kang, Anhong Guo, Gierad Laput, Yang Li, and Xiang'Anthony' Chen. 2019. Minuet: Multimodal interaction with an Internet of Things. In Symposium on Spatial User Interaction. 1--10.Google ScholarDigital Library
- B.R. Mehta and Y.J. Reddy. 2015. Chapter 9 - Serial communications. In Industrial Process Automation Systems, B.R. Mehta and Y.J. Reddy (Eds.). Butterworth-Heinemann, Oxford, 307--339. https://doi.org/10.1016/B978-0-12-800939-0.00009-7Google Scholar
- David Merrill and Pattie Maes. 2007. Augmenting looking, pointing and reaching gestures to enhance the searching and browsing of physical objects. In International Conference on Pervasive Computing. Springer, 1--18.Google ScholarCross Ref
- Behram FT Mistree and Joseph A Paradiso. 2010. ChainMail: a configurable multimodal lining to enable sensate surfaces and interactive objects. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 65--72.Google ScholarDigital Library
- Steven Nagels, Raf Ramakers, Kris Luyten, and Wim Deferme. 2018. Silicone devices: A scalable DIY approach for fabricating self-contained multi-layered soft circuits using microfluidics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Ken Nakagaki, Sean Follmer, and Hiroshi Ishii. 2015. Lineform: Actuated curve interfaces for display, interaction, and constraint. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 333--339.Google ScholarDigital Library
- Simon Olberding, Nan-Wei Gong, John Tiab, Joseph A Paradiso, and Jürgen Steimle. 2013. A cuttable multi-touch sensor. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 245--254.Google ScholarDigital Library
- Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable touch-sensitive lighted cords using spiraling, repeating sensing textiles and fiber optics. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 485--497.Google ScholarDigital Library
- Joseph A Paradiso, Kai-yuh Hsiao, Joshua Strickon, Joshua Lifton, and Ari Adler. 2000. Sensor systems for interactive surfaces. IBM Systems Journal 39, 3.4 (2000), 892--914.Google ScholarDigital Library
- Joseph A Paradiso, Che King Leo, Nisha Checka, and Kaijen Hsiao. 2002. Passive acoustic sensing for tracking knocks atop large interactive displays. In SENSORS, 2002 IEEE, Vol. 1. IEEE, 521--527.Google Scholar
- Amanda Parkes and Hiroshi Ishii. 2010. Bosu: a physical programmable design tool for transformability with soft mechanics. In Proceedings of the 8th ACM Conference on Designing Interactive Systems. 189--198.Google ScholarDigital Library
- Shwetak N Patel, Jun Rekimoto, and Gregory D Abowd. 2006. icam: Precise at-a-distance interaction in the physical environment. In International Conference on Pervasive Computing. Springer, 272--287.Google ScholarDigital Library
- JH Pikul, S Li, H Bai, RT Hanlon, I Cohen, and RF Shepherd. 2017. Stretchable surfaces with programmable 3D texture morphing for synthetic camouflaging skins. Science 358, 6360 (2017), 210--214.Google Scholar
- Narjes Pourjafarian, Anusha Withana, Joseph A Paradiso, and Jürgen Steimle. 2019. Multi-Touch Kit: A Do-It-Yourself Technique for Capacitive Multi-Touch Sensing Using a Commodity Microcontroller. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 1071--1083.Google ScholarDigital Library
- Hayes Solos Raffle, Amanda J Parkes, and Hiroshi Ishii. 2004. Topobo: a constructive assembly system with kinetic memory. In Proceedings of the SIGCHI conference on Human factors in computing systems. 647--654.Google ScholarDigital Library
- Jun Rekimoto. 2002. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 113--120.Google ScholarDigital Library
- Jun Rekimoto and Nobuyuki Matsushita. 1997. Perceptual surfaces: Towards a human and object sensitive interactive display. In Workshop on Perceptual User Interfaces (PUI'97). 30--32.Google Scholar
- Jun Rekimoto, Brygg Ullmer, and Haruo Oba. 2001. DataTiles: a modular platform for mixed physical and graphical interactions. In Proceedings of the SIGCHI conference on Human factors in computing systems. 269--276.Google ScholarDigital Library
- Bruce Richardson, Krispin Leydon, Mikael Fernstrom, and Joseph A Paradiso. 2004. Z-Tiles: building blocks for modular, pressure-sensing floorspaces. In CHI'04 extended abstracts on Human factors in computing systems. 1529--1532.Google ScholarDigital Library
- Silvia Rus, Tobias Grosse-Puppendahl, and Arjan Kuijper. 2014. Recognition of bed postures using mutual capacitance sensing. In European Conference on Ambient Intelligence. Springer, 51--66.Google ScholarDigital Library
- Muhamad Risqi Utama Saputra, Guntur Dharma Putra, Paulus Insap Santosa, et al. 2012. Indoor human tracking application using multiple depth-cameras. In 2012 International Conference on Advanced Computer Science and Information Systems (ICACSIS). IEEE, 307--312.Google Scholar
- Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 483--492.Google ScholarDigital Library
- Renan Serra, Dominique Knittel, Pascal Di Croce, and Richard Peres. 2016. Activity recognition with smart polymer floor sensor: Application to human footstep recognition. IEEE Sensors Journal 16, 14 (2016), 5757--5775.Google ScholarCross Ref
- Joshua Smith, Tom White, Christopher Dodge, Joseph Paradiso, Neil Gershenfeld, and David Allport. 1998. Electric field sensing for graphical interfaces. IEEE Computer Graphics and Applications 18, 3 (1998), 54--60.Google ScholarDigital Library
- Smooth-On. 2021. Dragon Skin silicone. https://www.smooth-on.com/products/dragon-skin-10-fast/Google Scholar
- Smooth-On. 2021. Task-4 Liquid polyurethane casting resin. https://www.smooth-on.com/products/task-4/Google Scholar
- Mahmoud Tavakoli, Pedro Lopes, Joao Lourenco, Rui Pedro Rocha, Luana Giliberto, Anibal T de Almeida, and Carmel Majidi. 2017. Autonomous selection of closing posture of a robotic hand through embodied soft matter capacitive sensors. IEEE Sensors Journal 17, 17 (2017), 5669--5677.Google ScholarCross Ref
- Shan-Yuan Teng, Da-Yuan Huang, Chi Wang, Jun Gong, Teddy Seyed, Xing-Dong Yang, and Bing-Yu Chen. 2019. Aarnio: passive kinesthetic force output for foreground interactions on an interactive chair. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Marc Teyssier, Gilles Bailly, Catherine Pelachaud, Eric Lecolinet, Andrew Conn, and Anne Roudaut. 2019. Skin-On Interfaces: A Bio-Driven Approach for Artificial Skin Design to Cover Interactive Devices. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 307--322.Google ScholarDigital Library
- Tibtech. 2019. DATASTRETCH. https://www.tibtech.com/smartshop/index.php?id_product=157&controller=product&id_lang=1Google Scholar
- Miika Valtonen, Jaakko Maentausta, and Jukka Vanhala. 2009. Tiletrack: Capacitive human tracking using floor tiles. In 2009 IEEE international conference on pervasive computing and communications. IEEE, 1--10.Google ScholarDigital Library
- Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui-Shyong Yeo, William Field, and Haiyan Zhang. 2018. Project zanzibar: A portable and flexible tangible interaction platform. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Anandghan Waghmare, Qiuyue Xue, Dingtian Zhang, Yuhui Zhao, Shivan Mittal, Nivedita Arora, Ceara Byrne, Thad Starner, and Gregory D Abowd. 2020. UbiquiTouch: Self sustaining ubiquitous touch interfaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--22.Google ScholarDigital Library
- Ryoichi Watanabe, Yuichi Itoh, Masatsugu Asai, Yoshifumi Kitamura, Fumio Kishino, and Hideo Kikuchi. 2004. The soul of ActiveCube: implementing a flexible, multimodal, three-dimensional spatial tangible interface. Computers in Entertainment (CIE) 2, 4 (2004), 15--15.Google ScholarDigital Library
- Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2991--3000.Google ScholarDigital Library
- Mark Weiser. 1993. Hot topics-ubiquitous computing. Computer 26, 10 (1993), 71--72.Google ScholarDigital Library
- Michael Wessely, Ticha Sethapakdi, Carlos Castillo, Jackson C Snowden, Ollie Hanton, Isabel PS Qamar, Mike Fraser, Anne Roudaut, and Stefanie Mueller. 2020. Sprayable User Interfaces: Prototyping Large-Scale Interactive Surfaces with Sensors and Displays. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--12.Google ScholarDigital Library
- Michael Wessely, Theophanis Tsandilas, and Wendy E Mackay. 2016. Stretchis: Fabricating highly stretchable user interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 697--704.Google ScholarDigital Library
- Irmandy Wicaksono, Elena Kodama, Artem Dementyev, and Joseph A Paradiso. 2020. SensorNets: Towards Reconfigurable Multifunctional Fine-grained Soft and Stretchable Electronic Skins. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--8.Google Scholar
- Andrew D Wilson. 2010. Using a depth camera as a touch sensor. In ACM international conference on interactive tabletops and surfaces. 69--72.Google ScholarDigital Library
- Te-Yen Wu, Lu Tan, Yuji Zhang, Teddy Seyed, and Xing-Dong Yang. 2020. Capacitivo: Contact-Based Object Recognition on Interactive Fabrics using Capacitive Sensing. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 649--661.Google ScholarDigital Library
- Sang Ho Yoon, Ke Huo, Yunbo Zhang, Guiming Chen, Luis Paredes, Subramanian Chidambaram, and Karthik Ramani. 2017. iSoft: a customizable soft sensor with real-time continuous contact and stretching sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 665--678.Google ScholarDigital Library
- Yang Zhang and Chris Harrison. 2018. Pulp nonfiction: Low-cost touch tracking for paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--11.Google ScholarDigital Library
- Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-cost touch sensing using electric field tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarDigital Library
- Yang Zhang, Chouchang Yang, Scott E Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++ room-scale interactive and context-aware sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--15.Google ScholarDigital Library
- Jieming Zhu, Xuecai Gao, Yucang Yang, Hang Li, Zhati Ai, and Xiaoyan Cui. 2010. Developing a voice control system for zigbee-based home automation networks. In 2010 2nd IEEE InternationalConference on Network Infrastructure and Digital Content. IEEE, 737--741.Google Scholar
Index Terms
- Sensurfaces: A Novel Approach for Embedded Touch Sensing on Everyday Surfaces
Recommendations
Interaction Techniques Using a Spherical Cursor for 3D Targets Acquisition and Indicating in Volumetric Displays
IV '09: Proceedings of the 2009 13th International Conference Information VisualisationWe present several innovative interaction techniques for 3D target acquisition and indication.These techniques make use of the shape of our cylindrical multi-touch interface, which we are developing as an interface for a volumetric display.Our ...
Browsing 3D Media Using Cylindrical Multi-touch Interface
ISM '08: Proceedings of the 2008 Tenth IEEE International Symposium on MultimediaWe describe interaction techniques for browsing 3D media using our cylindrical multi-touch interface (CMTI). CMTI uses a cylinder wall as its controlling surface. Because the control area of the interface is in cylindrical polar coordinates, the use of ...
On the criteria to be used in decomposing systems into modules
Software pioneersThis paper discusses modularization as a mechanism for improving the flexibility and comprehensibility of a system while allowing the shortening of its development time. The effectiveness of a "modularization" is dependent upon the criteria used in ...
Comments