research-article

Fl.UIs: Liquid-Mediated Vision Based Touch Surfaces

Authors:

Eric PaulosAuthors Info & Claims

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 85 - 88

https://doi.org/10.1145/2677199.2680604

Published: 15 January 2015 Publication History

Abstract

Fluid User Interfaces (Fl.UIs) are liquid-based touch surfaces that use computer vision to detect and interpret a range of tactile user inputs. While Fl.UIs have less input resolution than digital touch screens, they provide an excellent low-cost solution for rapidly prototyping non-rectilinear screen designs as well as exploring novel surface interaction techniques. Fabricated on a laser cutter using low-cost materials, Fl.UIs use unique shape outlines to displace an internal colored liquid to regions-of-interest for a camera. This paper presents a set of software tools that help users rapidly design, fabricate and author interactions with Fl.UIs. The robust construction and an unpowered surface makes Fl.UIs well-suited for outdoor and public installations. Our Fl.UIs prototyping tool encourages these uncommon "screens" to emerge in complex environments (i.e. urban spaces, benches, tables, fountains, sidewalks).

Supplementary Material

suppl.mov (tei0333.mp4)

Supplemental video

Download
36.06 MB

MP4 File (p85.mp4)

Download
76.95 MB

References

[1]

Bränzel, A., Holz, C., Hoffmann, D., Schmidt, D., Knaust, M., Läuhne, P., Meusel, R., Richter, S., and Baudisch, P. Gravityspace: Tracking users and their poses in a smart room using a pressure-sensing floor. In CHI '13, ACM Press (2013), 725--734.

Digital Library

[2]

Follmer, S., Johnson, M., Adelson, E., and Ishii, H. deForm: An interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch. In UIST '11, ACM Press (2011), 527--536.

Digital Library

[3]

Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05, ACM Press (2005), 115--118.

Digital Library

[4]

Harrison, C., and Hudson, S. E. Providing dynamically changeable physical buttons on a visual display. In CHI '09, ACM Press (2009), 299--308.

Digital Library

[5]

Hartmann, B., and Wright, P. K. Designing bespoke interactive devices. Computer 46, 8 (2013), 85--89.

Digital Library

[6]

Hennecke, F., Berwein, F., and Butz, A. Optical pressure sensing for tangible user interfaces. In Proc. ITS '11, ACM Press (2011), 45--48.

Digital Library

[7]

Hilliges, O., Kim, D., and Izadi, S. Creating malleable interactive surfaces using liquid displacement sensing. In Proc. Tabletop 2008, IEEE Press (2008), 157160.

[8]

Jansen, Y. Mudpad: fluid haptics for multitouch surfaces. In Extended Abstracts of CHI '10, ACM (2010), 43514356.

Digital Library

[9]

Lehni, J., and Puckey, J. Paper.js, 2011.

[10]

Matsushita, N., and Rekimoto, J. HoloWall: designing a finger, hand, body, and object sensitive wall. In UIST '97, ACM Press (1997), 209--210.

Digital Library

[11]

Maynes-Aminzade, D., Winograd, T., and Igarashi, T. Eyepatch: prototyping camera-based interaction through examples. In UIST '07, ACM Press (2007), 33--42.

Digital Library

[12]

Moeller, J., and Kerne, A. Zerotouch: An optical multi-touch and free-air interaction architecture. In CHI '12, ACM Press (2012), 2165--2174.

Digital Library

[13]

Murugappan, S., Vinayak, Elmqvist, N., and Ramani, K. Extended multitouch: Recovering touch posture and differentiating users using a depth camera. In UIST '12, ACM Press (2012), 487--496.

Digital Library

[14]

Swain, M. J., and Ballard, D. H. Color indexing. Int'l J. Computer Vision '91, 1 (1991), 1132.

Digital Library

[15]

Sylvester, A., Dring, T., and Schmidt, A. Liquids, smoke, and soap bubbles: reflections on materials for ephemeral user interfaces. In TEI '10, ACM (2010), 269--270.

Digital Library

Cited By

Lee YLee C(2024)ICY Interfaces: Exploration of Ice’s Ephemeral Features for Digital Game User ExperienceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660725(2107-2124)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660725
Mueller FMontoya MPell SOppermann LBlythe MDietz PMarshall JBateman SSmith IAnanthanarayan SMazalek AVerni ABakogeorge ASimonnet MEllis KSemertzidis NBurleson WQuarles JMann SHill CClashing CElvitigala D(2024)Grand challenges in WaterHCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642052(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642052
Clashing CSmith IMontoya MPatibanda RAnanthanarayan SPell SMueller F(2022)Going into Depth: Learning from a Survey of Interactive Designs for Aquatic RecreationProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533543(1119-1132)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533543
Show More Cited By

Index Terms

Fl.UIs: Liquid-Mediated Vision Based Touch Surfaces
1. Human-centered computing

Recommendations

PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Tangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
PERCs Demo: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

Tangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
reacTIVision and TUIO: a tangible tabletop toolkit
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

This article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 2015

766 pages

ISBN:9781450333054

DOI:10.1145/2677199

Conference Chairs:
Bill Verplank
Stanford University, USA
,
Wendy Ju
Stanford University, USA
,
Program Chairs:
Alissa Antle
Simon Fraser University, Canada
,
Ali Mazalek
Georgia Institute of Technology, USA
,
Florian "Floyd" Mueller
RMIT, Australia

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 January 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Adobe
NSF

Conference

TEI '15

Sponsor:

SIGCHI

TEI '15: Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 15 - 19, 2015

California, Stanford, USA

Acceptance Rates

TEI '15 Paper Acceptance Rate 63 of 222 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
443
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee YLee C(2024)ICY Interfaces: Exploration of Ice’s Ephemeral Features for Digital Game User ExperienceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660725(2107-2124)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660725
Mueller FMontoya MPell SOppermann LBlythe MDietz PMarshall JBateman SSmith IAnanthanarayan SMazalek AVerni ABakogeorge ASimonnet MEllis KSemertzidis NBurleson WQuarles JMann SHill CClashing CElvitigala D(2024)Grand challenges in WaterHCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642052(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642052
Clashing CSmith IMontoya MPatibanda RAnanthanarayan SPell SMueller F(2022)Going into Depth: Learning from a Survey of Interactive Designs for Aquatic RecreationProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533543(1119-1132)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533543
Wang YLuo SGong HXu FChen RLiu SHansen PMandryk RHancock MPerry MCox A(2018)SKIN+Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3188443(1-6)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3188443
Sturdee MAlexander J(2018)Analysis and Classification of Shape-Changing Interfaces for Design and Application-based ResearchACM Computing Surveys10.1145/314355951:1(1-32)Online publication date: 4-Jan-2018
https://dl.acm.org/doi/10.1145/3143559
Häkkilä JColley ABjörk SEriksson EFjeld MBødker SBarendregt WObaid M(2016)Towards a Design Space for Liquid User InterfacesProceedings of the 9th Nordic Conference on Human-Computer Interaction10.1145/2971485.2971537(1-4)Online publication date: 23-Oct-2016
https://dl.acm.org/doi/10.1145/2971485.2971537
Raffe WTamassia MZambetta FLi XPell SMueller FCox ACairns PBernhaupt RNacke L(2015)Player-Computer Interaction Features for Designing Digital Play Experiences across Six Degrees of Water ContactProceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play10.1145/2793107.2793134(295-305)Online publication date: 5-Oct-2015
https://dl.acm.org/doi/10.1145/2793107.2793134

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten