Amani Alkayyali
Yasha Iravantchi
Jaylin Herskovitz
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Pervasive and interactive displays promise to present our digital content seamlessly throughout our environment. However, traditional display technologies do not scale to room-wide applications due to high per-unit-area costs and the need for constant wired power and data infrastructure. This research proposes the use of photochromic paint as a display medium. Applying the paint to any surface or object creates ultra-low-cost displays, which can change color when exposed to specific wavelengths of light. We develop new paint formulations that enable wide area application of photochromic material. Along with a specially modified wide-area laser projector and depth camera that can draw custom images and create on-demand, room-wide user interfaces on photochromic enabled surfaces. System parameters such as light intensity, material activation time, and user readability are examined to optimize the display. Results show that images and user interfaces can last up to 16 minutes and can be updated indefinitely. Finally, usage scenarios such as displaying static and dynamic images, ephemeral notifications, and the creation of on-demand interfaces, such as light switches and music controllers, are demonstrated and explored. Ultimately, the UbiChromics system demonstrates the possibility of extending digital content to all painted surfaces.
Supplemental Material
- Nivedita Arora, Steven L. Zhang, Fereshteh Shahmiri, Diego Osorio, Yi-Cheng Wang, Mohit Gupta, Zhengjun Wang, Thad Starner, Zhong Lin Wang, and Gregory D. Abowd. 2018. SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2, 2 (2018), Article 60, July, 28 pages. issn:2474-9567 https://doi.org/10.1145/3214263
Google Scholar
Digital Library
- Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, and Matthias Grundmann. 2020. BlazePose: On-device Real-time Body Pose tracking. CoRR, abs/2006.10204 (2020), https://doi.org/10.48550/ARXIV.2006.10204 arXiv:2006.10204.
Google Scholar
- Hrvoje Benko, Ricardo Jota, and Andrew Wilson. 2012. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA. 199–208. isbn:978-1-4503-1015-4 https://doi.org/10.1145/2207676.2207704
Google ScholarDigital Library
- Johanna Brewer, Amanda Williams, and Paul Dourish. 2007. A Handle on What’s Going on: Combining Tangible Interfaces and Ambient Displays for Collaborative Groups. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI ’07). ACM, New York, NY, USA. 3–10. isbn:978-1-59593-619-6 https://doi.org/10.1145/1226969.1226971
Google ScholarDigital Library
- Andrew Dahley, Craig Wisneski, and Hiroshi Ishii. 1998. Water Lamp and Pinwheels: Ambient Projection of Digital Information into Architectural Space. In CHI 98 Conference Summary on Human Factors in Computing Systems (CHI ’98). Association for Computing Machinery, New York, NY, USA. 269–270. isbn:1581130287 https://doi.org/10.1145/286498.286750
Google ScholarDigital Library
- Paul H. Dietz, Benjamin Eidelson, Jonathan Westhues, and Steven Bathiche. 2009. A Practical Pressure Sensitive Computer Keyboard. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’09). ACM, New York, NY, USA. 55–58. isbn:978-1-60558-745-5 https://doi.org/10.1145/1622176.1622187
Google ScholarDigital Library
- Marinella Ferrara and Murat Bengisu. 2014. Materials that Change Color (first ed.). Springer Nature. https://doi.org/10.1007/978-3-319-00290-3
Google ScholarCross Ref
- Hackaday. 2018. Drawing Lines In The Sand: Taking Beach Graffiti To The Next Level. Website. Retrieved November 15, 2019 from https://hackaday.com/2018/07/03/drawing-lines-in-the-sand-taking-beach-graffiti-to-the-next-level/
Google Scholar
- Jefferson Y. Han. 2005. Low-cost Multi-touch Sensing Through Frustrated Total Internal Reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST ’05). ACM, New York, NY, USA. 115–118. isbn:1-59593-271-2 https://doi.org/10.1145/1095034.1095054
Google ScholarDigital Library
- Tomoko Hashida, Yasuaki Kakehi, and Takeshi Naemura. 2010. Photochromic Canvas Drawing with Patterned Light. In ACM SIGGRAPH 2010 Posters (SIGGRAPH ’10). ACM, New York, NY, USA. Article 26, 1 pages. isbn:978-1-4503-0393-4 https://doi.org/10.1145/1836845.1836873
Google ScholarDigital Library
- Tomoko Hashida, Yasuaki Kakehi, and Takeshi Naemura. 2011. Photochromic Sculpture: Volumetric Color-forming Pixels. In ACM SIGGRAPH 2011 Emerging Technologies (SIGGRAPH ’11). ACM, New York, NY, USA. Article 11, 1 pages. isbn:978-1-4503-0969-1 https://doi.org/10.1145/2048259.2048270
Google ScholarDigital Library
- Tomoko Hashida, Yasuaki Kakehi, and Takeshi Naemura. 2011. SolaColor: Space Coloration with Solar Light. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’11). ACM, New York, NY, USA. 417–418. isbn:978-1-4503-0478-8 https://doi.org/10.1145/1935701.1935808
Google ScholarDigital Library
- Tomoko Hashida, Kohei NIshimura, and Takeshi Naemura. 2012. Hand-rewriting: Automatic Rewriting Similar to Natural Handwriting. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS ’12). ACM, New York, NY, USA. 153–162. isbn:978-1-4503-1209-7 https://doi.org/10.1145/2396636.2396660
Google ScholarDigital Library
- Jeremy M. Heiner, Scott E. Hudson, and Kenichiro Tanaka. 1999. The Information Percolator: Ambient Information Display in a Decorative Object. In Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology (UIST ’99). ACM, New York, NY, USA. 141–148. isbn:1-58113-075-9 https://doi.org/10.1145/320719.322595
Google ScholarDigital Library
- Christian Holz and Patrick Baudisch. 2013. Fiberio: A Touchscreen That Senses Fingerprints. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST ’13). ACM, New York, NY, USA. 41–50. isbn:978-1-4503-2268-3 https://doi.org/10.1145/2501988.2502021
Google ScholarDigital Library
- Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI ’97). ACM, New York, NY, USA. 234–241. isbn:0-89791-802-9 https://doi.org/10.1145/258549.258715
Google ScholarDigital Library
- Yuhua Jin, Isabel Qamar, Michael Wessely, Aradhana Adhikari, Katarina Bulovic, Parinya Punpongsanon, and Stefanie Mueller. 2019. Photo-Chromeleon: Re-Programmable Multi-Color Textures Using Photochromic Dyes. In Proceedings of the 32Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). ACM, New York, NY, USA. 701–712. isbn:978-1-4503-6816-2 https://doi.org/10.1145/3332165.3347905
Google ScholarDigital Library
- Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST ’14). ACM, New York, NY, USA. 637–644. isbn:978-1-4503-3069-5 https://doi.org/10.1145/2642918.2647383
Google ScholarDigital Library
- Tatsuya Kaihou and Akira Wakita. 2013. Electronic Origami with the Color-Changing Function. In Proceedings of the Second International Workshop on Smart Material Interfaces: Another Step to a Material Future (SMI ’13). Association for Computing Machinery, New York, NY, USA. 7–12. isbn:9781450325622 https://doi.org/10.1145/2534688.2534690
Google ScholarDigital Library
- Hsin-Liu (Cindy) Kao, Manisha Mohan, Chris Schmandt, Joseph A. Paradiso, and Katia Vega. 2016. ChromoSkin: Towards Interactive Cosmetics Using Thermochromic Pigments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). Association for Computing Machinery, New York, NY, USA. 3703–3706. isbn:9781450340823 https://doi.org/10.1145/2851581.2890270
Google ScholarDigital Library
- Jun Kato, Daisuke Sakamoto, and Takeo Igarashi. 2010. Surfboard: Keyboard with Microphone As a Low-cost Interactive Surface. In Adjunct Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’10). ACM, New York, NY, USA. 387–388. isbn:978-1-4503-0462-7 https://doi.org/10.1145/1866218.1866233
Google ScholarDigital Library
- Norihisa Kobayashi. 2015. Handbook of Visual Display Technology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35947-7
Google ScholarCross Ref
- Liyu Liu, Suili Peng, Weijia Wen, and Ping Sheng. 2007. Paperlike thermochromic display. Applied Physics Letters, 90, 21 (2007), 213508. https://doi.org/10.1063/1.2742781
Google ScholarCross Ref
- K. Maegawa, T. Shiotani, K. Iwamoto, T. Noguchi, M. Kasetani, and J. Lee. 2013. Ubiquitous display 2.0: Development of new prototype and software modules for improvement. In 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI). 102–107. https://doi.org/10.1109/URAI.2013.6677483
Google ScholarCross Ref
- Nobuyuki Matsushita and Jun Rekimoto. 1997. HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST ’97). ACM, New York, NY, USA. 209–210. isbn:0-89791-881-9 https://doi.org/10.1145/263407.263549
Google ScholarDigital Library
- Andrii Matviienko, Sebastian Horwege, Lennart Frick, Christoph Ressel, and Susanne Boll. 2016. CubeLendar: Design of a Tangible Interactive Event Awareness Cube. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). ACM, New York, NY, USA. 2601–2608. isbn:978-1-4503-4082-3 https://doi.org/10.1145/2851581.2892278
Google ScholarDigital Library
- Yoichi Ochiai, Takayuki Hoshi, and Jun Rekimoto. 2014. Pixie Dust: Graphics Generated by Levitated and Animated Objects in Computational Acoustic-potential Field. ACM Trans. Graph., 33, 4 (2014), Article 85, July, 13 pages. issn:0730-0301 https://doi.org/10.1145/2601097.2601118
Google ScholarDigital Library
- Peter Peltonen, Esko Kurvinen, Antti Salovaara, Giulio Jacucci, Tommi Ilmonen, John Evans, Antti Oulasvirta, and Petri Saarikko. 2008. It’s Mine, Don’T Touch!: Interactions at a Large Multi-touch Display in a City Centre. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). ACM, New York, NY, USA. 1285–1294. isbn:978-1-60558-011-1 https://doi.org/10.1145/1357054.1357255
Google ScholarDigital Library
- Thiago Pereira, Szymon Rusinkiewicz, and Wojciech Matusik. 2014. Computational Light Routing: 3D Printed Optical Fibers for Sensing and Display. ACM Trans. Graph., 33, 3 (2014), Article 24, June, 13 pages. issn:0730-0301 https://doi.org/10.1145/2602140
Google ScholarDigital Library
- Pallets Projects. 2021. Flask. https://palletsprojects.com/p/flask/
Google Scholar
- Parinya Punpongsanon, Xin Wen, David S. Kim, and Stefanie Mueller. 2018. ColorMod: Recoloring 3D Printed Objects Using Photochromic Inks. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA. Article 213, 12 pages. isbn:978-1-4503-5620-6 https://doi.org/10.1145/3173574.3173787
Google ScholarDigital Library
- Ismo Rakkolainen, Stephen DiVerdi, Alex Olwal, Nicola Candussi, Tobias Hüllerer, Markku Laitinen, Mika Piirto, and Karri Palovuori. 2005. The Interactive FogScreen. In ACM SIGGRAPH 2005 Emerging Technologies (SIGGRAPH ’05). ACM, New York, NY, USA. Article 8, https://doi.org/10.1145/1187297.1187306
Google ScholarDigital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’99). ACM, New York, NY, USA. 378–385. isbn:0-201-48559-1 https://doi.org/10.1145/302979.303113
Google ScholarDigital Library
- Jan Riemann, Martin Schmitz, Alexander Hendrich, and Max Mühlhäuser. 2018. FlowPut: Environment-Aware Interactivity for Tangible 3D Objects. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2, 1 (2018), Article 31, March, 23 pages. issn:2474-9567 https://doi.org/10.1145/3191763
Google ScholarDigital Library
- Daniel Saakes, Kevin Chiu, Tyler Hutchison, Biyeun M. Buczyk, Naoya Koizumi, Masahiko Inami, and Ramesh Raskar. 2010. Slow Display. In ACM SIGGRAPH 2010 Emerging Technologies (SIGGRAPH ’10). ACM, New York, NY, USA. Article 22, 1 pages. isbn:978-1-4503-0392-7 https://doi.org/10.1145/1836821.1836843
Google ScholarDigital Library
- Daniel Saakes, Masahiko Inami, Takeo Igarashi, Naoya Koizumi, and Ramesh Raskar. 2012. Shader Printer. In ACM SIGGRAPH 2012 Emerging Technologies (SIGGRAPH ’12). ACM, New York, NY, USA. Article 18, 1 pages. isbn:978-1-4503-1680-4 https://doi.org/10.1145/2343456.2343474
Google ScholarDigital Library
- Daniel Saakes, Takahiro Tsujii, Kohei Nishimura, Tomoko Hashida, and Takeshi Naemura. 2013. Photochromic carpet: Playful floor canvas with color-changing footprints. In International Conference on Advances in Computer Entertainment Technology. 622–625. https://doi.org/10.1007/978-3-319-03161-3_67
Google ScholarCross Ref
- Clifton Sanders and Courtland Imel. 2017. Method, composition for the preparation and cleaning of photochromic dyes resulting in a product suitable for use on human skin. US Patent 9,611,389
Google Scholar
- Johan Sanneblad and Lars Erik Holmquist. 2006. Ubiquitous Graphics: Combining Hand-held and Wall-size Displays to Interact with Large Images. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’06). ACM, New York, NY, USA. 373–377. isbn:1-59593-353-0 https://doi.org/10.1145/1133265.1133343
Google ScholarDigital Library
- Naoto Tamai and Hiroshi Miyasaka. 2000. Ultrafast dynamics of photochromic systems. Chemical Reviews, 100, 5 (2000), 1875–1890. https://doi.org/10.1021/cr9800816
Google ScholarCross Ref
- Kohei Tsuji and Akira Wakita. 2011. Anabiosis: An Interactive Pictorial Art Based on Polychrome Paper Computing. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (ACE ’11). Association for Computing Machinery, New York, NY, USA. Article 80, 2 pages. isbn:9781450308274 https://doi.org/10.1145/2071423.2071521
Google ScholarDigital Library
- Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST ’04). ACM, New York, NY, USA. 137–146. isbn:1-58113-957-8 https://doi.org/10.1145/1029632.1029656
Google ScholarDigital Library
- James R. Wallace, Stacey D. Scott, and Carolyn G. MacGregor. 2013. Collaborative Sensemaking on a Digital Tabletop and Personal Tablets: Prioritization, Comparisons, and Tableaux. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). ACM, New York, NY, USA. 3345–3354. isbn:978-1-4503-1899-0 https://doi.org/10.1145/2470654.2466458
Google ScholarDigital Library
- Mark Weiser. 1993. Some Computer Science Issues in Ubiquitous Computing. Commun. ACM, 36, 7 (1993), July, 75–84. issn:0001-0782 https://doi.org/10.1145/159544.159617
Google ScholarDigital Library
- Mark Weiser. 1999. The Computer for the 21st Century. SIGMOBILE Mob. Comput. Commun. Rev., 3, 3 (1999), July, 3–11. issn:1559-1662 https://doi.org/10.1145/329124.329126
Google ScholarDigital Library
- Mark Weiser and John Seely Brown. 1996. Designing calm technology. PowerGrid Journal, 1, 1 (1996), 75–85.
Google Scholar
- Michael Wessely, Yuhua Jin, Cattalyya Nuengsigkapian, Aleksei Kashapov, Isabel P. S. Qamar, Dzmitry Tsetserukou, and Stefanie Mueller. 2021. ChromoUpdate: Fast Design Iteration of Photochromic Color Textures Using Grayscale Previews and Local Color Updates. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 666, 13 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445391
Google ScholarDigital Library
- Mary Anne White and Monique LeBlanc. 1999. Thermochromism in Commercial Products. Journal of Chemical Education, 76, 9 (1999), 1201. https://doi.org/10.1021/ed076p1201
Google ScholarCross Ref
- Wesley Willett, Yvonne Jansen, and Pierre Dragicevic. 2017. Embedded Data Representations. IEEE Transactions on Visualization and Computer Graphics, 23, 1 (2017), 461–470. https://doi.org/10.1109/TVCG.2016.2598608
Google ScholarDigital Library
- Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable Augmented Reality with the Beamatron. Association for Computing Machinery, New York, NY, USA. 413–422. isbn:9781450315807 https://doi.org/10.1145/2380116.2380169
Google ScholarDigital Library
- Andrew D. Wilson. 2004. TouchLight: An Imaging Touch Screen and Display for Gesture-based Interaction. In Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI ’04). ACM, New York, NY, USA. 69–76. isbn:1-58113-995-0 https://doi.org/10.1145/1027933.1027946
Google ScholarDigital Library
- Andrew D. Wilson. 2005. PlayAnywhere: A Compact Interactive Tabletop Projection-vision System. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST ’05). ACM, New York, NY, USA. 83–92. isbn:1-59593-271-2 https://doi.org/10.1145/1095034.1095047
Google ScholarDigital Library
- Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). ACM, New York, NY, USA. 879–888. isbn:978-1-4503-1899-0 https://doi.org/10.1145/2470654.2466113
Google ScholarDigital Library
- Robert Xiao, Scott Hudson, and Chris Harrison. 2016. DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA. 85–94. isbn:978-1-4503-4248-3 https://doi.org/10.1145/2992154.2992173
Google ScholarDigital Library
- Hiroki Yamada, Tomohiro Tanikawa, Kunihiro Nishimura, and Michitaka Hi rose. 2011. Paint Color Control System with Infrared Photothermal Conversion. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (ACE ’11). Association for Computing Machinery, New York, NY, USA. Article 64, 8 pages. isbn:9781450308274 https://doi.org/10.1145/2071423.2071503
Google ScholarDigital Library
- Michiyuki Yasuda, Yutaka Shibahashi, and Yoshie Kamiya. 2018. Photochromic toy. US Patent 9,937,434
Google Scholar
- Evan You. 2021. Vue.js. https://vuejs.org/
Google Scholar
- Johannes Zagermann, Ulrike Pfeil, Roman Rädle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. 2016. When Tablets Meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA. 5470–5481. isbn:978-1-4503-3362-7 https://doi.org/10.1145/2858036.2858224
Google ScholarDigital Library
- Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA. 1–14. isbn:978-1-4503-4655-9 https://doi.org/10.1145/3025453.3025842
Google ScholarDigital Library
- Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA. Article 273, 15 pages. isbn:978-1-4503-5620-6 https://doi.org/10.1145/3173574.3173847
Google ScholarDigital Library
Index Terms
- UbiChromics: Enabling Ubiquitously Deployable Interactive Displays with Photochromic Paint
Recommendations
Toolkit support for interactive projected displays
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous MultimediaThis paper presents a software toolkit designed to enable the rapid development of multimedia-rich, multi-touch enabled, and interactive projection-based displays. For instance: door displays, floor displays, wall displays, and interactive tables. ...
WallTokens: Surface Tangibles for Vertical Displays
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsTangibles can enrich interaction with digital surfaces. Among others, they support eyes-free control or increase awareness of other users’ actions. Tangibles have been studied in combination with horizontal surfaces such as tabletops, but not with ...
Cloud displays for mobile users in a display cloud
HotMobile '13: Proceedings of the 14th Workshop on Mobile Computing Systems and ApplicationsThe display cloud model allows users to select local and remote programmable displays, and add them to a user specific cloud display where the user can arrange them freely. On a cloud display, the abstraction representing remote graphical content is ...
Comments