skip to main content
10.1145/3290605.3300846acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

Vistribute: Distributing Interactive Visualizations in Dynamic Multi-Device Setups

Published: 02 May 2019 Publication History

Abstract

We present Vistribute, a framework for the automatic distribution of visualizations and UI components across multiple heterogeneous devices. Our framework consists of three parts: (i) a design space considering properties and relationships of interactive visualizations, devices, and user preferences in multi-display environments; (ii) specific heuristics incorporating these dimensions for guiding the distribution for a given interface and device ensemble; and (iii) a web-based implementation instantiating these heuristics to automatically generate a distribution as well as providing interaction mechanisms for user-defined adaptations. In contrast to existing UI distribution systems, we are able to infer all required information by analyzing the visualizations and devices without relying on additional input provided by users or programmers. In a qualitative study, we let experts create their own distributions and rate both other manual distributions and our automatic ones. We found that all distributions provided comparable quality, hence validating our framework.

Supplementary Material

ZIP File (paper616pvc.zip)
Preview video captions
ZIP File (pn1251.zip)
Supplementary Material comprises one PDF (distributions_participants.pdf) listing all distributions created by participants during the user study.
ZIP File (pn1251vc.zip)
Video figure captions
MP4 File (paper616p.mp4)
Preview video
MP4 File (pn1251.mp4)
Supplemental video

References

[1]
Robert Amar, James Eagan, and John Stasko. 2005. Low-level Components of Analytic Activity in Information Visualization. In Proceedings of the IEEE Symposium on Information Visualization. IEEE, Piscataway, NJ, USA, 111--117.
[2]
Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 55--64.
[3]
Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization 10, 4 (Aug. 2011), 341--355.
[4]
Daniel Archambault, Helen Purchase, and Bruno Pinaud. 2011. Animation, Small Multiples, and the Effect of Mental Map Preservation in Dynamic Graphs. IEEE Transactions on Visualization and Computer Graphics 17, 4 (April 2011), 539--552.
[5]
Sriram Karthik Badam and Niklas Elmqvist. 2014. PolyChrome: A Cross-Device Framework for Collaborative Web Visualization. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 109--118.
[6]
Sriram Karthik Badam, Eli Fisher, and Niklas Elmqvist. 2015. Munin: A Peer-to-Peer Middleware for Ubiquitous Analytics and Visualization Spaces. IEEE Transactions on Visualization and Computer Graphics 21, 2 (Feb. 2015), 215--228.
[7]
Sriram Karthik Badam, Andreas Mathisen, Roman Rädle, Clemens N. Klokmose, and Niklas Elmqvist. 2019. Vistrates: A Component Model for Ubiquitous Analytics. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 586--596.
[8]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 121--130.
[9]
Patrick Baudisch and Christian Holz. 2010. My new PC is a mobile phone. ACM XRDS 16, 4 (June 2010), 36--41.
[10]
Patrick Baudisch, Desney S. Tan, Maxime Collomb, Daniel C. Robbins, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos. 2006. Phosphor: explaining transitions in the user interface using afterglow effects. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 169--178.
[11]
Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3: DataDriven Documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec. 2011), 2301--2309.
[12]
Lauren Bradel, Alex Endert, Kristen Koch, Christopher Andrews, and Chris North. 2013. Large high resolution displays for co-located collaborative sensemaking: Display usage and territoriality. International Journal of Human-Computer Studies 71, 11 (Nov. 2013), 1078--1088.
[13]
Matthew Brehmer and Tamara Munzner. 2013. A Multi-Level Typology of Abstract Visualization Tasks. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec. 2013), 2376--2385.
[14]
Olivier Chapuis, Anastasia Bezerianos, and Stelios Frantzeskakis. 2014. Smarties: an input system for wall display development. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2763--2772.
[15]
Haeyong Chung, Chris North, Sarang Joshi, and Jian Chen. 2015. Four considerations for supporting visual analysis in display ecologies. In Proceedings of the IEEE Conference on Visual Analytics Science and Technology. IEEE, Piscataway, NJ, USA, 33--40.
[16]
Haeyong Chung, Chris North, Jessica Zeitz Self, Sharon Lynn Chu, and Francis K. H. Quek. 2014. VisPorter: facilitating information sharing for collaborative sensemaking on multiple displays. Personal and Ubiquitous Computing 18, 5 (June 2014), 1169--1186.
[17]
Matt Conlen and Jeffrey Heer. 2018. Idyll: A Markup Language for Authoring and Publishing Interactive Articles on the Web. In Proceedings CHI 2019, May 4--9, 2019, Glasgow, Scotland UK T. Horak et al. of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 977--989.
[18]
David Dearman and Jeffery S. Pierce. 2008. It's on My Other Computer!: Computing with Multiple Devices. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 767--776.
[19]
Niklas Elmqvist and Pourang Irani. 2013. Ubiquitous Analytics: Interacting with Big Data Anywhere, Anytime. IEEE Computer 46, 4 (April 2013), 86--89.
[20]
M. R. Garey and D. S. Johnson. 1981. Approximation Algorithms for Bin Packing Problems: A Survey. In Analysis and Design of Algorithms in Combinatorial Optimization. Springer Vienna, Vienna, 147--172.
[21]
Michael Gleicher. 2018. Considerations for Visualizing Comparison. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan. 2018), 413--423.
[22]
Michael Gleicher, Danielle Albers, Rick Walker, Ilir Jusufi, Charles D. Hansen, and Jonathan C. Roberts. 2011. Visual comparison for information visualization. Information Visualization 10, 4 (Sept. 2011), 289--309.
[23]
Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2773--2782.
[24]
Jeffrey Heer and Maneesh Agrawala. 2006. Multi-Scale Banking to 45 Degrees. IEEE Transactions on Visualization and Computer Graphics 12, 5 (Sept. 2006), 701--708.
[25]
Jeffrey Heer and George Robertson. 2007. Animated Transitions in Statistical Data Graphics. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1240--1247.
[26]
Tom Horak, Sriram Karthik Badam, Niklas Elmqvist, and Raimund Dachselt. 2018. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 19:1--19:13.
[27]
Steven Houben and Nicolai Marquardt. 2015. WATCHCONNECT: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1247--1256.
[28]
Maria Husmann, Alfonso Murolo, Nicolas Kick, Linda Di Geronimo, and Moira C. Norrie. 2018. Supporting out of office software development using personal devices. In Proceedings of the ACM Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, USA, 27:1--27:11.
[29]
Mikkel R. Jakobsen and Kasper Hornbæk. 2013. Interactive Visualizations on Large and Small Displays: The Interrelation of Display Size, Information Space, and Scale. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec. 2013), 2336--2345.
[30]
Waqas Javed and Niklas Elmqvist. 2012. Exploring the Design Space of Composite Visualization. In Proceedings of the IEEE Pacific Symposium on Visualization. IEEE, Piscataway, NJ, USA, 1--8.
[31]
Haojian Jin, Christian Holz, and Kasper Hornbæk. 2015. Tracko: Adhoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 147--156.
[32]
Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Computer Graphics Forum 36, 3 (June 2017), 503--514.
[33]
Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, and Michel Beaudouin-Lafon. 2015. Webstrates: Shareable Dynamic Media. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 280--290.
[34]
Ricardo Langner, Tom Horak, and Raimund Dachselt. 2018. VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan. 2018), 626--636.
[35]
Ricardo Langner, Ulrike Kister, and Raimund Dachselt. 2019. Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 608--618.
[36]
Ricardo Langner, Ulrich von Zadow, Tom Horak, Annett Mitschick, and Raimund Dachselt. 2016. Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. In Collaboration Meets Interactive Spaces. Springer International Publishing, Cham, 75--96.
[37]
David Ledo, Saul Greenberg, Nicolai Marquardt, and Sebastian Boring. 2015. Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies. In Proceedings of the ACM Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, USA, 187--198.
[38]
Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Transactions on Visualization and Computer Graphics 18, 12 (Dec. 2012), 2689--2698.
[39]
Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of display size and navigation type on a classification task. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4147--4156.
[40]
Nicolai Marquardt and Saul Greenberg. 2012. Informing the Design of Proxemic Interactions. IEEE Pervasive Computing 11, 2 (Feb. 2012), 14--23.
[41]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Crossdevice interaction via micro-mobility and f-formations. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 13--22.
[42]
Will McGrath, Brian Bowman, David McCallum, Juan David HincapiéRamos, Niklas Elmqvist, and Pourang Irani. 2012. Branch-exploremerge: Facilitating Real-time Revision Control in Collaborative Visual Exploration. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 235--244.
[43]
Dominik Moritz, Chenglong Wang, Greg L. Nelson, Halden Lin, Adam M. Smith, Bill Howe, and Jeffrey Heer. 2019. Formalizing Visualization Design Knowledge as Constraints: Actionable and Extensible Models in Draco. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 438--448.
[44]
Michael Nebeling. 2017. XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces. In Proceedings of the ACM Conference on Vistribute CHI 2019, May 4--9, 2019, Glasgow, Scotland UK Human Factors in Computing Systems. ACM, New York, NY, USA, 4574-- 4584.
[45]
Michael Nebeling and Anind K. Dey. 2016. XDBrowser: User-Defined Cross-Device Web Page Designs. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 5494--5505.
[46]
Seonwook Park, Antti Oulasvirta, Otmar Hilliges, Christoph Gebhardt, Roman Rädle, Anna Maria Feit, Hana Vrzakova, Niraj Ramesh Dayama, Hui-Shyong Yeo, Clemens N. Klokmose, and Aaron Quigley. 2018. AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 184:1--184:14.
[47]
Thomas Plank, Hans-Christian Jetter, Roman Rädle, Clemens N. Klokmose, Thomas Luger, and Harald Reiterer. 2017. Is Two Enough?! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4548--4560.
[48]
Zening Qu and Jessica Hullman. 2018. Keeping Multiple Views Consistent: Constraints, Validations, and Exceptions in Visualization Authoring. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan. 2018), 468--477.
[49]
Roman Rädle, Hans-Christian Jetter, Jonathan Fischer, Inti Gabriel, Clemens N. Klokmose, Harald Reiterer, and Christian Holz. 2018. PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 497:1--497:9.
[50]
Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 45--54.
[51]
Roman Rädle, Midas Nouwens, Kristian Antonsen, James R. Eagan, and Clemens N. Klokmose. 2017. Codestrates: Literate Computing with Webstrates. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 715--725.
[52]
Jonathan C. Roberts. 2007. State of the Art: Coordinated & Multiple Views in Exploratory Visualization. In Proccedings of the IEEE Conference on Coordinated and Multiple Views in Exploratory Visualization. IEEE, Piscataway, NJ, USA, 61--71.
[53]
Jonathan C. Roberts, Panagiotis D. Ritsos, Sriram Karthik Badam, Dominique Brodbeck, Jessie Kennedy, and Niklas Elmqvist. 2014. Visualization beyond the Desktop-the Next Big Thing. IEEE Computer Graphics and Applications 34, 6 (Nov. 2014), 26--34.
[54]
Stephanie Santosa and Daniel Wigdor. 2013. A field study of multidevice workflows in distributed workspaces. In Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing. ACM, New York, NY, USA, 63--72.
[55]
Alper Sarikaya, Michael Correll, Lyn Bartram, Melanie Tory, and Danyel Fisher. 2019. What Do We Talk About When We Talk About Dashboards? IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 682--692.
[56]
Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, and Jeffrey Heer. 2017. Vega-Lite: A Grammar of Interactive Graphics. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan. 2017), 341--350.
[57]
Arvind Satyanarayan, Kanit Wongsuphasawat, and Jeffrey Heer. 2014. Declarative interaction design for data visualization. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 669--678.
[58]
Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 2163--2168.
[59]
Shaishav Siddhpuria, Sylvain Malacria, Mathieu Nancel, and Edward Lank. 2018. Pointing at a Distance with Everyday Smart Devices. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 173:1--173:11.
[60]
Martin Spindler, Christian Tominski, Heidrun Schumann, and Raimund Dachselt. 2010. Tangible views for information visualization. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 157--166.
[61]
Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touchsensitive Display Walls. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, New York, NY, USA, 129--138.
[62]
Pawel Wozniak, Lars Lischke, Benjamin Schmidt, Shengdong Zhao, and Morten Fjeld. 2014. Thaddeus: a dual device interaction space for exploring information visualisation. In Proceedings of the ACM Nordic Conference on Human-Computer Interaction. ACM, New York, NY, USA, 41--50.
[63]
Jishuo Yang and Daniel Wigdor. 2014. Panelrama: enabling easy specification of cross-device web applications. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2783--2792.
[64]
Ji Soo Yi, Youn ah Kang, and John Stasko. 2007. Toward a Deeper Understanding of the Role of Interaction in Information Visualization. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1224--1231.

Cited By

View all
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Semi-Automatic Layout Adaptation for Responsive Multiple-View Visualization DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324035630:7(3798-3812)Online publication date: Jul-2024
  • (2023)Data Analytics Anywhere and EverywhereCommunications of the ACM10.1145/358485866:12(52-63)Online publication date: 17-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
May 2019
9077 pages
ISBN:9781450359702
DOI:10.1145/3290605
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cross-device interaction
  2. cross-device visualization
  3. distributed user interfaces
  4. information visualization
  5. multi-display environments

Qualifiers

  • Research-article

Funding Sources

Conference

CHI '19
Sponsor:

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)296
  • Downloads (Last 6 weeks)28
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Semi-Automatic Layout Adaptation for Responsive Multiple-View Visualization DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324035630:7(3798-3812)Online publication date: Jul-2024
  • (2023)Data Analytics Anywhere and EverywhereCommunications of the ACM10.1145/358485866:12(52-63)Online publication date: 17-Nov-2023
  • (2023)WebJump: AR-facilitated Distributed Display of Web PagesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585669(1-6)Online publication date: 19-Apr-2023
  • (2023)Colibri: A Toolkit for Rapid Prototyping of Networking Across Realities2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00010(9-13)Online publication date: 16-Oct-2023
  • (2022)Between Principle and Pragmatism: Reflections on Prototyping Computational Media with WebstratesACM Transactions on Computer-Human Interaction10.1145/356989530:4(1-53)Online publication date: 27-Oct-2022
  • (2022)Webstrates, Codestrates v2, and Varv: A Software Stack for Computational MediaAdjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference10.1145/3547522.3547714(1-2)Online publication date: 8-Oct-2022
  • (2021)Designing Proxemic-aware Cross-Device Applications: A Feasibility StudyProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490658(84-89)Online publication date: 5-Dec-2021
  • (2021)Applications across Co-located Devices: User Interface Distribution, State Management and CollaborationThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487748(602-613)Online publication date: 29-Nov-2021
  • (2021)Computational Framework to Support Development of Applications Running on Multiple Co-located DevicesCompanion of the 2021 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3459926.3464758(63-69)Online publication date: 8-Jun-2021
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media