skip to main content
10.1145/3025453.3025547acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces

Published: 02 May 2017 Publication History

Abstract

Several recent studies have highlighted the need to support parallel usage of multiple devices for cross-device use. Yet, most interfaces today are still designed for single-device use and require re-authoring to enable cross-device interaction. This paper presents two studies to inform the design of a new web browser with support for semi-automatic generation of cross-device interfaces. Based on the results of a recent study in which users manually customized web pages for cross-device use, our first study elicits from users how they might want to trigger popular cross-device patterns to transform single-device designs with relatively little effort. Our second study then examines how the emerging design patterns could be applied to the Alexa top 50 sites from 10 different genres. Based on these studies, we design semi-automatic techniques for page segmentation and distribution between multiple devices that can work on many existing web sites and require only minimal user input to switch between different cross-device designs. Finally, we discuss possible extensions to the Chrome web browser to make the techniques available for a wide range of desktop, mobile, and wearable devices, and successfully test them on popular web sites.

Supplementary Material

suppl.mov (pn1474.mp4)
Supplemental video
MP4 File (p4574-nebeling.mp4)

References

[1]
Patrick Baudisch, Bongshin Lee, and Libby Hanna. 2004a. Fishnet, a fisheye web browser with search term popouts: a comparative evaluation with overview and linear view. In Proc. AVI.
[2]
Patrick Baudisch, Xing Xie, Chong Wang, and Wei-Ying Ma. 2004b. Collapse-to-Zoom: Viewing Web Pages on Small Screen Devices by Interactively Removing Irrelevant Content. In Proc. UIST.
[3]
Jeffrey P. Bigham. 2014. Making the Web Easier to See with Opportunistic Accessibility Improvement. In Proc. UIST.
[4]
Nilton Bila, Troy Ronda, Iqbal Mohomed, Khai N. Truong, and Eyal de Lara. 2007. PageTailor: Reusable End-User Customization for the Mobile Web. In Proc. MobiSys.
[5]
Staffan Björk, Lars Erik Holmquist, Johan Redström, Ivan Bretan, Rolf Danielsson, Jussi Karlgren, and Kristofer Franzén. 1999. WEST: A Web Browser for Small Terminals. In Proc. UIST.
[6]
Orkut Buyukkokten, Hector Garcia-Molina, Andreas Paepcke, and Terry Winograd. 2000. Power Browser: Efficient Web Browsing for PDAs. In Proc. CHI.
[7]
Nicholas Chen, François Guimbreti'ere, Morgan Dixon, Cassandra Lewis, and Maneesh Agrawala. 2008. Navigation Techniques for Dual-Display E-Book Readers. In Proc. CHI.
[8]
Xiang 'Anthony' Chen, Tovi Grossman, Daniel J. Wigdor, and George W. Fitzmaurice. 2014. Duet: Exploring Joint Interactions on a Smart Phone and a Smart Watch. In Proc. CHI.
[9]
Y. Chen, W.Y. Ma, and H.J. Zhang. 2003. Detecting Web Page Structure for Adaptive Viewing on Small Form Factor Devices. In Proc. WWW.
[10]
Pei-Yu (Peggy) Chi and Yang Li. 2015. Weave: Scripting Cross-Device Wearable Interaction. In Proc. CHI.
[11]
David Dearman and Jeffrey S. Pierce. 2008. "Its on my other Computer!": Computing with Multiple Devices. In Proc. CHI.
[12]
Luca Frosini and Fabio Patern'o. 2014. User Interface Distribution in Multi-Device and Multi-User Environments with Dynamically Migrating Engines. In Proc. EICS.
[13]
Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. 2007. Automatically Generating User Interfaces Adapted to Users' Motor And Vision Capabilities. In Proc. UIST.
[14]
Giuseppe Ghiani, Fabio Patern'o, and Carmen Santoro. 2012. Push and Pull of Web User Interfaces in Multi-Device Environments. In Proc. AVI.
[15]
Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: Enabling and Understanding Cross-Device Interaction. In Proc. CHI.
[16]
G. Hattori, K. Hoashi, K. Matsumoto, and F. Sugaya. 2007. Robust Web Page Segmentation for Mobile Terminal Using Content-Distances and Page Layout Information. In Proc. WWW.
[17]
Tommi Heikkinen, Jorge Goncalves, Vassilis Kostakos, Ivan Elhart, and Timo Ojala. 2014. Tandem Browsing Toolkit: Distributed Multi-Display Interfaces with Web Technologies. In Proc. PerDis.
[18]
Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. In Proc. CHI.
[19]
Brad Johanson, Shankar Ponnekanti, Caesar Sengupta, and Armando Fox. 2001. Multibrowsing: Moving Web Content across Multiple Displays. In Proc. Ubicomp.
[20]
Shaun K. Kane, Amy K. Karlson, Brian Meyers, Paul Johns, Andy Jacobs, and Greg Smith. 2009. Exploring Cross-Device Web Use on PCs and Mobile Devices. In Proc. INTERACT.
[21]
Amy K. Karlson and Benjamin B. Bederson. 2008. One-handed touchscreen input for legacy applications. In Proc. CHI.
[22]
Amy K. Karlson, Shamsi T. Iqbal, Brian Meyers, Gonzalo Ramos, Kathy Lee, and John C. Tang. 2010. Mobile Taskflow in Context: A Screenshot Study of Smartphone Usage. In Proc. CHI.
[23]
Heidi Lam and Patrick Baudisch. 2005. Summary Thumbnails: Readable Overviews for Small Screen Web Browsers. In Proc. CHI.
[24]
Meredith Ringel Morris. 2012. Web on the Wall: Insights from a Multimodal Interaction Elicitation Study. In Proc. ITS.
[25]
Meredith Ringel Morris, Andreea Danielescu, Steven M. Drucker, Danyel Fisher, Bongshin Lee, m. c. schraefel, and Jacob O. Wobbrock. 2014. Reducing Legacy Bias in Gesture Elicitation Studies. Interactions 21, 3 (2014).
[26]
Michael Nebeling and Anind K. Dey. 2016. XDBrowser: User-Defined Cross-Device Web Page Designs. In Proc. CHI.
[27]
Michael Nebeling, Theano Mintsi, Maria Husmann, and Moira C. Norrie. 2014. Interactive Development of Cross-Device User Interfaces. In Proc. CHI.
[28]
Jeffrey Nichols, Zhigang Hua, and John Barton. 2008. Highlight: A System for Creating and Deploying Mobile Web Applications. In Proc. UIST.
[29]
Antti Oulasvirta and Lauri Sumari. 2007. Mobile Kits and Laptop Trays: Managing Multiple Devices in Mobile Information Work. In Proc. CHI.
[30]
Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proc. CHI.
[31]
Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-Defined Motion Gestures for Mobile Interaction. In Proc. CHI.
[32]
Stephanie Santosa and Daniel Wigdor. 2013. A Field Study of Multi-Device Workflows in Distributed Workspaces. In Proc. UbiComp.
[33]
Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A Cross-Device Interaction Style for Mobiles and Surfaces. In Proc. DIS.
[34]
Evan Schrier, Mira Dontcheva, Charles E. Jacobs, Geraldine Wade, and David Salesin. 2008. Adaptive Layout for Dynamically Aggregated Documents. In Proc. IUI.
[35]
Teddy Seyed, Chris Burns, Mario Costa Sousa, Frank Maurer, and Anthony Tang. 2012. Eliciting Usable Gestures for Multi-Display Environments. In Proc. ITS.
[36]
Desney S. Tan, Brian Meyers, and Mary Czerwinski. 2004. WinCuts: Manipulating Arbitrary Window Regions for More Effective Use of Screen Space. In Proc. CHI EA.
[37]
Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proc. CHI.
[38]
Jacob O. Wobbrock, Jodi Forlizzi, Scott E. Hudson, and Brad A. Myers. 2002. WebThumb: Interaction Techniques for Small-Screen Browsers. In Proc. UIST.
[39]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proc. CHI.
[40]
Jishuo Yang and Daniel Wigdor. 2014. Panelrama: Enabling Easy Specification of Cross-Device Web Applications. In Proc. CHI.

Cited By

View all
  • (2024)Vulture: Cross-Device Web Experience with Fine-Grained Graphical User Interface DistributionIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621433(2478-2487)Online publication date: 20-May-2024
  • (2023)Exploring Opportunities for Multimodality and Multiple Devices in Food JournalingProceedings of the ACM on Human-Computer Interaction10.1145/36042567:MHCI(1-27)Online publication date: 13-Sep-2023
  • (2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
  • Show More Cited By

Index Terms

  1. XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cross-device interaction
    2. distributed user interfaces
    3. semi-automatic page segmentation

    Qualifiers

    • Research-article

    Funding Sources

    • Swiss National Science Foundation

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Vulture: Cross-Device Web Experience with Fine-Grained Graphical User Interface DistributionIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621433(2478-2487)Online publication date: 20-May-2024
    • (2023)Exploring Opportunities for Multimodality and Multiple Devices in Food JournalingProceedings of the ACM on Human-Computer Interaction10.1145/36042567:MHCI(1-27)Online publication date: 13-Sep-2023
    • (2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
    • (2023)WebJump: AR-facilitated Distributed Display of Web PagesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585669(1-6)Online publication date: 19-Apr-2023
    • (2023)I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic ArmProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581184(1-15)Online publication date: 19-Apr-2023
    • (2023)Crow API: Cross-device I/O Sharing in Web ApplicationsIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228950(1-10)Online publication date: 17-May-2023
    • (2021)Designing Proxemic-aware Cross-Device Applications: A Feasibility StudyProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490658(84-89)Online publication date: 5-Dec-2021
    • (2021)Applications across Co-located Devices: User Interface Distribution, State Management and CollaborationThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487748(602-613)Online publication date: 29-Nov-2021
    • (2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
    • (2021)Computational Framework to Support Development of Applications Running on Multiple Co-located DevicesCompanion of the 2021 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3459926.3464758(63-69)Online publication date: 8-Jun-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media