research-article

InterTwine: creating interapplication information scent to support coordinated use of software

Authors:

Ben Lafreniere,

Parmit Chilana,

Michael TerryAuthors Info & Claims

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Pages 429 - 438

https://doi.org/10.1145/2642918.2647420

Published: 05 October 2014 Publication History

Abstract

Users often make continued and sustained use of online resources to complement use of a desktop application. For example, users may reference online tutorials to recall how to perform a particular task. While often used in a coordinated fashion, the browser and desktop application provide separate, independent mechanisms for helping users find and re-find task-relevant information. In this paper, we describe InterTwine, a system that links information in the web browser with relevant elements in the desktop application to create interapplication information scent. This explicit link produces a shared interapplication history to assist in re-finding information in both applications. As an example, InterTwine marks all menu items in the desktop application that are currently mentioned in the front-most web page. This paper introduces the notion of interapplication information scent, demonstrates the concept in InterTwine, and describes results from a formative study suggesting the utility of the concept.

Supplementary Material

suppl.mov (uistf4833-file3.mp4)

Supplemental video

Download
24.08 MB

References

[1]

Baudisch, P., Tan, D., Collomb, M., Robbins, D., Hinckley, K., Agrawala, M., Zhao, S., and Ramos, G. Phosphor: Explaining transitions in the user interface using afterglow effects. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, UIST '06, ACM (New York, NY, USA, 2006), 169--178.

Digital Library

[2]

Brandt, J., Dontcheva, M., Weskamp, M., and Klemmer, S. R. Example-centric programming: integrating web search into the development environment. In Proc. CHI '10, ACM (New York, NY, USA, 2010), 513--522.

Digital Library

[3]

Brandt, J., Guo, P. J., Lewenstein, J., Dontcheva, M., and Klemmer, S. R. Two studies of opportunistic programming: interleaving web foraging, learning, and writing code. In Proc CHI '09, ACM (New York, NY, USA, 2009), 1589--1598.

Digital Library

[4]

Chi, E. H., Pirolli, P., Chen, K., and Pitkow, J. Using information scent to model user information needs and actions and the web. In Proc CHI '01, ACM (New York, NY, USA, 2001).

Digital Library

[5]

Ekstrand, M., Li, W., Grossman, T., Matejka, J., and Fitzmaurice, G. Searching for software learning resources using application context. In Proc. UIST '11, ACM (New York, NY, USA, 2011), 195--204.

Digital Library

[6]

Fourney, A., Mann, R., and Terry, M. Characterizing the usability of interactive applications through query log analysis. In Proc. CHI '11, ACM (New York, NY, USA, 2011), 1817--1826.

Digital Library

[7]

Fourney, A., Mann, R., and Terry, M. Query-feature graphs: Bridging user vocabulary and system functionality. In Proc. UIST '11, ACM (New York, NY, USA, 2011), 207--216.

Digital Library

[8]

Fourney, A., and Ringle Morris, M. Enhancing technical Q&A forums with CiteHistory. In Proc. ICWSM '13 (2013).

[9]

Goldman, M., and Miller, R. C. Codetrail: Connecting source code and web resources. J. Vis. Lang. Comput. 20, 4 (Aug. 2009), 223--235.

Digital Library

[10]

Hartmann, B., Dhillon, M., and Chan, M. K. HyperSource: bridging the gap between source and code-related web sites. In Proc. CHI '11, ACM (New York, NY, USA, 2011).

Digital Library

[11]

Hendy, J., Booth, K. S., and McGrenere, J. Graphically enhanced keyboard accelerators for GUIs. In Proc. GI '10, Canadian Information Processing Society (Toronto, Ont., Canada, 2010), 3--10.

Digital Library

[12]

Jones, W., Bruce, H., and Dumais, S. How do people get back to information on the web? how can they do it better. In Proc. INTERACT '03 (2003), 793--796.

[13]

Kim, J., Nguyen, P. T., Weir, S., Guo, P. J., Miller, R. C., and Gajos, K. Z. Crowdsourcing step-by-step information extraction to enhance existing how-to videos. In CHI '14, CHI '14, ACM (New York, NY, USA, 2014), 4017--4026.

Digital Library

[14]

Lafreniere, B. Task-Centric User Interfaces. PhD, University of Waterloo, Waterloo, ON, Canada, Apr. 2014.

[15]

Lafreniere, B., Grossman, T., and Fitzmaurice, G. Community enhanced tutorials: Improving tutorials with multiple demonstrations. In CHI '13, CHI '13, ACM (New York, NY, USA, 2013), 1779--1788.

Digital Library

[16]

Lafreniere, B., Grossman, T., Matejka, J., and Fitzmaurice, G. Investigating the feasibility of extracting tool demonstrations from in-situ video content. In CHI '14, CHI '14, ACM (New York, NY, USA, 2014), 4007--4016.

Digital Library

[17]

Li, I., Nichols, J., Lau, T., Drews, C., and Cypher, A. Here's what i did: Sharing and reusing web activity with ActionShot. In Proc. CHI '10, ACM (New York, NY, USA, 2010), 723--732.

Digital Library

[18]

Matejka, J., Grossman, T., and Fitzmaurice, G. Patina: Dynamic heatmaps for visualizing application usage. In Proc CHI '13, ACM (New York, NY, USA, 2013), 3227--3236.

Digital Library

[19]

Matejka, J., Li, W., Grossman, T., and Fitzmaurice, G. CommunityCommands: command recommendations for software applications. In Proc. UIST '09, ACM (New York, NY, USA, 2009), 193--202.

Digital Library

[20]

Morris, D., Ringel Morris, M., and Venolia, G. SearchBar: a search-centric web history for task resumption and information re-finding. In Proc. CHI '08, ACM (New York, NY, USA, 2008).

Digital Library

[21]

Obendorf, H., Weinreich, H., Herder, E., and Mayer, M. Web page revisitation revisited: implications of a long-term click-stream study of browser usage. In Proc. CHI '07, ACM (New York, NY, USA, 2007), 597--606.

Digital Library

[22]

Pirolli, P., and Card, S. Information foraging. Psychological Review 106, 4 (1999), 643--675.

[23]

Pongnumkul, S., Dontcheva, M., Li, W., Wang, J., Bourdev, L., Avidan, S., and Cohen, M. F. Pause-and-play: Automatically linking screencast video tutorials with applications. In Proc. UIST '11, ACM (New York, NY, USA, 2011), 135--144.

Digital Library

[24]

Schwarz, J., and Morris, M. Augmenting web pages and search results to support credibility assessment. In Proc. CHI '11, ACM (New York, NY, USA, 2011).

Digital Library

[25]

Sparrow, B., Liu, J., and Wegner, D. M. Google effects on memory: Cognitive consequences of having information at our fingertips. Science 333, 6043 (2011), 776--778.

[26]

Teevan, J., Adar, E., Jones, R., and Potts, M. A. S. Information re-retrieval: repeat queries in yahoo's logs. In Proc. SIGIR '07, ACM (New York, NY, USA, 2007), 151--158.

Digital Library

[27]

Willett, W., Heer, J., and Agrawala, M. Scented widgets: Improving navigation cues with embedded visualizations. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1129--1136.

Digital Library

Cited By

Khurana AChilana PKostakos VKay JHoang T(2024)Understanding Novice Users' Mental Models of Gesture Discoverability and Designing Effective OnboardingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678370(290-295)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678370
Khurana ASubramonyam HChilana P(2024)Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-SeekingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645200(288-303)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645200
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Show More Cited By

Index Terms

InterTwine: creating interapplication information scent to support coordinated use of software
1. Human-centered computing

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

October 2014

722 pages

ISBN:9781450330695

DOI:10.1145/2642918

General Chair:
Hrvoje Benko
Microsoft Research, USA
,
Program Chairs:
Mira Dontcheva
Adobe, USA
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Networks of Centres of Excellence of Canada

Conference

UIST '14

Sponsor:

UIST '14: The 27th Annual ACM Symposium on User Interface Software and Technology

October 5 - 8, 2014

Hawaii, Honolulu, USA

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
463
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Khurana AChilana PKostakos VKay JHoang T(2024)Understanding Novice Users' Mental Models of Gesture Discoverability and Designing Effective OnboardingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678370(290-295)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678370
Khurana ASubramonyam HChilana P(2024)Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-SeekingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645200(288-303)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645200
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Ashtari NAlamzadeh PGanapathy GChilana P(2022)PONI: A Personalized Onboarding Interface for Getting Inspiration and Learning About AR/VR CreationNordic Human-Computer Interaction Conference10.1145/3546155.3546642(1-14)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546642
Palani SZhou YZhu SDow S(2022)InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and SynthesisProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545696(1-16)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545696
Nonnemann LHogräfer MRöhlig MSchumann HUrban BSchulz H(2022)A Data-Driven Platform for the Coordination of Independent Visual Analytics ToolsComputers and Graphics10.1016/j.cag.2022.05.023106:C(152-160)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.05.023
Zhong MLi GChi PLi Y(2021)HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based InstructionsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474812(1144-1153)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474812
Fraser CMarkel JBasa NDontcheva MKlemmer SIqbal SMacLean KChevalier FMueller S(2020)ReMapProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415592(979-986)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415592
Kiani KChilana PBunt AGrossman TFitzmaurice G(2020)“I Would Just Ask Someone”: Learning Feature-Rich Design Software in the Modern Workplace2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC50065.2020.9127288(1-10)Online publication date: Aug-2020
https://doi.org/10.1109/VL/HCC50065.2020.9127288
Nonnemann LSchumann HUrban BAehnelt MSchulz H(2020)A Characterization of Data Exchange between Visual Analytics Tools2020 24th International Conference Information Visualisation (IV)10.1109/IV51561.2020.00066(368-377)Online publication date: Sep-2020
https://doi.org/10.1109/IV51561.2020.00066
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten