Nicholas Kong
Tovi Grossman
Björn Hartmann
ABSTRACT
Tutorials and sample workflows for complicated, feature-rich software packages are widely available online. As a result users must differentiate between workflows to choose the most suitable one for their task. We present Delta, an interactive workflow visualization and comparison tool that helps users identify the tradeoffs between workflows. We conducted an initial study to identify the set of attributes users attend to when comparing workflows, finding that they consider result quality, their knowledge of commands, and the efficiency of the workflow. We then designed Delta to surface these attributes at three granularities: a high-level, clustered view; an intermediate-level list view that contains workflow summaries; and a low-level detail view that allows users to compare two individual workflows. Finally, we conducted an evaluation of Delta on a small corpus of 30 workflows and found that the intermediate list view provided the best information density. We conclude with thoughts on how such a workflow comparison system could be scaled up to larger corpora in the future.
Supplemental Material
- Andrews, K., Wohlfahrt, M., and Wurzinger, G. Visual Graph Comparison. Info. Vis., pp. 62--67, 2009. Google Scholar
Digital Library
- Bederson, B., Shneiderman, B., and Wattenberg, M. Ordered and quantum treemaps: Making effective use of 2D space to display hierarchies. ACM Trans. Graph, 21(4):833--854, 2002. Google ScholarDigital Library
- Chen, H.-T., Wei, L.-Y. and Chang, C.-F. Nonlinear Revision Control for Images. ACM Trans. Graph, 30(4), Article 105, 2011. Google ScholarDigital Library
- Chi, E. H., Pirolli, P., Chen, K., and Pitkow, J. Using information scent to model user information needs and actions and the Web. ACM CHI, pp. 490--497, 2001. Google ScholarDigital Library
- Chi, E., Pirolli, P., and Pitkow, J. The scent of a site: a system for analyzing and predicting information scent, usage, and usability of a Web site. ACM CHI, pp. 161--168, 2000. Google ScholarDigital Library
- Cutrell, E. and Guan Z. What are you looking for?: an eye-tracking study of information usage in web search. ACM CHI. pp. 407--416. 2007. Google ScholarDigital Library
- Cutting, D., Karger, D., Pedersen, J., and Tukey, J. Scatter/Gather: a cluster-based approach to browsing large document collections. SIGIR. pp. 318--329. 1992. Google ScholarDigital Library
- Denning, J. D., Kerr, W. B., and Pellacini, F. MeshFlow: Interactive Visualization of Mesh Construction Sequences. ACM Trans. Graph, 30(4), Article 66, 2011. Google ScholarDigital Library
- Dorn, B. and Guzdial, M. Learning on the job: characterizing the programming knowledge and learning strategies of web designers. ACM CHI, pp. 703--712. 2010. Google ScholarDigital Library
- Grabler, F., Agrawala, M., Li, W., Dontcheva, M. and Igarashi, T. Generating Photo Manipulation Tutorials by Demonstration. SIGGRAPH. pp. 66:1--66:9, 2009. Google ScholarDigital Library
- Grossman, T., Matejka, J. and Fitzmaurice, G. Chronicle: Capture, Exploration, and Playback of Document Workflow Histories. UIST, pp. 143--152, 2010. Google ScholarDigital Library
- Grossman, T., Fitzmaurice, G. and Attar, R. A Survey of Software Learnability: Metrics, Methodologies and Guidelines. ACM CHI, pp. 649--658, 2009. Google ScholarDigital Library
- Guan. Z., and Cutrell, E. An eye tracking study of the effect of target rank on web search. ACM CHI, pp. 417--420, 2007. Google ScholarDigital Library
- Hearst, M. Search User Interfaces (1st ed.). Cambridge University Press, New York, NY, USA. 2009. Google ScholarDigital Library
- Heer, J., Mackinlay, J., Stolte, C. and Agrawala, M. Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation. IEEE TVCG, pp. 1189--1196, 2008. Google ScholarDigital Library
- Jing, F. Wang, W., Yao, Y., Deng, K., Zhang, L., and Ma, W.-Y. IGroup: web image search results clustering. ACM Multimedia, pp. 377--384, 2006. Google ScholarDigital Library
- Koop, D., Scheidegger, C., Callahan, S., Freire, J., and Silva, C. VisComplete: Automating Suggestions for Visualization Pipelines. IEEE TVCG, pp. 1691--1698, 2008. Google ScholarDigital Library
- Kurlander, D.,and Feiner, S. Editable graphical histories. IEEE Visual Languages, pp. 127--134, 1988.Google ScholarCross Ref
- LaFreniere, B., Bunt, A., Lount, M., Krynicki, F., and Terry, M. AdaptableGIMP: designing a sociallyadaptable interface. UIST Adjunct, pp. 89--90. 2011. Google ScholarDigital Library
- Lee, B., Srivastava, S., Kumar, R., Brafman, R., and Klemmer, S. Designing with Interactive Example Galleries. ACM CHI, pp. 2257--2266, 2010. Google ScholarDigital Library
- Nakamura, T. and Igarashi, I. An application-independent system for visualizing user operation history. UIST, pp. 23--32, 2008. Google ScholarDigital Library
- Pirolli, P. and Card, S. Information foraging. Psychological Review, 106(4):643--675, 1999.Google ScholarCross Ref
- Santos, E., Lins, L., Ahrens, J., Freire, J., and Silva, C. A first study on clustering collections of workflow graphs. IPAW, pp. 160--173, 2008. Google ScholarDigital Library
- Sorokin, A. and Forsyth, D. Utility data annotation with Amazon Mechanical Turk. CVPRW, pp.1--8, 2008.Google ScholarCross Ref
- Wagner, R. and Fischer, M. The String-to-String Correction Problem. J. ACM, 21(1):168--173, 1974. Google ScholarDigital Library
Index Terms
- Delta: a tool for representing and comparing workflows
Recommendations
Community enhanced tutorials: improving tutorials with multiple demonstrations
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWeb-based tutorials are a popular help resource for learning how to perform unfamiliar tasks in complex software. However, in their current form, web tutorials are isolated from the applications that they support. In this paper we present FollowUs, a ...
MixT: automatic generation of step-by-step mixed media tutorials
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsAs software interfaces become more complicated, users rely on tutorials to learn, creating an increasing demand for effective tutorials. Existing tutorials, however, are limited in their presentation: Static step-by-step tutorials are easy to scan but ...
EverTutor: automatically creating interactive guided tutorials on smartphones by user demonstration
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present EverTutor, a system that automatically generates interactive tutorials on smartphone from user demonstration. For tutorial authors, it simplifies the tutorial creation. For tutorial users, it provides contextual step-by-step guidance and ...
Comments