How to serve soup: interleaving demonstration and assisted editing to support nonprogrammers
Authors: 
Melinda Gervasio, Will Haines, David Morley, Thomas J. Lee, C. Adam Overholtzer, Shahin Saadati, Aaron SpauldingAuthors Info & Claims
Melinda Gervasio, Will Haines, David Morley, Thomas J. Lee, C. Adam Overholtzer, Shahin Saadati, Aaron SpauldingAuthors Info & ClaimsPages 331 - 334
Abstract
The Adept Task Learning system is an end-user programming environment that combines programming by demonstration and direct manipulation to support customization by nonprogrammers. Previously, Adept enforced a rigid procedure-authoring workflow consisting of demonstration followed by editing. However, a series of system evaluations with end users revealed a desire for more feedback during learning and more flexibility in authoring. We present a new approach that interleaves incremental learning from demonstration and assisted editing to provide users with a more flexible procedure-authoring experience. The approach relies on maintaining a "soup" of alternative hypotheses during learning, propagating user edits through the soup, and suggesting repairs as needed. We discuss the learning and reasoning techniques that support the new approach and identify the unique interaction design challenges they raise, concluding with an evaluation plan to resolve the design challenges and complete the improved system.
References
[1]
CALO: Cognitive Assistant that Learns and Organizes, 2008. Retrieved September 7, 2010, from SRI International: http://caloproject.sri.com.
[2]
Chen, J. H. and Weld, D. S. 2008. Recovering from errors during programming by demonstration. Proc. IUI-08, 159--168.
[3]
Cypher, A. 1991. EAGER: programming repetitive tasks by example. Proc. CHI-91, 33--39.
[4]
Garvey, T., Gervasio, M., Lee, T., Myers, K., Angiolillo, C., Gaston, M., Knittel, J., and Kolojejchick, J. 2009. Learning by demonstration to support military planning and decision making. Proc. IAAI-09.
[5]
Halbert, D. C. 1993. SmallStar: programming by demonstration in the desktop metaphor. Chapter 5 in Watch What I Do: Programming by Demonstration, A. Cypher and D. C. Halbert (Eds.), MIT Press, 1993.
[6]
Lau, T., Domingos, P., and Weld, D. S. 2000. Version space algebra and its application to programming by demonstration. Proc. ICML-00.
[7]
Lau, T., Bergman, L., Castelli, V., and Oblinger, D. 2004. Sheepdog: learning procedures for technical support. Proc. IUI-04.
[8]
Lieberman, H., Paterno, F., Klann, M. and Wulf, V. 2006. End-user development: an emerging paradigm. In End User Development, H. Lieberman, F. Paterno, and V. Wulf (Eds.), Springer, 1--8.
[9]
Little, G., Lau, T. A., Cypher, A., Lin, J., Haber, E. M., and Kandogan, E. 2007. Koala: capture, share, automate, personalize business processes on the web. Proc. CHI-07.
[10]
Oblinger, D., Castelli, V., and Bergman, L. 2006. Augmentation-based learning. Proc. IUI-06.
[11]
1Paynter, G. W. and Witten, I. H. 2001. Domain-independent programming by demonstration in existing applications. Chapter 15 in Your Wish is My Command: Programming by Example, H. Lieberman (Ed.) Morgan Kaufmann, 2001.
[12]
Scaffidi, C., Shaw, M., and Myers, B. 2005. Estimating the numbers of end users and end user programmers. Proc. VL/HCC'05.
[13]
Spaulding, A., Blythe, J., Haines, W., and Gervasio, M. 2009. From geek to sleek: integrating task learning tools to support end users in real-world applications. Proc. IUI-09.
Index Terms
- How to serve soup: interleaving demonstration and assisted editing to support nonprogrammers
Recommendations
Koala: capture, share, automate, personalize business processes on the web
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present Koala, a system that enables users to capture, share, automate, and personalize business processes on the web. Koala is a collaborative programming-by-demonstration system that records, edits, and plays back user interactions as pseudo-...
Pavlov: an interface builder for designing animated interfaces
Conventional interface builders provide little support for interactive development of interfaces with application-specific graphics. Some Programming by Demonstration (PBD) systems do provide such support, but none provide full support for demonstrating ...
Rousillon: Scraping Distributed Hierarchical Web Data
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyProgramming by Demonstration (PBD) promises to enable data scientists to collect web data. However, in formative interviews with social scientists, we learned that current PBD tools are insufficient for many real-world web scraping tasks. The missing ...
Comments
Information & Contributors
Information
Published In
February 2011
504 pages
ISBN:9781450304191
DOI:10.1145/1943403
- General Chairs:
- Pearl Pu,
- Michael Pazzani,
- Program Chairs:
- Elisabeth André,
- Doug Riecken
Copyright © 2011 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 February 2011
Check for updates
Author Tags
Qualifiers
- Poster
Conference
IUI '11: 16th International Conference on Intelligent User Interfaces
February 13 - 16, 2011
CA, Palo Alto, USA
Acceptance Rates
Overall Acceptance Rate 746 of 2,811 submissions, 27%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 131Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in