skip to main content
10.1145/1095034.1095071acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

Informal prototyping of continuous graphical interactions by demonstration

Published: 23 October 2005 Publication History

Abstract

Informal prototyping tools have shown great potential in facilitating the early stage design of user interfaces. How-ever, continuous interactions, an important constituent of highly interactive interfaces, have not been well supported by previous tools. These interactions give continuous visual feedback, such as geometric changes of a graphical object, in response to continuous user input, such as the movement of a mouse. We built Monet, a sketch-based tool for proto-typing continuous interactions by demonstration. In Monet, designers can prototype continuous widgets and their states of interest using examples. They can also demonstrate com-pound behaviors involving multiple widgets by direct ma-nipulation. Monet allows continuous interactions to be eas-ily integrated with event-based, discrete interactions. Con-tinuous widgets can be embedded into storyboards and their states can condition or trigger storyboard transitions. Monet achieves these features by employing continuous function approximation and statistical classification techniques, without using any domain specific knowledge or assuming any application semantics. Informal feedback showed that Monet is a promising approach to enabling more complete tool support for early stage UI design.

References

[1]
Bailey, B.P., Konstan, J.A., and Carlis, J.V. DEMAIS: designing multimedia applications with interactive storyboards. In ACM Multimedia. 2001. Ottawa, Canada. pp. 241--250.
[2]
Bishop, C.M., Neural Networks for Pattern Recognition. 1995, Oxford, UK: Oxford University Press.
[3]
Caetano, A., et al. JavaSketchIt: Issues in Sketching the Look of User Interfaces. In AAAI Spring Symposium on Sketch Understanding. 2002. Palo Alto, CA. pp. 9--14.
[4]
Cypher, A., ed. Watch What I Do: Programming by Demon-stration. 1993, MIT Press.
[5]
Frank, M.R., Sukaviriya, P.N., and Foley, J.D. Inference bear: designing interactive interfaces through before and after snap-shots. In DIS'95. 1995. Ann Arbor, Michigan. pp. 167--175.
[6]
Hong, J.I. and Landay, J.A. SATIN: a toolkit for informal ink-based applications. In CHI Letters: 2(2), UIST'00. 2000. San Diego, CA. pp. 63--72.
[7]
Jacob, R.J.K., Deligiannidis, L., and Morrison, S., A Software Model and Specification Language for Non-WIMP User Inter-faces. TOCHI, 1999. 6(1): pp. 1--46.
[8]
JAMA. A Java Matrix Package. http://math.nist.gov/javanumerics/jama/.
[9]
Kovar, L. and Gleicher, M., Simplicial families of drawings. In CHI Letters: 3(2), UIST. 2001. Orlando, FL. pp. 163--172.
[10]
Kurlander, D. and Feiner, S., Inferring constraints from multiple snapshots. ACM Transactions on Graphics (TOG), 1993. 12(4): pp. 277--304.
[11]
Landay, J.A. and Myers, B.A., Sketching Interfaces: Toward More Human Interface Design. IEEE Computer, 2001. 34(3): pp. 56--64.
[12]
Li, Y., Hong, J.I., and Landay, J.A. Topiary: A Tool for Prototyping Location-Enhanced Applications. In CHI Letters: 6(2), UIST'04. 2004. Santa Fe, NM. pp. 217-226.
[13]
Lieberman, H., ed. Your Wish Is My Command: Programming by Example. 2001, Morgan Kaufmann: San Francisco, CA.
[14]
McDaniel, R.G. and Myers, B.A. Getting more out of programming-by-demonstration. In CHI'99. 1999. Pittsburgh, Pennsylvania. pp. 442--449.
[15]
Myers, B.A. Creating dynamic interaction techniques by demonstration. In CHI'87. 1987. Toronto, Ontario, Canada. pp. 271--278.
[16]
Myers, B.A., McDaniel, R.G., and Kosbie, D.S. Marquise: creating complete user interfaces by demonstration. In CHI'93. 1993. Amsterdam, The Netherlands. pp. 293--300.
[17]
Newman, M.W., et al., DENIM: An Informal Web Site Design Tool Inspired by Observations of Practice. Human-Computer Interaction, 2003. 18(3): pp. 259--324.
[18]
Noh, J.-y., Fidaleo, D., and Neumann, U. Animated deformations with radial basis functions. In VRST. 2000. Seoul, Korea. pp. 166--174.
[19]
Olsen, D.R., Ahlstrom, B., and Kohlert, D. Building geometry-based widgets by example. In CHI'95. 1995. Denver, Colorado, United States. pp. 35--42.
[20]
Russell, S. and Norvig, P., Statistical Learning Methods, In Artificial Intelligence: A Modern Approach. 2003, Prentice Hall. pp. 712--762.
[21]
van de Kant, M., et al. Patchwork: A Software Tool for Early Design. In Extended Abstracts of CHI'98. 1998. Los Angeles, California. pp. 221--222.
[22]
Wolber, D., Pavlov: an interface builder for designing animated interfaces. TOCHI, 1997. 4(4): pp. 347--386.
[23]
Wolber, D. and Fisher, G. A demonstrational technique for developing interfaces with dynamically created objects. In UIST'91. 1991. Hilton Head, South Carolina. pp. 221--230.
[24]
Wolberg, G., Image Morphing: A Survey. Visual Computer, 1998. 14: pp. 360--372.
[25]
Wong, Y.Y. Rough and Ready Prototypes: Lessons from Graphic Design. In Posters and short talks of CHI'92. 1992. Monterey, CA: ACM Press, New York. pp. 83--84.
[26]
Zanden, B.V. and Myers, B.A., Demonstrational and constraint-based techniques for pictorially specifying application objects and behaviors. TOCHI, 1995. 2(4): pp. 308--356.

Cited By

View all
  • (2024)FrameKit: A Tool for Authoring Adaptive UIs Using KeyframesProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645176(660-674)Online publication date: 18-Mar-2024
  • (2024)VideoClipper: Rapid Prototyping with the "Editing-in-the-Camera" MethodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642458(1-14)Online publication date: 11-May-2024
  • (2024)ConnectVR: A Trigger-Action Interface for Creating Agent-based Interactive VR Stories2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00051(286-297)Online publication date: 16-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology
October 2005
270 pages
ISBN:1595932712
DOI:10.1145/1095034
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. continuous interactions
  2. direct manipulation
  3. informal prototyping
  4. pen-based user interfaces
  5. programming by demonstration
  6. sketching

Qualifiers

  • Article

Conference

UIST05

Acceptance Rates

UIST '05 Paper Acceptance Rate 31 of 159 submissions, 19%;
Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)1
Reflects downloads up to 24 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)FrameKit: A Tool for Authoring Adaptive UIs Using KeyframesProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645176(660-674)Online publication date: 18-Mar-2024
  • (2024)VideoClipper: Rapid Prototyping with the "Editing-in-the-Camera" MethodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642458(1-14)Online publication date: 11-May-2024
  • (2024)ConnectVR: A Trigger-Action Interface for Creating Agent-based Interactive VR Stories2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00051(286-297)Online publication date: 16-Mar-2024
  • (2023)Escapement: A Tool for Interactive Prototyping with Video via Sensor-Mediated Abstraction of TimeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581115(1-14)Online publication date: 19-Apr-2023
  • (2019)EnactACM Transactions on Computer-Human Interaction10.1145/331027626:3(1-48)Online publication date: 31-May-2019
  • (2018)MontageProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242613(675-682)Online publication date: 11-Oct-2018
  • (2018)Expresso: Building Responsive Interfaces with Keyframes2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2018.8506516(39-47)Online publication date: Oct-2018
  • (2017)A Comparative Study of Milestones for Featuring GUI Prototyping ToolsJournal of Software Engineering and Applications10.4236/jsea.2017.10603110:06(564-589)Online publication date: 2017
  • (2015)SketchSlidersProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702129(3255-3264)Online publication date: 18-Apr-2015
  • (2014)TiquidProceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2639208(319-322)Online publication date: 26-Oct-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media