David Franklin
ABSTRACT
In designing Jabberwocky—a speech-based interface to Microsoft PowerPoint—we have tried to go beyond simple commands like “Next slide, please” and make a tool that aids speakers as they present and even learns as they rehearse their presentations. Jabberwocky looks at the contents of the slides, extracting key words and phrases and associating them with their places in the presentation. By listening for these phrases (and synonymous phrases derived using syntactic rules) Jabberwocky is able to follow along with the presentation, switching slides at the appropriate moments. In this paper, we discuss the implementation of this system—a component of our Intelligent Classroom project—and look at how we are using it.
- 1.Allen, J., Miller, B., Ringger, E., and Sikorski, T. (1996). Robust Understanding in a Dialogue System. In Proceedings of 34" Meeting of the Association for Computational Linguistics.Google Scholar
- 2.Bradshaw, S., and Hammond, K. (1999). Constructing Indices from Citations in Collections of Research Papers. In Proceedings of the 62"d Annual Meeting of the American Society for Information Science.Google Scholar
- 3.Carroll, L. (1871). Through the Looking Glass.Google Scholar
- 4.Coen, M. (1998). Design Principles for Intelligent Environments. In Proceedings of Fifteenth National Conference on Artificial Intelligence. Google ScholarDigital Library
- 5.Everett, S., Wauchope, K., and Perez-Quinones, M . (1998). Creating Natural Language Interfaces to VR Systems: Experiences, Observations and Lessons Learned. In Proceedings of Fourth International Conference on Virtual Systems and Multimedia.Google Scholar
- 6.Franklin, D. (1998). Cooperating with people: the Intelligent Classroom. In Proceedings of Fifteenth National Conference on Artificial Intelligence. Google ScholarDigital Library
- 7.Franklin, D., and Flachsbart, J. (1998). All gadget and no representation makes Jack a dull environment. In AAAI Spring Symposium on Intelligent Environments. AAAI TR SS-98-02.Google Scholar
- 8.Lucente, M., Zwart, G. and George, A. (1998). Visualization Space: A Testbed for Deviceless Multimodal User Interface. In AAAI Spring Symposium on Intelligent Environments. AAAI TR SS-98-02.Google Scholar
- 9.Heckerman, D., and Horvitz, E. (1998). Inferring Informational Goals from Free-Text Queries: A Bayesian Approach. In Proceedings of Fourteenth Conference on Uncertainty in Artificial Intelligence. Google ScholarDigital Library
- 10.Wilson, D., and Bradshaw, S. (1999). CBR Textuality. In Proceedings of the Fourth UK Case-Based Reasoning Workshop.Google Scholar
- 11.WordNet. Available and described at http:llwww.- cogsci.princeton.ed&wn/w3wn.htmlGoogle Scholar
- 12.Xerox Fart of Speech Tagger. Available at parcftp.xerox.com/pub/tagger/tagger-1-0.tar.z and described at http://kb.rxrc.xerox.com/grenoble/mltt/- fsNLP/tagger.htmlGoogle Scholar
Index Terms
- Jabberwocky: you don't have to be a rocket scientist to change slides for a hydrogen combustion lecture
Recommendations
JabberWocky: Crowd-Sourcing Metadata for Files
SCC '09: Proceedings of the 2009 IEEE International Conference on Services ComputingFinding relevant files in a personal file system continues to be a challenge. It is still easier to find stuff on the Web with its exponential growth than in one’s personal file system. Yet, the exponential growth of personal data renders the current ...
Jabberwocky: children's digital ink story writing from nonsense to sense
DIMEA '08: Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and ArtsThis paper describes Jabberwocky, a digital ink based story writing and reading application for children. Created following an immersive design experience, the Jabberwocky interface, and its underlying algorithms, are motivated and described in the ...
Disambiguation of Homograms in a Pitch Accent Language
CSAI '17: Proceedings of the 2017 International Conference on Computer Science and Artificial IntelligenceThe Croatian language is a pitch-accent language in which the tone contour realized in the stressed syllable carries the lexical information. Therefore, in some cases, different lexical accent gives the word a different meaning. In such cases, the ...
Comments