Philip R. Cohen
Skip Abstract Section
Abstract
Speaking military jargon, users can create labels and draw symbols to position objects on digitized maps.
- Alberts, D.S. and Hayes, R.E. Understanding Command and Control. DoD Command and Control Research Program Publication Series, Washington, D.C., 2006.Google Scholar
- Bolt, R.A. Voice and gesture at the graphics interface. ACM Computer Graphics 14, 3 (1980), 262--270. Google ScholarDigital Library
- Cheyer, A. and Julia, L. Multimodal maps: An agent-based approach. In Proceedings of the International Conference on Cooperative Multimodal Communication (Eindhoven, the Netherlands, May). Springer, 1995, 103--113.Google Scholar
- Clarkson, J.D. and Yi, J. LeatherNet: A synthetic forces tactical training system for the USMC commander. In Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation Technical Report IST-TR-96-18, University of Central Florida, Institute for Simulation and Training, Orlando, FL, 1996, 275--281.Google Scholar
- Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. QuickSet: Multimodal interaction for distributed applications. In Proceedings of the Fifth ACM International Conference on Multimedia (Seattle, WA, Nov. 9--13). ACM Press, New York, 1997, 31--40. Google ScholarDigital Library
- Cohen, P.R. and McGee, D.R. Tangible multimodal interfaces for safety-critical applications. Commun. ACM 47, 1 (Jan. 2004), 41--46. Google ScholarDigital Library
- Cohen, P.R., McGee, D., Oviatt, S., Wu, L., Clow, J., King, R., Julier, S., and Rosenblum, L. Multimodal interaction for 2D and 3D environments. IEEE Computer Graphics and Applications 19, 4 (Apr. 1999), 10--13. Google ScholarDigital Library
- Courtemanche, A.J. and Ceranowicz, A. ModSAF development status. In Proceedings of the Fifth Conference on Computer Generated Forces and Behavioral Representation, University of Central Florida, Institute for Simulation and Training, Orlando, FL, 1995, 3--13.Google Scholar
- Dowding, J., Gawron, J.M., Appelt, D., Bear, J., Cherny, L., Moore, R., and Moran, D. Gemini: A natural language system for spoken-language understanding. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics (Ohio State University, Columbus, OH, June 22--26). Association for Computational Linguistics, Stroudsburg, PA, 1993, 54--61. Google ScholarDigital Library
- Dowding, J., Frank, J., Hockey, B.A., Jonsson, A., Aist, G., and Hieronymus, J. A spoken-dialogue interface to the EUROPA planner. In Proceedings of the Third International NASA Workshop on Planning and Scheduling for Space (Washington, D.C.). NASA, 2002.Google Scholar
- Greene, H., Stotts, L., Patterson, R., and Greenburg, J. Command Post of the Future: Successful Transition of a Science and Technology Initiative to a Program of Record. Defense Acquisition University, Fort Belvoir, VA, Jan. 2010; http://www.dau.milGoogle Scholar
- Hammond, T., Logsdon, D., Peschel, J., Johnston, J., Taele, P., Wolin, A., and Paulson, B. A sketch-recognition interface that recognizes hundreds of shapes in course-of-action diagrams. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (Atlanta, Apr. 10--15). ACM Press, New York, 2010, 4213--4218. Google ScholarDigital Library
- Hyman, P. Speech-to-speech translations stutter, but researchers see mellifluous future. Commun. ACM 57, 4 (Apr. 2014), 16--19. Google ScholarDigital Library
- Johnston, M., Cohen, P.R., McGee, D., Oviatt, S.L., Pittman, J.A., and Smith, I. Unification-based multimodal integration. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Annual Meeting of the European ACL (Madrid, Spain, July 7--12). Association for Computational Linguistics, Stroudsburg, PA, 1997, 281--288. Google ScholarDigital Library
- Johnston, M., Bangalore, S., Varireddy, G., Stent, A., Ehlen, P., Walker, M., Whittaker, S., and Maloor, P. MATCH: An architecture for multimodal dialogue systems. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (Philadelphia, PA, July). Association for Computational Linguistics, Stroudsburg, PA, 2002, 376--383. Google ScholarDigital Library
- Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P.R., and Feiner, S. Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality. In Proceedings of the Seventh International Conference on Multimodal Interfaces (Trento, Italy, Oct. 4--6). ACM Press, New York, 2005, 12--19. Google ScholarDigital Library
- Kara, L.B. and Stahovich, T.F. An image-based, trainable symbol recognizer for hand-drawn sketches. Computers and Graphics 29, 4 (2005), 501--517. Google ScholarDigital Library
- Kumar, S., Cohen, P.R., and Coulston, R. Multimodal interaction under exerted conditions in a natural field setting. In Proceedings of the Sixth International Conference on Multimodal Interfaces (State College, PA, Oct. 13--15). ACM Press, New York, 2004, 227--234. Google ScholarDigital Library
- MacEachren, A.M., Cai, G., Brewer, I., and Chen, J. Supporting map-based geo-collaboration through natural interfaces to large-screen display. Cartographic Perspectives 54 (Spring 2006), 16--34.Google ScholarCross Ref
- Moran, D.B., Cheyer, A.J., Julia, L.E., Martin, D.L., and Park, S. Multimodal user interfaces in the Open Agent Architecture. In Proceedings of the Second International Conference on Intelligent User Interfaces (Orlando, FL, Jan. 6--9). ACM Press, New York, 1997, 61--68. Google ScholarDigital Library
- Myers, K., Kolojejchick, J., Angiolillo, C., Cummings, T., Garvey, T., Gervasio, M., Haines, W., Jones, C., Knittel, J., Morley, D., Ommert, W., and Potter, S. Learning by demonstration for military planning and decision making: A deployment story. In Proceedings of the 23rd Innovative Applications of Artificial Intelligence Conference (San Francisco, CA, Aug. 6--10). AAAI Press, Menlo Park, CA, 2011, 1597--1604.Google Scholar
- O'Hara, K., Gonzalez, G., Sellen, A., Penney, G., Varnavas, A., Mentis, H., Criminisi, A., Corish, R., Rouncefield, M., Dastur, N., and Carrell, T. Touchless interaction in surgery. Commun. ACM 57, 1 (Jan. 2014), 70--77. Google ScholarDigital Library
- Oviatt, S.L. Multimodal interfaces. The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, Revised Third Edition, J. Jacko, Ed. Lawrence Erlbaum Associates, Mahwah, NJ, 2012, 405--430.Google Scholar
- Oviatt, S.L. Taming recognition errors with a multimodal architecture. Commun. ACM 43, 9 (Sept. 2000), 45--51. Google ScholarDigital Library
- Oviatt, S.L. and Cohen, P.R. Perceptual user interfaces: Multimodal interfaces that process what comes naturally. Commun. ACM 43, 3 (Mar. 2000), 45--53. Google ScholarDigital Library
- Oviatt, S.L. and Cohen, P.R. The Paradigm Shift to Multimodality in Contemporary Computer Interfaces. Morgan & Claypool Publishers, San Francisco, CA, 2015.Google ScholarCross Ref
- Stilman, B., Yakhnis, V., and Umanskiy, O. Strategies in large-scale problems. In Adversarial Reasoning: Computational Approaches to Reading the Opponent's Mind, A. Kott and W. McEneaney, Eds. Chapman & Hall/CRC, London, U.K., 2007, 251--285.Google Scholar
- U.S. Army. U.S. Army Field Manual 101--5-1, Chapter 5, 1997; http://armypubs.army.mil/doctrine/dr_pubs/dr_a/pdf/fm1_02c1.pdfGoogle Scholar
Index Terms
- Sketch-Thru-Plan: a multimodal interface for command and control
Recommendations
Demonstration of sketch-thru-plan: a multimodal interface for command and control
ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interactionThis paper demonstrates a multimodal system called Sketch-Thru-Plan (STP) that enables users to speak and draw doctrinal language and symbols in order to create courses of action. We argue that STP can meet many of the challenges inherent in building ...
Using a geometric-based sketch recognition approach to sketch Chinese radicals
AAAI'08: Proceedings of the 23rd national conference on Artificial intelligence - Volume 3Unlike English, where unfamiliar words can be queried for its meaning by typing out its letters, the analogous operation in Chinese is far from trivial due to the nature of its written language. One approach for querying Chinese characters involve ...
Sketch express: facial expressions made easy
SBIM '11: Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and ModelingFinding an effective control interface to manipulate complex geometric objects has traditionally relied on experienced users to place the animation controls. This process, whether for key framed or for motion captured animation, takes a lot of time and ...
Comments