Yong (Yates) Lin
ABSTRACT
Dialogue management system is originated when human-computer interaction (HCI) was dominated by a single computer. With the development of sensor networks and pervasive techniques, the HCI has to adapt into pervasive environments. Pervasive interaction is a form of HCI derived under the context of pervasive computing. This paper introduces a pervasive interaction based planning and reasoning system for individuals with cognitive impairment, for their activities of daily living. Our system is a fusion of speech prompt, speech recognition as well as events from sensor networks.
The system utilizes Markov decision processes for activity planning, and partially observable Markov decision processes for action planning and executing. Multimodal and multi-observation is the characteristics of a pervasive interaction system. Experimental results demonstrate the flexible effect the reminder system works for activity planning.
- Jim Blythe. Decision-theoretic planning. AI Magazine, 20, 1999.Google Scholar
- Jennifer Boger, Pascal Poupart, Jesse Hoey, Craig Boutilier, Geoff Fernie, and Alex Mihailidis. A decision-theoretic approach to task assistance for persons with dementia. In Proceedings of IJCAI, pages 1293--1299, 2005. Google ScholarDigital Library
- Frank Broz, Illah R. Nourbakhsh, and Reid G. Simmons. Planning for human-robot interaction using time-state aggregated POMDPs. In Proceedings of AAAI, pages 1339--1344, 2008. Google ScholarDigital Library
- Shihao Ji, Ronald Parr, Hui Li, Xuejun Liao, and Lawrence Carin. Point-based policy iteration. In AAAI, pages 1243--1249. AAAI Press, 2007. Google ScholarDigital Library
- D. Kawanaka, T. Okatani, and K. Deguchi. HHMM based recognition of human activity. Transactions Institute Elec. Info. and Comm. Eng., E89-D(7):2180--2185, July 2006. Google ScholarDigital Library
- Richard Kelley, Alireza Tavakkoli, Christopher King, Monica Nicolescu, Mircea Nicolescu, and George Bebis. Understanding human intentions via hidden markov models in autonomous mobile robots. In Proc. of the 3rd ACM/IEEE international conference on Human robot interaction, pages 367--374, 2008. Google ScholarDigital Library
- Hyong-Euk Lee, Youngmin Kim, Kwang-Hyun Park, and Z. Z. Bien. Development of a steward robot for human-friendly interaction. In Control Applications (CCA), pages 551--556, 2006.Google ScholarCross Ref
- Yong Lin, Eric Becker, Kyungseo Park, Zhengyi Le, and Fillia Makedon. Decision making in assistive environments using multimodal observations. In Proc. of the 2nd International Conference on PErvsive Technologies Related to Assistive Environments, pages 1--8, 2009. Google ScholarDigital Library
- Martin Mühlenbrock, Oliver Brdiczka, Dave Snowdon, and Jean-Luc Meunier. Learning to detect user activity and availability from a variety of sensor data. In Proceedings of the Second IEEE International Conference on Pervasive Computing and Communications, page 13, 2004. Google ScholarDigital Library
- Joelle Pineau, Nicholas Roy, and Sebastian Thrun. A hierarchical approach to pomdp planning and execution. In Workshop on Hierarchy and Memory in Reinforcement Learning (ICML), 2001.Google Scholar
- Martha E. Pollack. Planning technology for intelligent cognitive orthotics. In Proceedings of the Sixth International Conference on Artificial Intelligence Planning Systems (AIPS), page 322, 2002.Google ScholarDigital Library
- Satinder Singh and David Cohn. How to dynamically merge markov decision processes. In Proceedings of NIPS, pages 1057--1063, 1998. Google ScholarDigital Library
- Trey Smith and Reid G. Simmons. Point-based POMDP algorithms: Improved analysis and implementation. In Proc. of UAI, pages 542--547, 2005.Google Scholar
- Douglas L. Vail, Manuela M. Veloso, and John D. Lafferty. Conditional random fields for activity recognition. In Proceedings of AAMAS, pages 1--8, 2007. Google ScholarDigital Library
- Jason D. Williams and Steve Young. Partially observable markov decision processes for spoken dialog systems. Comput. Speech Lang., 21(2):393--422, 2007. Google ScholarDigital Library
Index Terms
- From dialogue management to pervasive interaction based assistive technology
Recommendations
Pervasive Interaction
The coming era will offer a hardware-agnostic ecology in which information flows to and from any nearby device in the most appropriate fashion. However, the current proliferation of devices has resulted in a world that's increasingly fragmented and rife ...
Toward Pervasive Interaction: Empowering and Enriching Interactions on Resource-constrained Devices
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersMultimedia technology for pervasive computing environment
With the emerging multimedia techniques which can be used for various pervasive and ubiquitous applications such as healthcare, environmental monitoring, security and surveillance, there are a number of important challenges that arise when multimedia ...
Comments