Abstract
We introduce an approach to test and evaluate assistance systems for smart environments. Our work comprises a specification language to describe assistance problems independent of the concrete application domain and a test system to test assistance systems and compare their performance systematically. For the latter, our test system employs software-in-the-loop simulation to test assistance systems in a virtual environment instead of a real deployment. On the one hand, this helps developers of assistance systems to evaluate their implementations and compare them to other systems. On the other hand, the language allows researchers specifying assistance problems at an abstract level. Furthermore, we provide a formal semantics for our language, describe the usage of our test system, and show its applicability using a simple assistance system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
EvAAL competition homepage: http://evaal.aaloa.org
- 2.
IPC homepage: http://ipc.icaps-conference.org
- 3.
In the simulation, a smart environment is represented by a model: the simulation model.
- 4.
Moving a lamp is just an abstract concept. Assume the lamps are spot lights, where the target spot (or: angles between the lamp and the floor) can be set freely by an AS. We also abstract from any form of projection or distortion resulting in non/circular spot lights.
- 5.
Handling invalid actions is beyond the scope here.
- 6.
This situation can of course change significantly when the domain and reward function changes. For instance when imposing a penalty on moving lamps, the maximising AS would get a much lower score and would most likely be outperformed by the minimal distance AS.
References
Bader, S., Dyrba, M.: Goalaviour-based control of heterogeneous and distributed smart environments. In: Proceedings of the 7th International Conference on Intelligent Environments, pp. 142–148. IEEE Computer Society (2011)
Bayha, A., Grüneis, F., Schätz, B.: Model-based software in-the-loop-test of autonomous systems. In: Wainer, G.A., Mosterman, P. (eds.) Proceedings of the 2012 Symposium on Theory of Modeling and Simulation—DEVS Integrative M&S Symposium. Society for Computer Simulation International, Article No. 30 (2012)
Brooks, R.A.: The intelligent room project. In: Proceedings of Second International Conference on Cognitive Technology Humanizing the Information Age, pp. 271–278 (1997)
Chin, J., Callaghan, V., Clarke, G.: An end user tool for customising personal spaces in ubiquitous environments. In: Proceedings of the Third international conference on Ubiquitous Intelligence and Computing, UIC’06, pp. 1080–1089. Springer, Berlin/Heidelberg (2006)
Cook, D.J., Das, S.K.: Smart Environments. Wiley, Hoboken (2005)
Cook, D.J., Huber, M., Gopalratnam, K., Youngblood, M.: Learning to control a smart home environment. In: Riedl, J., Hill, R. (eds.) Innovative Applications of Artificial Intelligence. The AAAI Press, Menlo Park, (2003)
Cook, D.J., Youngblood, M., Das, S.K.: A multi-agent approach to controlling a smart environment. In: Designing Smart Homes. Lecture Notes in Computer Science, vol. 4008, pp. 165–182. Springer, Berlin/Heidelberg (2006)
Dooley, J., Callaghan, H.H.V., Gardner, M., Ghanbaria, M., AlGhazzawi, D.: The intelligent classroom: beyond four walls. In: Proceedings of the Intelligent Campus Workshop (IC’11) held at the 7th IEEE Intelligent Environments Conference (IE’11), Nottingham (2011)
Genesereth, M., Love, N.: General game playing: overview of the AAAI competition. AI Mag. 26, 62–72 (2005)
Ghallab, M., Howe, A., Knoblock, C., Mcdermott, D., Ram, A., Veloso, M., Weld, D., Wilkins, D.: PDDL—the planning domain definition language. Technical Report CVC TR-98-003/DCS TR-1165, Yale Center for Computational Vision and Control (1998)
Gierke, M., Himmelspach, J., Röhl, M., Uhrmacher, A.M.: Modeling and simulation of tests for agents. In: Fischer, K., Timm, I.J., André, E., Zhong, N. (eds.) Multiagent System Technologies. Lecture Notes in Computer Science, vol. 4196, pp. 49–60. Springer (2006)
Giersich, M., Heider, T., Kirste, T.: AI methods for smart environments: a case study on team assistance in smart meeting rooms. In: Proceedings of Scientific Workshop 1: Artificial Intelligence Methods for Ambient Intelligence on European Conference on Ambient Intelligence (AmI-07), Darmstadt, Germany (2007)
Helal, S., Mann, W., El-Zabadani, H., King, J., Kaddoura, Y., Jansen, E.: The gator tech smart house: a programmable pervasive space. Computer 38(3), 50–60 (2005)
Helal, S., Lee, J.W., Hossain, S., Kim, E., Hagras, H., Cook, D.J.: Persim—simulator for human activities in pervasive spaces. In: Proceedings of the Seventh International Conference on Intelligent Environments, pp. 192–199. IEEE Computer Society (2011)
Himmelspach, J.: Konzeption, Realisierung und Verwendung eines allgemeinen Modellierungs-, Simulations- und Experimentiersystems—Entwicklung und Evaluation effizienter Simulationsalgorithmen, vol. 4, 1st edn. Sierke (2007) in German
Himmelspach, J., Uhrmacher, A.M.: Plug’n simulate. In: Proceddings of the 40th Annual Simulation Symposium, pp. 137–143. IEEE Computer Society (2007)
Hoey, J., Poupart, P., von Bertoldi, A., Craig, T., Boutilier, C., Mihailidis, A.: Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. Comput. Vis. Image Underst. 114(5), 503–519 (2010)
Huebscher, M.C., McCann, J.A.: Simulation model for self-adaptive applications in pervasive computing. In: Proceedings of the Database and Expert Systems Applications, pp. 694–698 (2004)
Kientz, J.A., Patel, S.N., Jones, B., Price, E., Mynatt, E.D., Abowd, G.D.: The Georgia Tech Aware Home. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, pp. 3675–3680. ACM, New York (2008)
Krüger, F., Steiniger, A., Bader, S., Kirste, T.: Evaluating the robustness of activity recognition using computational causal behavior models. In: Dey, A.K., Chu, H.-H., Hayes, G. (eds.) Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 1066–1074. ACM Press, New York (2012)
Hambling, B., Morgan, P., Samaroo, A., Thompson, G., Williams, P.: Software Testing: An ISTQB-ISEB Foundation Guide, revised edn. British Informatics Society Ltd., Swindon (2010)
Mozer, M.C.: Lessons from an adaptive house. In: Cook, D.J., Das, R. (eds.) Smart Environments: Technologies, Protocols, and Applications, pp. 273–294. Wiley, Hoboken (2005)
Murphy, K.P.: A survey of POMDP solution techniques. Technical report, Department of Computer Science, University of British Columbia (2000)
Murphy, K.P.: Dynamic bayesian networks: representation, inference and learning. Ph.D. thesis, University of California, Berkeley (2002)
Nakashima, H., Aghajan, H., Augusto, J.C. (eds.): Handbook of Ambient Intelligence and Smart Environments. Springer, New York (2010)
Nishikawa, H., Yamamoto, S., Tamai, M., Nishigaki, K., Kitani, T., Shibata, N., Yasumoto, K., Ito, M.: UbiREAL: Realistic smartspace simulator for systematic testing. In: Dourish, P., Friday, A. (eds.) Proceedings of the 8th international conference on Ubiquitous Computing. Lecture Notes in Computer Science, vol. 4206, pp. 459–476. Springer (2006)
Nyolt, M.: Concept and realisation of a framework for testing general assistance systems. Master’s thesis, University of Rostock (2012)
Pfeffer, A.: IBAL: a probabilistic rational programming language. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence, vol. 1, pp. 733–740. Morgan Kaufmann Publishers Inc., San Francisco (2001)
Poslad, S.: Ubiquitous Computing: Smart Devices, Environments and Interactions.Wiley, Chichester (2009)
Proetzsch, M., Zimmermann, F., Eschbach, R., Kloos, J., Berns, K.: A systematic testing approach for autonomous mobile robots using domain-specific languages. In: KI 2010: Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol. 6359, pp. 317–324. Springer (2010)
Sanner, S.: Relational dynamic influence diagram language (RDDL): language description. http://users.cecs.anu.edu.au/~ssanner/IPPC_2011/RDDL.pdf (2010)
Sato, T.: Logic-based probabilistic modeling. In: Ono, H., Kanazawa, M., de Queiroz, R. (eds.) Logic, Language, Information and Computation. Lecture Notes in Computer Science, vol. 5514, pp. 61–71. Springer, Berlin/Heidelberg (2009)
Uhrmacher, A.M., Röhl, M., Himmelspach, J.: Unpaced and paced simulation for testing agents. In: Verbraeck, A., Hlupic, V. (eds.) Proceedings of the 15th European Simulation Symposium, pp. 71–80. SCS European Publishing House (2003)
Acknowledgements
This research is supported by the German Research Foundation (DFG) within the research training group GRK 1424 MuSAMA (Multimodal Smart Appliance Ensembles for Mobile Applications).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Japan
About this chapter
Cite this chapter
Nyolt, M., Steiniger, A., Bader, S., Kirste, T. (2015). Describing and Evaluating Assistance Using APDL. In: Bai, Q., Ren, F., Zhang, M., Ito, T., Tang, X. (eds) Smart Modeling and Simulation for Complex Systems. Studies in Computational Intelligence, vol 564. Springer, Tokyo. https://doi.org/10.1007/978-4-431-55209-3_5
Download citation
DOI: https://doi.org/10.1007/978-4-431-55209-3_5
Published:
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-55208-6
Online ISBN: 978-4-431-55209-3
eBook Packages: EngineeringEngineering (R0)