Abstract
We report on the technology transfer project “Do it yourself, but not alone: Companion-Technology for Home Improvement” that was carried out by Ulm University in cooperation with Robert Bosch GmbH. We developed a prototypical assistance system that assists a Do It Yourself (DIY) handyman in carrying out DIY projects. The assistant, based on various AI and dialog management capabilities, generates a sequence of detailed instructions that users may just follow or adapt according to their individual preferences. It features explanation capabilities as well as pro-active support based on communication with the user as well as with the involved tools. We report on the project’s main achievements, including the findings of various empirical studies conducted in various development stages of the prototype.
Similar content being viewed by others
References
Behnke G, Bercher P, Kraus M, Schiller M, Mickeleit K, Häge T, Dorna M, Dambier M, Minker W, Glimm B, Biundo S (2020) New developments for Robert—assisting novice users even better in DIY projects. In: ICAPS. AAAI Press, pp. 343–347
Behnke G, Biundo S (2018) X and more parallelism: integrating LTL-next into SAT-based planning with trajectory constraints while allowing for even more parallelism. Intell Artif 21(62):75–90
Behnke G, Höller D, Bercher P, Biundo S (2016) Change the plan—how hard can that be? In: ICAPS. AAAI Press, pp 38–46
Behnke G, Höller D, Biundo S (2015) On the complexity of HTN plan verification and its implications for plan recognition. In: ICAPS. AAAI Press, pp 25–33
Behnke G, Höller D, Biundo S (2019) Bringing order to chaos–a compact representation of partial order in SAT-based HTN planning. In: AAAI. AAAI Press, pp 7520–7529
Behnke G, Höller D, Biundo S (2019) Finding optimal solutions in HTN planning—a SAT-based approach. pp 5500–5508. ijcai.org
Behnke G, Höller D, Schmid A, Bercher P, Biundo S (2020) On succinct groundings of HTN planning problems. In: AAAI. AAAI Press, pp 9775–9784
Behnke G, Höller D, Biundo S (2018) Tracking branches in trees—a propositional encoding for solving partially-ordered HTN planning problems. In: IEEE international conference on tools with AI (ICTAI). IEEE Computer Society, pp 73–80
Behnke G, Schiller M, Kraus M, Bercher P, Schmautz M, Dorna M, Dambier M, Minker W, Glimm B, Biundo S (2019) Alice in DIY-wonderland or: instructing novice users on how to use tools in DIY projects. AI Commun 32(1):31–57
Bercher P, Alford R, Höller D (2019) A survey on hierarchical planning—one abstract idea, many concrete realizations. In: IJCAI. pp 6267–6275. ijcai.org
Bercher P, Behnke G, Höller D, Biundo S (2017) An admissible HTN planning heuristic. In: IJCAI. pp 480–488. ijcai.org
Bercher P, Biundo S, Geier T, Hoernle T, Nothdurft F, Richter F, Schattenberg B (2014) Plan, repair, execute, explain—how planning helps to assemble your home theater. In: ICAPS. AAAI Press, pp 386–394
Bercher P, Keen S, Biundo S (2014) Hybrid planning heuristics based on task decomposition graphs. In: Annual symposium on combinatorial search (SoCS). AAAI Press, pp 35–43
Bercher P, Olz C (2020) POP \(\equiv\) POCL, right? Complexity results for partial order (causal link) makespan minimization. AAAI Press, pp 9785–9793
Bercher P, Richter F, Honold F, Nielsen F, Schüssel F, Geier T, Hörnle T, Reuter S, Höller D, Behnke G, Dietmayer K, Minker W, Weber M, Biundo S (2018) A Companion-system architecture for realizing individualized and situation-adaptive user assistance. Tech. rep., Ulm University
Biundo S, Bercher P, Geier T, Müller F, Schattenberg B (2011) Advanced user assistance based on AI planning. Cogn Syst Res 12(3–4):219–236
Biundo S, Schattenberg B (2001) From abstract crisis to concrete relief–a preliminary report on combining state abstraction and HTN planning. In: European conference on planning (ECP). AAAI Press, pp 157–168
Biundo S, Wendemuth A (2016) Companion-technology for cognitive technical systems. Künstliche Intelligenz 30(1):71–75
Biundo S, Wendemuth A (2017) An introduction to companion-technology. In: Biundo S, Wendemuth A (eds) Companion technology—a paradigm shift in human-technology interaction. Springer, Berlin
Erol K, Hendler JA, Nau DS (1996) Complexity results for HTN planning. Ann Math Artif Intell (AMAI) 18(1):69–93
Fox M, Long D (2003) PDDL2.1: an extension to PDDL for expressing temporal planning domains. J Artif Intell Res (JAIR) 20:61–124
Höller D, Bercher P, Behnke G, Biundo S (2018) A generic method to guide HTN progression search with classical heuristics. In: ICAPS. AAAI Press, pp 114–122
Höller D, Bercher P, Behnke G, Biundo S (2019) On guiding search in HTN planning with classical planning heuristics. In: IJCAI. pp 6171–6175. ijcai.org
Höller D, Bercher P, Behnke G, Biundo S (2020) HTN planning as heuristic progression search. J Artif Intell Res (JAIR) 67:835–880
Höller D, Bercher P, Richter F, Schiller M, Geier T, Biundo S (2014) Finding user-friendly linearizations of partially ordered plans. In: Workshop “Planen, Scheduling und Konfigurieren, Entwerfen” (PuK)
Höller D, Behnke G, Bercher P, Biundo S, Fiorino H, Pellier D, Alford R (2020) HDDL: an extension to PDDL for expressing hierarchical planning problems. In: AAAI. AAAI Press, pp 9883–9891
Kraus M, Fischbach F, Jansen P, Minker W (2020) A comparison of explicit and implicit proactive dialogue strategies for conversational recommendation. In: Language Resources and Evaluation Conference (LREC). ELRA, pp 429–435
Kraus M, Schiller M, Behnke G, Bercher P, Biundo S, Glimm B, Minker W (2019) A Multimodal dialogue framework for cloud-based companion systems. Springer, pp 405–410
Kraus M, Schiller M, Behnke G, Bercher P, Dorna M, Dambier M, Glimm B, Biundo S, Minker W (2020) “Was that successful” On integrating proactive meta-dialogue in a DIY-assistant system using multimodal cues. In: International conference on multimodal interaction (ICMI). ACM
Kraus M, Wagner N, Minker W (2020) Effects of proactive dialogue strategies on human-computer trust. In: ACM conference on user modeling, adaptation and personalization (UMAP). Association for Computing Machinery, pp 107–116
Leichtmann B, Bercher P, Höller D, Behnke G, Biundo S, Nitsch V, Baumann M (2018) Towards a companion system incorporating human planning behavior—a qualitative analysis of human strategies. In: Transdisciplinary conference on support technologies (TCST). pp 89–98
Mattmüller R, Rintanen J (2007) Planning for temporally extended goals as propositional satisfiability. In: IJCAI. AAAI Press, pp 1966–1971
Nothdurft F, Richter F, Minker W (2014) Probabilistic human–computer trust handling. In: Annual meeting of the special interest group on discourse and dialogue (SIGDIAL). Association for Computational Linguistics, pp 51–59
Olz C, Bercher P (2019) Eliminating redundant actions in partially ordered plans—a complexity analysis. In: ICAPS. AAAI Press, pp 310–319
Pnueli A (1977) The temporal logic of programs. In: Annual symposium on Foundations of computer science (SFCS). IEEE, pp 46–57
Schiller M, Behnke G, Bercher P, Kraus M, Dorna M, Richter F, Biundo S, Glimm B Minker W (2018) Evaluating knowledge-based assistance for DIY. In: MCI Workshop “Digital Companion”, pp 925–930
Schiller M, Behnke G, Schmautz M, Bercher P, Kraus M, Dorna M, Minker W, Glimm B, Biundo S (2017) A paradigm for coupling procedural and conceptual knowledge in companion systems. In: International conference on computer technology (ICCT). IEEE
Schiller M, Schiller F, Glimm B (2017) Testing the adequacy of automated explanations of el subsumptions. In: Proceedings of DL 2017, CEUR Workshop, 1879
Acknowledgements
This work was partly funded by the technology transfer project “Do it yourself, but not alone: Companion-Technology for Home Improvement” of the CRC/TRR 62 funded by the German Research Foundation (DFG). The industrial project partner is the Corporate Research Sector of the Robert Bosch GmbH.
Author information
Authors and Affiliations
Corresponding author
Additional information
P. Bercher, G. Behnke: Most results described were achieved while still at Ulm University.
Rights and permissions
About this article
Cite this article
Bercher, P., Behnke, G., Kraus, M. et al. Do It Yourself, but Not Alone: Companion-Technology for Home Improvement—Bringing a Planning-Based Interactive DIY Assistant to Life. Künstl Intell 35, 367–375 (2021). https://doi.org/10.1007/s13218-021-00721-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13218-021-00721-x