Mixed-initiative collaboration between a humanoid robot and a virtual human through a common platform for a real-world common task: Evaluation and benchmarking
Abstract: This article presents mixed-initiative collaboration between two artificial agents of heterogeneous realities (a humanoid robot and a virtual human) for a real-world social task communicated through a common platform. A detailed framework for the collaboration is developed. Based on the framework, a representative real-world task to be performed through collaboration between the artificial agents for the wellbeing of humans is decided, which is to search for a missing (hidden) object in a homely environment. The agents are enriched with various similar intelligence and autonomy, functionalities and interaction modalities, and are integrated through a common communication platform based on a collaboration scheme so that they can collaborate (assist each other) to perform the real-world task. As a part of the collaboration scheme, a robot-virtual human bilateral trust model is derived and a real-time trust measurement method is developed so that the role of taking initiative in the collaboration can be switched between the agents triggered by the bilateral trust, which results in a mixed-initiative collaboration. An evaluation scheme is developed to evaluate the performance of the agents for the collaborative task. To benchmark their performance in the collaboration, human’s collaborations with the artificial agents and with some other allied agents for the same task are studied. The evaluation and benchmarking results show that both the robot and the virtual human perform satisfactorily in their collaboration, which proves the effectiveness of the real-world collaboration between the artificial agents of heterogeneous realities as well as justifies the effectiveness of the common platform and of the bilateral trust-based mixed-initiatives between the artificial agents. The results can be used to develop intelligent agents of heterogeneous realities to assist humans in various real-world tasks or help humans get real-world tasks performed in cooperation between artificial agents of heterogeneous realities.
Keywords: Human-robot interaction, human-virtual human interaction, robot-virtual human collaboration, interaction evaluation, benchmark, common platform, mixed-initiative, trust, smart homes, assisted living, telepresence
