Networking is an indispensable tool for disaster situations. Since it is predictable that there are no professional technicians around the place where the faults occur, a solution of collaborative problem solving between humans and agents makes the non-professionals to improve that situation. In this paper, to address the errors of the network under the disaster situation, we propose a multi-modal interaction mechanism for temporally organized groups of humans and agents who accidentally present at a short distance. A prototypical system including the proposed mechanism and the network management support agents shows that the flexible collaboration realizes the useful restoration.