Interacting with virtual and augmented worlds

For more than three decades, the main focus was to be able to model realistic decors, lights and living beings, particularly humans that should look realistic. Actually, we are aiming for interacting with these worlds in a sensitive and meaningful way. In this talk, the research that is developed on many aspects at MIRALab is presented: interactive modelling of virtual humans, interactive clothes modelling and animation, touching textiles, haptic interaction with hair, gaze interaction with Virtual Humans in Augmented Reality, talking and being recognized by virtual humans with memory and personality models. We will describe what the problems are, what the solutions now are and what the next step to come is. We will show plenty of examples we have developed in our several European Projects in which we are participating.