CoCoMaps – Collaborative Cognitive Maps


The experiment CoCoMaps uses an expanded version of the existing Cognitive Map Architecture implemented on Honda’s ASIMO robot in an environment with more complex tasks than already attempted. This will allow the robot to interact in more complex ways, in particular, to simultaneously interact with another robot and more than one person at a time. Thus, the project aims for a group of 2 robots and 2 humans. These systems will enable social interactions that can coexist with the robots’ attention to – and completion of – practical tasks in the workplace. A particular focus is on human detection and tracking algorithms and on an improved dialogue system.

The aim of the project is :

  • Improve natural human-robot communication & collaboration
  • Working together on task specification and completion
  • Based on real-time dialogue skills
  • Cognitive model of turn-taking, knowledge and goals
  • Task-oriented coordination of multi-party task completion
  • Using conversational dialogue to obtain and convey information

The principal components of the dialogue system, as targeted in this demonstration, have been validated piece-wise in laboratory settings, and some subsystems have been demonstrated to work in combination; a finally unified, fully integrated whole remains to be demonstrated and is thus targeted here. Deployment in a single robot has performed well, whereas the deployment on multiple robots has only been demonstrated in simulation.



Thor List

K. R. Thórisson



CMLabs- Communicative Machines



IIIM – Icelandic Institute for Intelligent Machines