• Condividi su Facebook

EYESHOTS - Heterogeneous 3-D perception across visual fragments

  • 17216
  • CORDIS - PROJECTS 21/01/2008
  • RISULTATO

The research intends to investigate the interplay existing between vision and motion control, and to study how to exploit this interaction to achieve a knowledge of the surrounding environment that allows a robot to act properly. Robot perception can be flexibly integrated with its own actions and the understanding of planned actions of humans in a shared workspace. The research relies upon the assumption that a complete and operative cognition of visual space can be achieved only through active exploration of it: the natural effectors of this cognition are the eyes and the arms.
Crucial but yet unsolved issues we address are object recognition, dynamic shifts of attention, 3D space perception including eye and arm movements including action selection in unstructured environments. We propose a flexible solution based on the concept of visual fragments, which avoids a central representation of the environment and rather uses specialized components that interact with each other and tune themselves on the task at hand.
In addition to a high standard in engineering solutions the development and application of novel learning rules enables our system to acquire the necessary information directly from the environment. The study and models of human/primate behaviour, based on specific experiments, guide many of our envisaged solutions.
Three main objectives will be addressed:

  • a robotic system for interactive visual stereopsis {composed of: an anthropomorphic mechatronic binocular system; and software vision modules based on cortical-like population, to be used as an experimental platform}.
  • a model of a multisensory egocentric representation of the 3D space {constructed on binocular visual cues, signals from the oculomotor systems, signals about reaching movements performed by the arm}.
  • a model of human-robot cooperative actions in a shared workspace {relaying on the concept of shared attention to understand the intention or goal of the communicating partner}.


Start date: 2008-03-01
End date: 2011-02-28

Duration: 36 months

Project Reference: 217077

Project cost: 3168232 EURO
Project Funding: 2400000 EURO

Subprogramme Area: Cognitive Systems, Interaction, Robotics
Contract type: Collaborative project (generic)



Coordinatore: UNIVERSITA DEGLI STUDI DI GENOVA - GENOVA - ITALIA - Caviglia, Daniele

Altri Partecipanti

  • KATHOLIEKE UNIVERSITEIT LEUVEN - LEUVEN - BELGIQUE-BELGIË
  • ALMA MATER STUDIORUM - UNIVERSITA DI BOLOGNA - BOLOGNA - ITALIA
  • UNIVERSITAT JAUME I DE CASTELLON - CASTELLON DE LA PLANA - ESPAÑA
  • WESTFAELISCHE WILHELMS-UNIVERSITAET MUENSTER - MUENSTER - DEUTSCHLAND
Quadro di finanziamento
  • 7FP-ICT : TECNOLOGIE DELL’INFORMAZIONE E DELLA COMUNICAZIONE: priorità tematica 3 nell'ambito del programma specifico “Cooperazione” recante attuazione del Settimo programma quadro (2007-2013) di attività comunitarie di ricerca, sviluppo tecnologico e dimostrazione
Area di interesse
  • Unione Europea