POPPerception On Purpose
POP - Perception On Purpose
POP was a 3-year scientific project (January 2006 - December 2008) granted by the European Commission under Cognitive Systems. EC project number is FP6-IST-2004-027268.
The main scientific results of POP will be presented at CogSys 2010, the 4th International Conference on Cognitive Systems, January 27 & 28 2010, ETH Zurich, Switzerland.
POP on ICT-results : Robotic perception, on purpose
The final report (May 2009) is available here : POP Final report.
Project coordinator and contact : Radu Horaud, INRIA Grenoble Rhône-Alpes, France
Partners : INRIA, U. Osnabrück, U. Hospital Hamburg-Eppendorf, U. Coimbra, & U. Sheffield (see below for more details or click on the "Partners" button).
Summary
The ease with which we make sense of our environment belies the complex processing required to convert sensory signals into meaningful cognitive descriptions. Computational approaches have so far made little impact on this fundamental problem. Visual and auditory processes have typically been studied independently, yet it is clear that the two senses provide complementary information which can help a system to respond robustly in challenging conditions. In addition, most algorithmic approaches adopt the perspective of a static observer or listener, ignoring all the benefits of interaction with the environment. This project proposes the development of a fundamentally new approach, perception on purpose, which is based on 5 principles :
visual and auditory information should be integrated in both space and time.
active exploration of the environment is required to improve the audiovisual signal-to-noise ratio.
the enormous potential sensory requirements of the entire input array should be rendered manageable by multimodal models of attentional processes.
bottom-up perception should be stabilized by top-down cognitive function and lead to purposeful action.
all parts of the system should be underpinned by rigorous mathematical theory, from physical models of low-level binocular and binaural sensory processing to trainable probabilistic models of audiovisual scenes.
These ideas will be put into practice through behavioural and neuroimaging studies as well as in the construction of testable computational models. A demonstrator platform consisting of a mobile audiovisual head will be developed and its behaviour evaluated in a range of application scenarios. Project participants represent leading institutions with the expertise in computational, behavioural and cognitive neuroscientific aspects of vision and hearing needed both to carry out the POP manifesto and to contribute to the training of a new community of scientists.
Partners
INRIA (Computer vision and statistics groups) - Project coordinator and partner 1 ;
University of Osnabrück (Institute of Cognitive Science)- Partner 2
University Hospital Hamburg-Eppendorf (Institute of Neurophysiology and Pathophysiology) - Partner 3
University of Coimbra (Institute for Systems and Robotics) - Partner 4
University of Sheffield (Speech and Hearing group) - Partner 5
