Neuromorphic Processing and Cognition for Sensory Fusion and Robotics
NEKOR is a subproject of a coordinated one. The SAMURAI coordinated project proposes an ambitious development of compact, low-power and high-speed neuromorphic multimodal-sensing-processing-actuation systems for multiple robotic platforms, including on-line learning capabilities exploiting the sparseness and compression advantages of spike-based coding from sensor to actuation level. The project proposes to advance in the development of different complementary event-based visual and auditory sensors, the development of low-power HW implementations of computing systems, the development of hybrid nano-memristive adaptive computing modules with analog weight online learning and the integration of the hardware modules in several efficient robotic platforms. Therefore, the project requires developments at different levels of abstraction, from low-level sensor design, custom hardware modules, digital programmable modules, computational algorithms up to mechanical and robotic control. The expertise at the different levels of abstraction of the project is not available in a single research group. However, the combination of the three participant groups creates the required synergies to successfully tackle all the different aspects proposed in the project. The UV group has experience designing CMOS full custom event-based hardware vision sensors and developing beyond-vision sensors (such as magnetic) from the event-based perspective. The IMSE group has experience designing event-based Electronically-Foveated Dynamic Vision Sensors (EFDVS) and hybrid CMOS-memristive neuromorphic hardware for online learning. The US group (NEKOR subproject) has experience in event-based audio processing, sensory fusion and embedded co-design systems.
PIs: Alejandro Linares Barranco / Juan Pedro Domínguez Morales
Type: Plan Estatal 2021-2023 – Proyectos Investigación No Orientada
Reference: PID2023-149071NB-C54
Funding by: Ministerio de Ciencia, Innovación y Universidades
Start date: 01-09-2024
End date: 31-12-2028
Researchers:
Jiménez Moreno, Gabriel
Piñero Fuentes, Enrique
Curra Sosa, Dagnier Antonio
Müller Cejás, Carlos
Gómez Rodríguez, Francisco de Asís
Pérez Peña, Fernando
Cerezuela Escudero, Elena
Montes Sánchez, Juan Manuel
Trejos Hernández, Diógenes Enrique
Durán López, Lourdes
Pérez Peña, Antonio Manuel
Casanueva Morato, Daniel
López Osorio, Pablo
Ríos Navarro, José Antonio
Orellana Martín, David
Ayuso Martínez, Álvaro
Ragel Díaz-Jara, David
Díaz Romero, Santiago
Muñoz González, Tomás
More Information:
