Nanomind Project                                                        

 

Neuromorphic Perception and NANO-Memristive CognItioN for High-SpeeD Robotic Actuation (NANO-MIND)

This project has been granted by the Spanish Ministry of Science and Innovation under the grant PID2019-105556GB

 

Project Summary

 

In the last years, due to the availability of large amounts of annotated data and the increase of the computation capability of high-performance computing platforms, we have witnessed a resurgence of artificial intelligence (AI) and neuro-inspired computation. AI systems outperforming human beings in image classification tasks have been demonstrated. However, those systems still lag well behind human beings if we compare them in terms of speed and energy efficiency. The intensive computation requirements of AI recognition systems cause that the developed AI systems for our portable devices perform computations on the cloud. It has been foreseen that by the year 2025, one-fifth of the world's electricity will be consumed by the internet.

The development of efficient information coding schemes and low power AI hardware platforms is a must if we want to witness the spread of AI systems while keeping an affordable energy budget. Current state-of-the-art AI systems are based on information coding and processing paradigm which is quite different from the way biological brains code and process the information. If we consider vision as example, state-of-the-art AI computational vision systems code and process the information as sequences of static frames. However, biological neurons produce and communicate sequences of spikes. In this context, the so-called third generation of neural networks or spiking neural networks has emerged to emulate the efficiency in information coding and computation of human brains.

However, spiking neural networks computational systems lack the maturity of frame-based conventional computing systems in terms of theoretical development, learning and controlling algorithms and availability of event-based sensors, event-based hardware computing platforms, and event-based robotic actuators.

The NANO-MIND project aims to advance in the theoretical and hardware development of neuromorphic spiking neural systems from the sensors level, to the processing up to the control and actuation level.

At the sensing level, NANO-MIND will develop a binocular vision platform using information compressive selective change-driven (SCD) sensors developed in the project, a binaural echo localization platform based on a pair of event-driven audition sensors and novel arrays of magneto-optical sensors.

At the processing level, NANO-MIND will develop a fully event-based cognitive architecture able to perform on-line learning and asynchronous classification of dynamic stimuli based on a novel hybrid CMOS-memristive event-based processor.

At the control and actuation level, event-based actuation and controllers will be designed for two different robotic platforms: a pocket drone and a SCORBOT robotic arm.

The developed technology will be demonstrated in several use-cases and benchmarked with state-of-the-art solutions.