Feb 15, 2021

A new EU-project for developing an intelligent camera-sensor technology


Source: AMO GmbH
Feb 15, 2021

AMO GmbH is partner of MISEL (Multispectral Intelligent Vision System with Embedded Low-Power Neural Computing), a project that aims at developing a bio-inspired vision system able to implement advanced recognition tasks, but with much smaller size, weight and power consumption than off-the-shelf components. The project is funded by the European Commission through the Horizon 2020 Research and Innovation Programme with a total budget of 4.96 million Euros.

Inspired by the neurobiological structures of the human vision system

The architecture of the vision system targeted by MISEL is inspired by the neurobiological structures of the human vision system. The key idea is to implement certain learning and decision-making capabilities directly into the camera sensor. This will increase substantially the speed and the energy-efficiency of the vision system, allowing for fast situation-awareness in dynamically changing environments. To achieve this goal, MISEL will develop camera sensors equipped with pixels with build-in synaptic weights, which can be trained to recognize different patterns through targeted learning processes.

Possible areas of application: autonomous driving, autonomous robotics, and surveillance systems

The new camera sensors will be based on classic silicon CMOS electronics, extended by newly developed neuromorphic elements and by graphene-based photodetectors with adaptive sensitivity for visible and infrared light. This multispectral sensitivity will allow for operation also in challenging environmental conditions, such as darkness, fog, etc. Possible areas of application of MISEL’s vision system include autonomous driving, autonomous robotics, and surveillance systems. 

MISEL is a highly interdisciplinary project that involves nine European research teams with complementary expertise in computer vision, machine learning theory and algorithms, nano- and device technologies, circuit design, and evaluation of artificial-intelligence systems. Coordinated by the VTT Technical Research Centre of Finland, MISELS’s consortium includes AMO GmbH, the University of Wuppertal (Germany), the Fraunhofer Centre for Applied Nanotechnology (Germany), Kovilta Oy (Finland), Lund University (Sweden), Lodz University of Technology (Poland), the University of Santiago de Compostela (Spain) and the Laboratoire national de métrologie et d'Essais (France). MISEL is funded by the European Union’s Horizon 2020 Research and Innovation Programme, under grant agreement Nr. 101016734.

Contact: Dr. Federica Haupt, AMO GmbH
haupt@amo.de 

Links

Member profile

Recommended articles

May 19, 2022

At the IVAM Hightech Summit 2022, the international members of the networks MinacNed, Optence, Nano in Germany, Greentech.Ruhr and SensorikNet …

Feb 16, 2024

ATLANT 3D, a leading innovator in atomic scale advanced manufacturing, proudly announces its membership in the UN Global Compact. This …

Oct 10, 2023

Silicon sensor elements based on MEMS technologies offer multiple advantages over conventional sensor technologies in terms of accuracy, long-term stability, …

Recommended events

Nov 11 - 14, 2024
Product Market “High-tech for Medical Devices” and "COMPAMED HIGH-TECH FORUM" in Hall 8a, F29 (IVAM Lounge)
Feb 4 - 6, 2025
Medical Design & Manufacturing - IVAM presents Micro Nanotech Area in Hall C
Mar 5 - 7, 2025
Discover the Future of Photonics with IVAM