NimbleAI: Towards Neuromorphic Sensing-Processing 3D-integrated Chips

Design, Automation, and Test in Europe, pp. 1–6

Abstract

The NimbleAI Horizon Europe project leverages key principles of energy-efficient visual sensing and processing in biological eyes and brains, and harnesses the latest advances in$\mathbf{33D}$stacked silicon integration, to create an integral sensing-processing neuromorphic architecture that efficiently and accurately runs computer vision algorithms in area-constrained endpoint chips. The rationale behind the NimbleAI architecture is: sense data only with high information value and discard data as soon as they are found not to be useful for the application (in a given context). The NimbleAI sensing-processing architecture is to be specialized after-deployment by tunning system-level trade-offs for each particular computer vision algorithm and deployment environment. The objectives of NimbleAI are: (1)$\mathbf{100x}$performance per mW gains compared to state-of-the-practice solutions (i.e., CPU/GPUs processing frame-based video); (2)$\mathbf{50x}$processing latency reduction compared to CPU/GPUs; (3) energy consumption in the order of tens of mWs; and (4) silicon area of approx. 50 mm2.

Authors 48

1. Xabier Iturbe

   Ikerlan

   Affiliation as printed

   IKERLAN,Basque Country (Spain)

   IKERLAN, Basque Country (Spain)

2. Nassim Abderrahmane
   Affiliation as printed

   MENTA,France

   MENTA, France

3. Jaume Abella

   Barcelona Supercomputing Center

   Affiliation as printed

   Barcelona Supercomputing Center (BSC),Catalonia,Spain

   Barcelona Supercomputing Center (BSC), Catalonia, Spain

4. Sergi Alcaide

   Barcelona Supercomputing Center

   Affiliation as printed

   Barcelona Supercomputing Center (BSC),Catalonia,Spain

   Barcelona Supercomputing Center (BSC), Catalonia, Spain

5. Eric Beyne

   IMEC

   Affiliation as printed

   IMEC,Belgium

   IMEC, Belgium

6. Henri‐Pierre Charles

   Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · Université Grenoble Alpes

   Affiliation as printed

   University Grenoble Alpes,CEA-LIST,France

   CEA-LIST, University Grenoble Alpes, France

7. Christelle Charpin-Nicolle

   Université Grenoble Alpes

   Affiliation as printed

   Univ. Grenoble Alpes,CEALETI,France

   CEALETI, Univ. Grenoble Alpes, France

8. Lars Chıttka

   Queen Mary University of London

   Affiliation as printed

   Queen Mary University of London,UK

   Queen Mary University of London, UK

9. Angélica Dávila

   Ikerlan

   Affiliation as printed

   IKERLAN,Basque Country (Spain)

   IKERLAN, Basque Country (Spain)

10. Arne Erdmann
    Affiliation as printed

    Raytrix,Germany

    Raytrix, Germany

11. Carles Estrada

    Ikerlan

    Affiliation as printed

    IKERLAN,Basque Country (Spain)

    IKERLAN, Basque Country (Spain)

12. Á. Álvarez Fernández

    Ikerlan

    Affiliation as printed

    IKERLAN,Basque Country (Spain)

    IKERLAN, Basque Country (Spain)

13. Anna Fontanelli
    Affiliation as printed

    Monozukuri (MZ Technologies),Italy

    Monozukuri (MZ Technologies), Italy

14. José Flich

    Universitat Politècnica de València

    Affiliation as printed

    Universitat Politecnica de Valencia,Spain

    Universitat Politecnica de Valencia, Spain

15. Gianluca Furano

    European Space Research and Technology Centre

    Affiliation as printed

    ESA ESTEC,Netherlands

    ESA ESTEC, Netherlands

16. Alejandro Hernán Gloriani
    Affiliation as printed

    Viewpointsystem,Austria

    Viewpointsystem, Austria

17. Erik Isusquiza
    Affiliation as printed

    ULMA Medical Technologies,Basque Country (Spain)

    ULMA Medical Technologies, Basque Country (Spain)

18. Radu Grosu

    TU Wien

    Affiliation as printed

    TU Wien,Austria

    TU Wien, Austria

19. Carles Hernández

    Universitat Politècnica de València

    Affiliation as printed

    Universitat Politecnica de Valencia,Spain

    Universitat Politecnica de Valencia, Spain

20. Daniele Ielmini

    Politecnico di Milano

    Affiliation as printed

    Politecnico Milano,Italy

    Politecnico Milano, Italy

21. Maha Kooli

    Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · Université Grenoble Alpes

    Affiliation as printed

    University Grenoble Alpes,CEA-LIST,France

    CEA-LIST, University Grenoble Alpes, France

22. Nicola Lepri

    Politecnico di Milano

    Affiliation as printed

    Politecnico Milano,Italy

    Politecnico Milano, Italy

23. B. Linares-Barranco

    Consejo Superior de Investigaciones Científicas

    Affiliation as printed

    CSIC,Spain

    CSIC, Spain

24. Jean-Loup Lachese
    Affiliation as printed

    MENTA,France

    MENTA, France

25. Éric Laurent
    Affiliation as printed

    MENTA,France

    MENTA, France

26. Menno Lindwer
    Affiliation as printed

    GrAI Matter Labs (GML),Netherlands

    GrAI Matter Labs (GML), Netherlands

27. Frank Linsenmaier
    Affiliation as printed

    Viewpointsystem,Austria

    Viewpointsystem, Austria

28. Mikel Luján

    University of Manchester

    Affiliation as printed

    University of Manchester,UK

    University of Manchester, UK

29. Karel Masařík
    Affiliation as printed

    CODASIP,Czech Republic

    CODASIP, Czech Republic

30. Nele Mentens Aachen

    Leiden University

    Affiliation as printed

    Universiteit Leiden,Netherlands

    Universiteit Leiden, Netherlands

31. Orlando Moreira
    Affiliation as printed

    GrAI Matter Labs (GML),Netherlands

    GrAI Matter Labs (GML), Netherlands

32. Chinmay Nawghane

    IMEC

    Affiliation as printed

    IMEC,Belgium

    IMEC, Belgium

33. Luca Peres

    University of Manchester

    Affiliation as printed

    University of Manchester,UK

    University of Manchester, UK

34. Jean-Philippe Noël

    Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · Université Grenoble Alpes

    Affiliation as printed

    University Grenoble Alpes,CEA-LIST,France

    CEA-LIST, University Grenoble Alpes, France

35. Arash Pourtaherian
    Affiliation as printed

    GrAI Matter Labs (GML),Netherlands

    GrAI Matter Labs (GML), Netherlands

36. C. Posch
    Affiliation as printed

    PROPHESEE,France

    PROPHESEE, France

37. Peter Priller

    Anstalt für Verbrennungskraftmaschinen List (Austria)

    Affiliation as printed

    AVL List,Austria

    AVL List, Austria

38. Zdeněk Přikryl
    Affiliation as printed

    CODASIP,Czech Republic

    CODASIP, Czech Republic

39. Félix Resch

    TU Wien

    Affiliation as printed

    TU Wien,Austria

    TU Wien, Austria

40. Oliver Rhodes

    University of Manchester

    Affiliation as printed

    University of Manchester,UK

    University of Manchester, UK

41. Todor P. Stefanov Aachen

    Leiden University

    Affiliation as printed

    Universiteit Leiden,Netherlands

    Universiteit Leiden, Netherlands

42. Moritz Störring

    IMEC

    Affiliation as printed

    IMEC,Belgium

    IMEC, Belgium

43. Michele Taliercio
    Affiliation as printed

    Monozukuri (MZ Technologies),Italy

    Monozukuri (MZ Technologies), Italy

44. Rafael Tornero

    Universitat Politècnica de València

    Affiliation as printed

    Universitat Politecnica de Valencia,Spain

    Universitat Politecnica de Valencia, Spain

45. Marcel van de Burgwal

    IMEC

    Affiliation as printed

    IMEC,Belgium

    IMEC, Belgium

46. Geert Van der Plas

    IMEC

    Affiliation as printed

    IMEC,Belgium

    IMEC, Belgium

47. Elisa Vianello

    Université Grenoble Alpes

    Affiliation as printed

    Univ. Grenoble Alpes,CEALETI,France

    CEALETI, Univ. Grenoble Alpes, France

48. Pavel G. Zaykov
    Affiliation as printed

    CODASIP,Czech Republic

    CODASIP, Czech Republic