Differentiable Content Addressable Memory with Memristors

Advanced Electronic Materials, vol. 8

Abstract

Abstract Memristors, Flash, and related nonvolatile analog device technologies offer in‐memory computing structures operating in the analog domain, such as accelerating linear matrix operations in array structures. These take advantage of analog tunability and large dynamic range. At the other side, content addressable memories (CAM) are fast digital lookup tables which effectively perform nonlinear Boolean logic and return a digital match/mismatch value. Recently, nonvolatile analog CAMs have been presented merging analog storage and analog search operations with digital match/mismatch output. However, CAM blocks cannot easily be inserted within a larger adaptive system due to the challenges of training and learning with binary outputs. Here, a missing link between analog crossbar arrays and CAMs, namely a differentiable content addressable memory (dCAM), is presented. Utilizing nonvolatile memories that act as a “soft” memory with analog outputs, dCAM enables learning and fine‐tuning of the memory operation and performance. Four applications are quantitatively evaluated to highlight the capabilities: improved data pattern storage, improved robustness to noise and variability, reduced energy and latency performance, and an application to solving Boolean satisfiability optimization problems. The use of dCAM is envisioned as a core building block of fully differentiable computing systems employing multiple types of analog compute operations and memories.

Authors 9

1. Giacomo Pedretti corresponding

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

2. Catherine E. Graves corresponding

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

3. Thomas Van Vaerenbergh

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

4. Sergey Serebryakov

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

5. Martin Foltín

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

6. Xia Sheng

   Hewlett-Packard (United States)

   Affiliation as printed

   Hewlett Packard Labs Milpitas CA 95035 USA

   Hewlett Packard Labs, Milpitas, CA, 95035 USA

7. Ruibin Mao

   University of Hong Kong

   Affiliation as printed

   The University of Hong Kong Hong Kong SAR China

   The University of Hong Kong, Hong Kong, SAR, China

8. Can Li

   University of Hong Kong

   Affiliation as printed

   The University of Hong Kong Hong Kong SAR China

   The University of Hong Kong, Hong Kong, SAR, China

9. John Paul Strachan corresponding Aachen Peter Grünberg Institute (PGI 10)

   Forschungszentrum Jülich · RWTH Aachen University

   Affiliation as printed

   Peter Grünberg Institute (PGI‐14), Forschungszentrum Jülich GmbH Jülich, Germany 52428 RWTH Aachen University 52062 Aachen Germany

   Peter Grünberg Institute (PGI‐14), Forschungszentrum Jülich GmbH Jülich, Germany 52428 RWTH Aachen University 52062 Aachen Germany