Interpreting Emergent Features in Deep Learning-based Side-channel Analysis

arXiv (Cornell University)

Abstract

Side-channel analysis (SCA) poses a real-world threat by exploiting unintentional physical signals to extract secret information from secure devices. Evaluation labs also use the same techniques to certify device security. In recent years, deep learning has emerged as a prominent method for SCA, achieving state-of-the-art attack performance at the cost of interpretability. Understanding how neural networks extract secrets is crucial for security evaluators aiming to defend against such attacks, as only by understanding the attack can one propose better countermeasures. In this work, we apply mechanistic interpretability to neural networks trained for SCA, revealing \textit{how} models exploit \textit{what} leakage in side-channel traces. We focus on sudden jumps in performance to reverse engineer learned representations, ultimately recovering secret masks and moving the evaluation process from black-box to white-box. Our results show that mechanistic interpretability can scale to realistic SCA settings, even when relevant inputs are sparse, model accuracies are low, and side-channel protections prevent standard input interventions.

Authors 3

1. Sengim Karayalçın Aachen

   Leiden University

   Affiliation as printed

   Leiden University , The Netherlands

2. Marina Krček

   Radboud University Nijmegen

   Affiliation as printed

   Radboud University , The Netherlands

3. Stjepan Picek

   Radboud University Nijmegen · University of Zagreb · Faculty of Electrical Engineering and Computing in Zagreb

   Affiliation as printed

   Radboud University , The Netherlands

   University of Zagreb Faculty of Electrical Engineering and Computing , Croatia &