Enforcing Fundamental Relations via Adversarial Attacks on Input Parameter Correlations

arXiv (Cornell University)

Abstract

Correlations between input parameters play a crucial role in many scientific classification tasks, since these are often related to fundamental laws of nature. For example, in high energy physics, one of the common deep learning use-cases is the classification of signal and background processes in particle collisions. In many such cases, the fundamental principles of the correlations between observables are often better understood than the actual distributions of the observables themselves. In this work, we present a new adversarial attack algorithm called Random Distribution Shuffle Attack (RDSA), emphasizing the correlations between observables in the network rather than individual feature characteristics. Correct application of the proposed novel attack can result in a significant improvement in classification performance - particularly in the context of data augmentation - when using the generated adversaries within adversarial training. Given that correlations between input features are also crucial in many other disciplines. We demonstrate the RDSA effectiveness on six classification tasks, including two particle collision challenges (using CERN Open Data), hand-written digit recognition (MNIST784), human activity recognition (HAR), weather forecasting (Rain in Australia), and ICU patient mortality (MIMIC-IV), demonstrating a general use case beyond fundamental physics for this new type of adversarial attack algorithms.

Authors 8

1. Timo Saala

   University of Bonn

   Affiliation as printed

   Institute of Physics , University of Bonn , Germany

2. Lucie Flek

   University of Bonn · Bonn Aachen International Center for Information Technology

   Affiliation as printed

   Bonn-Aachen Institute of Technology , University of Bonn , Germany

3. Alexander Jung Aachen Institute of Experimental physics III A

   RWTH Aachen University

   Affiliation as printed

   Institute of Experimental physics III A , RWTH Aachen University , Germany

4. Akbar Karimi

   University of Bonn · Bonn Aachen International Center for Information Technology

   Affiliation as printed

   Bonn-Aachen Institute of Technology , University of Bonn , Germany

5. Alexander G. Schmidt Aachen Institute of Experimental physics III A

   RWTH Aachen University

   Affiliation as printed

   Institute of Experimental physics III A , RWTH Aachen University , Germany

6. M. Schott

   University of Bonn

   Affiliation as printed

   Institute of Physics , University of Bonn , Germany

7. Philipp Soldin Aachen Institute of Experimental physics III B

   RWTH Aachen University

   Affiliation as printed

   Institute of Experimental physics III B , RWTH Aachen University , Germany

8. Christopher H. Wiebusch Aachen Institute of Experimental physics III B

   RWTH Aachen University

   Affiliation as printed

   Institute of Experimental physics III B , RWTH Aachen University , Germany