MBFair: a model-based verification methodology for detecting violations of individual fairness

Software & Systems Modeling, vol. 24, pp. 111–136

Abstract

Abstract Decision-making systems are prone to discrimination against individuals with regard to protected characteristics such as gender and ethnicity. Detecting and explaining the discriminatory behavior of implemented software is difficult. To avoid the possibility of discrimination from the onset of software development, we propose a model-based methodology called MBFair that allows for verifying UML-based software designs with regard to individual fairness. The verification in MBFair is performed by generating temporal logic clauses, whose verification results enable reporting on the individual fairness of the targeted software. We study the applicability of MBFair using three case studies in real-world settings including a bank services system, a delivery system, and a loan system. We empirically evaluate the necessity of MBFair in a user study and compare it against a baseline scenario in which no modeling and tool support is offered. Our empirical evaluation indicates that analyzing the UML models manually produces unreliable results with a high chance of 46% that analysts overlook true-positive discrimination. We conclude that analysts require support for fairness-related analysis, such as our MBFair methodology.

Authors 5

1. Qusai Ramadan corresponding

   Universität Koblenz

   Affiliation as printed

   University of Koblenz, Koblenz, Germany

2. Marco Konersmann corresponding Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany

3. Amir Shayan Ahmadian corresponding

   Universität Koblenz

   Affiliation as printed

   University of Koblenz, Koblenz, Germany

4. Jan Jürjens

   Fraunhofer Institute for Software and Systems Engineering · Universität Koblenz

   Affiliation as printed

   Fraunhofer-Institute for Software and Systems Engineering ISST, Dortmund, Germany

   University of Koblenz, Koblenz, Germany

5. Steffen Staab corresponding

   University of Stuttgart · University of Southampton

   Affiliation as printed

   University of Southampton, Southampton, UK

   Universität Stuttgart, Stuttgart, Germany