How to Measure Fairness in AI Models

Written by demographic | Published 2025/03/24
Tech Story Tags: ai-fairness | ai-bias | fair-learning-algorithms | demographic-parity | sa-dro | ethical-ai-algorithms | ai-fairness-criteria | fair-supervised-learning

TLDR Fair supervised learning requires meeting fairness criteria, such as demographic parity. This section reviews standard fairness measures and dependence metrics used to detect and mitigate bias in AI models.via the TL;DR App

Table of Links

Abstract and 1 Introduction

2 Related Works

3 Preliminaries

3.1 Fair Supervised Learning and 3.2 Fairness Criteria

3.3 Dependence Measures for Fair Supervised Learning

4 Inductive Biases of DP-based Fair Supervised Learning

4.1 Extending the Theoretical Results to Randomized Prediction Rule

5 A Distributionally Robust Optimization Approach to DP-based Fair Learning

6 Numerical Results

6.1 Experimental Setup

6.2 Inductive Biases of Models trained in DP-based Fair Learning

6.3 DP-based Fair Classification in Heterogeneous Federated Learning

7 Conclusion and References

Appendix A Proofs

Appendix B Additional Results for Image Dataset

3.1 Fair Supervised Learning

3.2 Fairness Criteria

In a fair supervised learning algorithm, the learned prediction rule is expected to meet a fairness criterion. Here, we review two standard fairness criteria in the literature:

3.3 Dependence Measures for Fair Supervised Learning

To measure the DP-based fairness violation, the machine learning literature has proposed the application of several dependence measures which we analyze in the paper. In the following, we review some of the applied dependence metrics:

This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.


Authors:

(1) Haoyu LEI, Department of Computer Science and Engineering, The Chinese University of Hong Kong ([email protected]);

(2) Amin Gohari, Department of Information Engineering, The Chinese University of Hong Kong ([email protected]);

(3) Farzan Farnia, Department of Computer Science and Engineering, The Chinese University of Hong Kong ([email protected]).


Written by demographic | Snapshot of society, a statistical portrait of people, age, gender, understanding populations, and their diverse stories
Published by HackerNoon on 2025/03/24