We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360.
- Authors
Blow, Christina Hastings; Qian, Lijun; Gibson, Camille; Obiomon, Pamela; Dong, Xishuang
- Abstract
Fairness Artificial Intelligence (AI) aims to identify and mitigate bias throughout the AI development process, spanning data collection, modeling, assessment, and deployment—a critical facet of establishing trustworthy AI systems. Tackling data bias through techniques like reweighting samples proves effective for promoting fairness. This paper undertakes a systematic exploration of reweighting samples for conventional Machine-Learning (ML) models, utilizing five models for binary classification on datasets such as Adult Income and COMPAS, incorporating various protected attributes. In particular, AI Fairness 360 (AIF360) from IBM, a versatile open-source library aimed at identifying and mitigating bias in machine-learning models throughout the entire AI application lifecycle, is employed as the foundation for conducting this systematic exploration. The evaluation of prediction outcomes employs five fairness metrics from AIF360, elucidating the nuanced and model-specific efficacy of reweighting samples in fostering fairness within traditional ML frameworks. Experimental results illustrate that reweighting samples effectively reduces bias in traditional ML methods for classification tasks. For instance, after reweighting samples, the balanced accuracy of Decision Tree (DT) improves to 100%, and its bias, as measured by fairness metrics such as Average Odds Difference (AOD), Equal Opportunity Difference (EOD), and Theil Index (TI), is mitigated to 0. However, reweighting samples does not effectively enhance the fairness performance of K Nearest Neighbor (KNN). This sheds light on the intricate dynamics of bias, underscoring the complexity involved in achieving fairness across different models and scenarios.
- Subjects
ARTIFICIAL intelligence; DECISION trees; TRUST; MACHINE learning; INCOME; FAIRNESS
- Publication
Applied Sciences (2076-3417), 2024, Vol 14, Issue 9, p3826
- ISSN
2076-3417
- Publication type
Article
- DOI
10.3390/app14093826