Search
Browse
Statistics
Feeds

Improving the fairness and robustness of deep learning classification models through bias mitigation and post hoc calibration

[thumbnail of Publisher's Version]
Preview
PDF (Publisher's Version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
838kB

Item Type:Article
Title:Improving the fairness and robustness of deep learning classification models through bias mitigation and post hoc calibration
Creators: Ramedani, Majid, Terli, Jaya C., Martensen, Ole H., Strauß, Tobias, Buerger, Katharina, Dechent, Peter, Düzel, Emrah, Fliessbach, Klaus, Gemenetzi, Maria, Glanz, Wenzel, Hellmann-Regen, Julian ORCID logoORCID: https://orcid.org/0000-0003-0411-9204, Hetzer, Stefan, Incesoy, Enise I., Janowitz, Daniel, Kronmüller, Marie T., Laske, Christoph, Lüsebrink, Falk, Perneczky, Robert, Peters, Oliver ORCID logoORCID: https://orcid.org/0000-0003-0568-2998, Preis, Lukas ORCID logoORCID: https://orcid.org/0000-0001-7601-6410, Priller, Josef ORCID logoORCID: https://orcid.org/0000-0001-7596-0979, Rauchmann, Boris-Stephan, Rostamzadeh, Ayda, Schneider, Anja, Schott, Björn H., Sodenkamp, Sebastian, Spottke, Annika, Spruth, Eike J., Stöcklein, Sophia, Wiltfang, Jens, Jessen, Frank, Teipel, Stefan J. and Dyrba, Martin ORCID logoORCID: https://orcid.org/0000-0002-3353-3167
Abstract:PURPOSE: Thegoal of this study was to enhance the fairness and clinical applicability of deep learning models for classifying Alzheimer’s disease from structural MRI scans. To achieve this, we addressed two key challenges: age-related bias and unreliable probability estimates. Specifically, we investigated in-processing debiasing strategies to achieve age-invariant predictions while preserving diagnostic accuracy. We also systematically evaluated post hoc calibration methods to improve the reliability, interpretability, and clinical usefulness of predicted probabilities across diverse patient populations. METHODS: Structural MRI data from three independent cohorts (ADNI, AIBL, and DELCODE) were preprocessed using a standardized pipeline. Age-related bias was addressed using two in-processing strategies, adversarial training (CF-Net) and GLM-based feature residualization (PMDN), implemented in a shared 3D convolutional neural network (CNN) framework. Additionally, post hoc calibration was performed using four regression methods: logistic, probit, isotonic, and Bayesian binning. Weevaluated modelperformance,fairness, and calibration using classification as well as calibration-specific metrics. RESULTS: PMDNachievedthebestoverallperformance,withhigherbalancedaccuracy(0.71)andimprovedcalibration(Brier ≈0.22), showing substantially reduced variability compared to baseline and CF-Net. PMDN effectively removed age-related bias, achieving near-zero age prediction correlation; CF-Net, however, showed only partial and unstable debiasing. Post hoc calibration further improved probability reliability, with nonparametric methods (isotonic regression and Bayesian binning) yielding the lowest calibration errors (MCE ≈0.21−0.24). CONCLUSION: This study shows that, although deep learning models achieve similar classification performance, they differ significantly in terms of calibration, stability, and fairness. PMDN provides more consistent and effective age bias mitigation than the CF-Net approach, particularly in clinically relevant subgroups. Post hoc calibration improves probability reliability further, with nonparametric methods achieving the best calibration.
Keywords:Magnetic Resonance Imaging, Deep Learning, Fairness, Bias Detection, Calibration
Source:International Journal of Computer Assisted Radiology and Surgery
ISSN:1861-6410
Publisher:Springer
Date:17 October 2026
Official Publication:https://doi.org/10.1007/s11548-026-03805-x
PubMed:View item in PubMed

Repository Staff Only: item control page

Downloads

Downloads per month over past year

Open Access
MDC Library