Abstraction and prediction algorithms : a harm-reduction framework : [a dissertation submitted to Auckland University of Technology in partial fulfilment of the requirements for the degree of Master of Business (MBus), 2020] / Adrian Desilvestro ; supervisors: Matthew Ryan, Peer Skov.
ProPublica's allegations, that an algorithmic tool used to predict re-offenders is "biased against blacks", met a wave of criticism from the wider community. Researchers have since shown a trade-off between accuracy and fairness, concluding that the risk tool, COMPAS, was not inherent...
Saved in:
| Main Author: | |
|---|---|
| Corporate Author: | |
| Format: | Ethesis |
| Language: | English |
| Subjects: | |
| Online Access: | Click here to access this resource online |
| Summary: | ProPublica's allegations, that an algorithmic tool used to predict re-offenders is "biased against blacks", met a wave of criticism from the wider community. Researchers have since shown a trade-off between accuracy and fairness, concluding that the risk tool, COMPAS, was not inherently discriminatory. However, in light of ProPublica's objections, a growing body of literature on assessing fairness in machine learning systems has taken flight. Performance criteria combine quantitative and qualitative elements, so users 'preferences' are hard to specify objectively. This study explores a Pareto frontier framework to illustrate the relative model (in)efficiencies that arise in Risk Prediction Instruments (RPIs). The research follows a logistic framework for estimating recidivism risk, and the design parameters include the choice of fairness constraints and the choice of a bin scoring system (the "bin number"). This dissertation presents three experiments where decision-makers can improve performance in their RPIs: (1) improving efficiency through a relaxed version of the constraint, (2) improving efficiency through 'cost-free' constraint implementation, and (3) improving efficiency through a revised scoring system. Author supplied keywords: Algorithmic fairness; Accuracy-fairness tradeoffs; Risk prediction instruments; Pareto-frontier framework. |
|---|---|
| Physical Description: | 1 online resource |
| Bibliography: | Includes bibliographical references. |