We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| repoanonymous/fairness_metrics | canonical | 4 of 4 |
| Function | Status | Where it lives |
|---|---|---|
| get_sensitivity | Ran | repoanonymous/fairness_metrics/src/get_sensitivity.py code served (permissive licence) · get_code("2a43f64d93bc3450") |
| load_data | Ran | repoanonymous/fairness_metrics/src/get_fairness.py code served (permissive licence) · get_code("837fc5ce6d819a74") |
| load_data | Ran | repoanonymous/fairness_metrics/src/measure_fairness_change.py code served (permissive licence) · get_code("9474be3e4b3fe7e5") |
| load_data | Ran | repoanonymous/fairness_metrics/src/create_clusters.py code served (permissive licence) · get_code("e0a6b2101acf20c8") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Testing machine learning software for ethical bias has become a pressing current concern. In response, recent research has proposed a plethora of new fairness metrics, for example, the dozens of fairness metrics in the IBM AIF360 toolkit. This raises the question: How can any fairness tool satisfy such a diverse range of goals? While we cannot completely simplify the task of fairness testing, we can certainly reduce the problem. This paper shows that many of those fairness metrics effectively measure the same thing. Based on experiments using seven real-world datasets, we find that (a) 26 classification metrics can be clustered into seven groups, and (b) four dataset metrics can be clustered into three groups. Further, each reduced set may actually predict different things. Hence, it is no longer necessary (or even possible) to satisfy all fairness metrics. In summary, to simplify the fairness testing problem, we recommend the following steps: (1)~determine what type of fairness is desirable (and we offer a handful of such types); then (2) lookup those types in our clusters; then (3) just test for one item per cluster.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2110.13029")
get_code_for_paper("2110.13029")
have("2110.13029")
Connect an agent — have() is free.