SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2312.04772 · 2023

Remembering to Be Fair: Non-Markovian Fairness in Sequential Decision Making

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 3 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
praal/remembering-to-be-fair canonical 0 of 3
FunctionStatusWhere it lives
argmax_greedy Not yet run praal/remembering-to-be-fair/ql.py
code served (permissive licence) · get_code("87f9437c4885c1ac")
evaluate Not yet run praal/remembering-to-be-fair/ql.py
code served (permissive licence) · get_code("1ebf0a52271654cb")
run_Q_learning Not yet run praal/remembering-to-be-fair/ql.py
code served (permissive licence) · get_code("937b3aa6bf00e726")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Fair decision making has largely been studied with respect to a single decision. Here we investigate the notion of fairness in the context of sequential decision making where multiple stakeholders can be affected by the outcomes of decisions. We observe that fairness often depends on the history of the sequential decision-making process, and in this sense that it is inherently non-Markovian. We further observe that fairness often needs to be assessed at time points within the process, not just at the end of the process. To advance our understanding of this class of fairness problems, we explore the notion of non-Markovian fairness in the context of sequential decision making. We identify properties of non-Markovian fairness, including notions of long-term, anytime, periodic, and bounded fairness. We explore the interplay between non-Markovian fairness and memory and how memory can support construction of fair policies. Finally, we introduce the FairQCM algorithm, which can automatically augment its training data to improve sample efficiency in the synthesis of fair policies via reinforcement learning.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2312.04772")
get_code_for_paper("2312.04772")
have("2312.04772")

Connect an agent — have() is free.