We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Robust MDPs (RMDPs) can be used to compute policies with provable worst-case guarantees in reinforcement learning. The quality and robustness of an RMDP solution are determined by the ambiguity set---the set of plausible transition probabilities---which is usually constructed as a multi-dimensional confidence region. Existing methods construct ambiguity sets as confidence regions using concentration inequalities which leads to overly conservative solutions. This paper proposes a new paradigm that can achieve better solutions with the same robustness guarantees without using confidence regions as ambiguity sets. To incorporate prior knowledge, our algorithms optimize the size and position of ambiguity sets using Bayesian inference. Our theoretical analysis shows the safety of the proposed method, and the empirical results demonstrate its practical promise.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1902.07605")
get_code_for_paper("1902.07605")
have("1902.07605")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1902.07605.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1902.07605)
Connect an agent — have() is free.