Dileep Kalathil, Srinivas Shakkottai, Desik Rengarajan, Nitin Ragothaman
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We consider the problem of federated offline reinforcement learning (RL), a scenario under which distributed learning agents must collaboratively learn a high-quality control policy only using small pre-collected datasets generated according to different unknown behavior policies. Naïvely combining a standard offline RL approach with a standard federated learning approach to solve this problem can lead to poorly performing policies. In response, we develop the Federated Ensemble-Directed Offline Reinforcement Learning Algorithm (FE-DORA), which distills the collective wisdom of the clients using an ensemble learning approach. We develop the FEDORA codebase to utilize distributed compute resources on a federated learning platform. We show that FEDORA significantly outperforms other approaches, including offline RL over the combined data pool, in various complex continuous control environments and realworld datasets. Finally, we demonstrate the performance of FEDORA in the real-world on a mobile robot. We provide our code and a video of our experiments at https://github.com/DesikRengarajan/FEDORA.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2305.03097")
get_code_for_paper("2305.03097")
have("2305.03097")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2305.03097.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2305.03097)
Connect an agent — have() is free.