Doina Precup, Martin Klissarov
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Temporal abstraction in reinforcement learning (RL), offers the promise of improving generalization and knowledge transfer in complex environments, by propagating information more efficiently over time. Although option learning was initially formulated in a way that allows updating many options simultaneously, using off-policy, intra-option learning (Sutton, Precup & Singh, 1999), many of the recent hierarchical reinforcement learning approaches only update a single option at a time: the option currently executing. We revisit and extend intra-option learning in the context of deep reinforcement learning, in order to enable updating all options consistent with current primitive action choices, without introducing any additional estimates. Our method can therefore be naturally adopted in most hierarchical RL frameworks. When we combine our approach with the option-critic algorithm for option discovery, we obtain significant improvements in performance and data-efficiency across a wide variety of domains.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2112.03097")
get_code_for_paper("2112.03097")
have("2112.03097")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2112.03097.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2112.03097)
Connect an agent — have() is free.