We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Online solvers for partially observable Markov decision processes have difficulty scaling to problems with large action spaces. Monte Carlo tree search with progressive widening attempts to improve scaling by sampling from the action space to construct a policy search tree. The performance of progressive widening search is dependent upon the action sampling policy, often requiring problem-specific samplers. In this work, we present a general method for efficient action sampling based on Bayesian optimization. The proposed method uses a Gaussian process to model a belief over the action-value function and selects the action that will maximize the expected improvement in the optimal action value. We implement the proposed approach in a new online tree search algorithm called Bayesian Optimized Monte Carlo Planning (BOMCP). Several experiments show that BOMCP is better able to scale to large action space POMDPs than existing state-of-the-art tree search solvers.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2010.03597")
get_code_for_paper("2010.03597")
have("2010.03597")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2010.03597.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2010.03597)
Connect an agent — have() is free.