SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2312.02852 · NeurIPS · 2023

Expert-guided Bayesian Optimisation for Human-in-the-loop Experimental Design of Known Systems

Tom Savage, Ehecatl Antonio, Del Chanona

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 10 functions out of this paper's own repositories and ran 6 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
trsav/hitl-bo canonical 6 of 10
FunctionStatusWhere it lives
create_prompt Ran trsav/hitl-bo/bo/reccomender.py
code served (permissive licence) · get_code("d16d3b2b4597fe7a")
format_data Ran trsav/hitl-bo/bo/utils.py
code served (permissive licence) · get_code("77467af29804f6b4")
post_process_local Ran trsav/hitl-bo/bo/reccomender.py
code served (permissive licence) · get_code("ce8eb67226b502b7")
run_prompt Ran trsav/hitl-bo/bo/reccomender.py
code served (permissive licence) · get_code("566145be7bbffc44")
sample_bounds Ran trsav/hitl-bo/bo/utils.py
code served (permissive licence) · get_code("4b63e0de00750f3d")
sample_function Ran trsav/hitl-bo/bo/utils.py
code served (permissive licence) · get_code("283aeb93a0f20a70")
bo Not yet run trsav/hitl-bo/bo/visualisation.py
code served (permissive licence) · get_code("83126daa27625663")
plot_regret Not yet run trsav/hitl-bo/bo/plotting.py
code served (permissive licence) · get_code("8728676cac6bb50a")
plot_simple_regret Not yet run trsav/hitl-bo/bo/plotting.py
code served (permissive licence) · get_code("71443846d1101306")
plot_simple_regret_alts Not yet run trsav/hitl-bo/bo/plotting.py
code served (permissive licence) · get_code("b6a63e25c6bdb760")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Domain experts often possess valuable physical insights that are overlooked in fully automated decision-making processes such as Bayesian optimisation. In this article we apply high-throughput (batch) Bayesian optimisation alongside anthropological decision theory to enable domain experts to influence the selection of optimal experiments. Our methodology exploits the hypothesis that humans are better at making discrete choices than continuous ones and enables experts to influence critical early decisions. At each iteration we solve an augmented multi-objective optimisation problem across a number of alternate solutions, maximising both the sum of their utility function values and the determinant of their covariance matrix, equivalent to their total variability. By taking the solution at the knee point of the Pareto front, we return a set of alternate solutions at each iteration that have both high utility values and are reasonably distinct, from which the expert selects one for evaluation. We demonstrate that even in the case of an uninformed practitioner, our algorithm recovers the regret of standard Bayesian optimisation.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2312.02852")
get_code_for_paper("2312.02852")
have("2312.02852")

Connect an agent — have() is free.