SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2107.08861 · 2021

VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 2 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
PKU-DAIR/mindware canonical 0 of 4
thomas-young-2013/mindware pwc_unofficial 2 of 2
FunctionStatusWhere it lives
convert_multioutput_multiclass_to_multilabel Ran thomas-young-2013/mindware/mindware/components/utils/model_util.py
code served (permissive licence) · get_code("51023c24ad99c1a6")
softmax Ran thomas-young-2013/mindware/mindware/components/utils/model_util.py
code served (permissive licence) · get_code("8bfe49aa3252c0d8")
fetch_predict_estimator Not yet run PKU-DAIR/mindware/mindware/modules/base_evaluator.py
code served (permissive licence) · get_code("7cd5097ac2f7cf77")
get_execution_tree Not yet run PKU-DAIR/mindware/mindware/blocks/block_utils.py
code served (permissive licence) · get_code("b609afe60ca98d40")
get_kfold_name Not yet run PKU-DAIR/mindware/mindware/modules/base_evaluator.py
code served (permissive licence) · get_code("d25a7fc97fc40154")
parse_kfold_name Not yet run PKU-DAIR/mindware/mindware/modules/base_evaluator.py
code served (permissive licence) · get_code("8fa38ec460bceda1")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

End-to-end AutoML has attracted intensive interests from both academia and industry, which automatically searches for ML pipelines in a space induced by feature engineering, algorithm/model selection, and hyper-parameter tuning. Existing AutoML systems, however, suffer from scalability issues when applying to application domains with large, high-dimensional search spaces. We present VolcanoML, a scalable and extensible framework that facilitates systematic exploration of large AutoML search spaces. VolcanoML introduces and implements basic building blocks that decompose a large search space into smaller ones, and allows users to utilize these building blocks to compose an execution plan for the AutoML problem at hand. VolcanoML further supports a Volcano-style execution model - akin to the one supported by modern database systems - to execute the plan constructed. Our evaluation demonstrates that, not only does VolcanoML raise the level of expressiveness for search space decomposition in AutoML, it also leads to actual findings of decomposition strategies that are significantly more efficient than the ones employed by state-of-the-art AutoML systems such as auto-sklearn.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2107.08861")
get_code_for_paper("2107.08861")
have("2107.08861")

Connect an agent — have() is free.