SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2303.03000 · 2023

Transfer learning on large datasets for the accurate prediction of material properties

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 11 functions out of this paper's own repositories and ran 9 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
hyllios/cgat canonical 9 of 11
FunctionStatusWhere it lives
EmbeddingData Ran hyllios/cgat/CGAT/gaussian_process.py
code served (permissive licence) · get_code("ed4c4fb6f0b92a4f")
RobustL1 Ran hyllios/cgat/CGAT/utils.py
code served (permissive licence) · get_code("b0f69de75228afa8")
RobustL2 Ran hyllios/cgat/CGAT/utils.py
code served (permissive licence) · get_code("246cbb4029d172f0")
collate_batch Ran hyllios/cgat/CGAT/prepare_data.py
code served (permissive licence) · get_code("204d873b8398e305")
collate_batch2 Ran hyllios/cgat/CGAT/prepare_data.py
code served (permissive licence) · get_code("46632866f370425f")
collate_fn Ran hyllios/cgat/CGAT/lightning_module.py
code served (permissive licence) · get_code("89e043c8a52cac6a")
cyclical_lr Ran hyllios/cgat/CGAT/utils.py
code served (permissive licence) · get_code("efeccd6b04404ad9")
lamb_kernel Ran hyllios/cgat/CGAT/lambs.py
code served (permissive licence) · get_code("c9619b9e20a7fef4")
partialclass Ran hyllios/cgat/CGAT/Hypernetworksmp.py
code served (permissive licence) · get_code("61098cd5c9624563")
build_dataset_prepare Not yet run hyllios/cgat/CGAT/prepare_data.py
code served (permissive licence) · get_code("34348fa866d9d6bc")
collate_batch Not yet run hyllios/cgat/CGAT/roost_message.py
code served (permissive licence) · get_code("edbe36714aa4acc4")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Graph neural networks trained on large crystal structure databases are extremely effective in replacing ab initio calculations in the discovery and characterization of materials. However, crystal structure datasets comprising millions of materials exist only for the Perdew-Burke-Ernzerhof (PBE) functional. In this work, we investigate the effectiveness of transfer learning to extend these models to other density functionals. We show that pre-training significantly reduces the size of the dataset required to achieve chemical accuracy and beyond. We also analyze in detail the relationship between the transfer-learning performance and the size of the datasets used for the initial training of the model and transfer learning. We confirm a linear dependence of the error on the size of the datasets on a log-log scale, with a similar slope for both training and the pre-training datasets. This shows that further increasing the size of the pre-training dataset, i.e. performing additional calculations with a low-cost functional, is also effective, through transfer learning, in improving machine-learning predictions with the quality of a more accurate, and possibly computationally more involved functional. Lastly, we compare the efficacy of interproperty and intraproperty transfer learning.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2303.03000")
get_code_for_paper("2303.03000")
have("2303.03000")

Connect an agent — have() is free.