SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2411.04750 · NeurIPS · 2024

SpectraFM: Tuning into Stellar Foundation Models

Jo Bovy, Nolan Koblischke, David Dunlap

arXiv · PDF · Open in the Atlas

Code that ran

14 of 17 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 3 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 11 failures of our instrument; 3 no recorded run), measured 2026-11-22; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2411.04750.json · badge: /api/ran/2411.04750.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
NolanKoblischke/SpectraFM_NeurIPS_FM4Science canonical (classifier label)
classifier basis: census
14 ran · 3 no recorded run
FunctionStatusWhere it lives
crop_xp Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/gaia_utils.py
pointer only (licence: NONE) · get_code("f1fb55e3900659cb")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

estimate_bprp Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/empirical_utils.py
pointer only (licence: NONE) · get_code("0916108f810a8280")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

estimate_logg_from_teff_MS Ran
ran, honoured the contract we drafted
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/empirical_utils.py
pointer only (licence: NONE) · get_code("f11021746c757675")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

estimate_teff_from_logg_rgb Ran
ran, honoured the contract we drafted
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/empirical_utils.py
pointer only (licence: NONE) · get_code("7b7fe2d763e1898f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_activation Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/layers.py
pointer only (licence: NONE) · get_code("6b0d532c134d64b5")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_initializer Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/layers.py
pointer only (licence: NONE) · get_code("b76ac4984902fcc3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

mag_to_flux Ran
ran, honoured the contract we drafted
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/gaia_utils.py
pointer only (licence: NONE) · get_code("db139f93c836329b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

mean_squared_error Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/nn_utils.py
pointer only (licence: NONE) · get_code("ac32065953e99b32")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

random_choice Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/data_utils.py
pointer only (licence: NONE) · get_code("6b321439c20994fb")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

robust_mean_squared_error Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/nn_utils.py
pointer only (licence: NONE) · get_code("9aea7c675f1b3865")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

run Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/torch_utils_collect_env.py
pointer only (licence: NONE) · get_code("078edcdd035127f0")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

run_and_parse_first_match Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/torch_utils_collect_env.py
pointer only (licence: NONE) · get_code("ab7aeddfa9e9fb2e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

run_and_read_all Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/stellarperceptron/torch_utils_collect_env.py
pointer only (licence: NONE) · get_code("84905132fbc263e3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

top_cbar Ran
ran; our contract draft was wrong, not the code
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/plotting_utils.py
pointer only (licence: NONE) · get_code("150b30062b840abc")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

prepare_labels_and_ids Not yet run
unverified (harvested, no recorded run)
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/dataset/create_dataset.py
pointer only (licence: NONE) · get_code("5b7c19850d0160ea")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

shuffle_row Not yet run
unverified (harvested, no recorded run)
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/model_core/utils/data_utils.py
pointer only (licence: NONE) · get_code("63e230bcdbaee56a")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

train_test_split_data Not yet run
unverified (harvested, no recorded run)
NolanKoblischke/SpectraFM_NeurIPS_FM4Science/dataset/create_dataset.py
pointer only (licence: NONE) · get_code("f2870f53793379c6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, NolanKoblischke/SpectraFM_NeurIPS_FM4Science when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 17 samples lifted from this paper's linked repositories, 17 carry a function identity and 0 do not. Of the 17 distinct functions with an identity, 14 are also present in other papers whose code we hold (14 with at least one paper dated earlier, 0 the same month, 3 later) and 3 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
run_and_parse_first_match 14 other papers
9 dated earlier, 5 later
2109.04003 (2021-09)
Improving Deep Metric Learning by Divide and Conquer
2109.08267 (2021-09)
CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research
2202.04053 (2022-02)
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models
and 11 more not named here
run_and_read_all 14 other papers
9 dated earlier, 5 later
2109.04003 (2021-09)
Improving Deep Metric Learning by Divide and Conquer
2109.08267 (2021-09)
CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research
2202.04053 (2022-02)
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models
and 11 more not named here
run 6 other papers
3 dated earlier, 3 later
2405.16444 (2024-05)
CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
2406.19215 (2024-06)
SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation
2410.00428 (2024-10)
LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
and 3 more not named here
mean_squared_error 2 other papers
2 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
2407.15703 (2024-07)
Estimating Probability Densities of Tabular Data using a Transformer Model combined with Denoising Diffusion
crop_xp 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
estimate_bprp 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
estimate_logg_from_teff_MS 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
estimate_teff_from_logg_rgb 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
get_activation 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
get_initializer 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
mag_to_flux 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
random_choice 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
shuffle_row 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model
top_cbar 1 other paper
1 dated earlier
2308.10944 (2023-08)
Towards an astronomical foundation model for stars with a Transformer-based model

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Machine learning models in astrophysics are often limited in scope and cannot adapt to data from new instruments or tasks. We introduce SpectraFM, a Transformerbased foundation model architecture that can be pre-trained on stellar spectra from any wavelength range and instrument. SpectraFM excels in generalization by combining flexibility with knowledge transfer from pre-training, allowing it to outperform traditional machine learning methods, especially in scenarios with limited training data. Our model is pre-trained on approximately 90k examples of synthetic spectra to predict the chemical abundances (Fe, Mg, O), temperature, and specific gravity of stars. We then fine-tune the model on real spectra to adapt it to observational data before fine-tuning it further on a restricted 100-star training set in a different wavelength range to predict iron abundance. Despite a small iron-rich training set of real spectra, transfer learning from the synthetic spectra pre-training enables the model to perform well on iron-poor stars. In contrast, a neural network trained from scratch fails at this task. We investigate the Transformer's attention mechanism and find that the wavelengths receiving attention carry physical information about chemical composition. By leveraging the knowledge from pre-training and its ability to handle non-spectra inputs, SpectraFM reduces the need for large training datasets and enables cross-instrument and cross-domain research. Its adaptability makes it well-suited for tackling emerging challenges in astrophysics, like extracting insights from multi-modal datasets.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2411.04750")
get_code_for_paper("2411.04750")
have("2411.04750")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2411.04750.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2411.04750.svg)](https://syntology.ai/paper/2411.04750)

Connect an agent — have() is free.