SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2411.19946 · 2024

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation

arXiv · PDF · Open in the Atlas

Code that ran

12 of 16 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 1 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 11 failures of our instrument; 4 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2411.19946.json · badge: /api/ran/2411.19946.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
vila-lab/delt canonical (classifier label)
classifier basis: census
12 ran · 4 no recorded run
FunctionStatusWhere it lives
accuracy Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
vila-lab/delt/evaluation/validation/utils.py
pointer only (licence: NONE); the stored copy get_code serves, from shuyao95/HNAS, is pointer only (licence: NONE) · get_code("eab4f74c38cc3c8f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

batched_forward Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/evaluation/model_utils/utils.py
pointer only (licence: NONE) · get_code("b615cefacfc04d10")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

clip Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/recover/utils.py
pointer only (licence: NONE) · get_code("d276004a69566d12")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

denormalize Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/recover/utils.py
pointer only (licence: NONE) · get_code("70d1e8cd2526f3ae")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_dataloader Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/data_selection.py
pointer only (licence: NONE) · get_code("465f5964f29eaca8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_mean_std Ran
ran, honoured the contract we drafted
vila-lab/delt/recover/recover.py
pointer only (licence: NONE) · get_code("ca0116cbf72e048c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_parameters Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/evaluation/validation/utils.py
pointer only (licence: NONE) · get_code("9a700a3b149f4952")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_round_imgs_indx Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/recover/recover.py
pointer only (licence: NONE) · get_code("b7f0b1c1ecd5d257")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

keep_top_k Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
vila-lab/delt/evaluation/validation/utils.py
pointer only (licence: NONE) · get_code("c209acc6c3e5877a")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

pad Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/evaluation/model_utils/utils.py
pointer only (licence: NONE) · get_code("680f3862844d8a00")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

rank Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/data_selection.py
pointer only (licence: NONE) · get_code("c80674a8056b7f9e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

tiny_clip Ran
ran; our contract draft was wrong, not the code
vila-lab/delt/recover/utils.py
pointer only (licence: NONE) · get_code("e692498fea6f44ff")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_img_indx Not yet run
unverified (harvested, no recorded run)
vila-lab/delt/recover/recover.py
pointer only (licence: NONE) · get_code("3724aa6b9357afef")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

get_model Not yet run
unverified (harvested, no recorded run)
vila-lab/delt/data_selection.py
pointer only (licence: NONE) · get_code("ef8f26a5e81b47e2")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

get_state_dict Not yet run
unverified (harvested, no recorded run)
vila-lab/delt/evaluation/model_utils/utils.py
pointer only (licence: NONE) · get_code("b76a08bec5e010fd")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

load_model Not yet run
unverified (harvested, no recorded run)
vila-lab/delt/recover/models.py
pointer only (licence: NONE) · get_code("952e2a07853f7c8e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, vila-lab/delt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 16 samples lifted from this paper's linked repositories, 16 carry a function identity and 0 do not. Of the 16 distinct functions with an identity, 6 are also present in other papers whose code we hold (6 with at least one paper dated earlier, 0 the same month, 4 later) and 10 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
accuracy 19 other papers
17 dated earlier, 2 later
1805.08318 (2018-05)
Self-Attention Generative Adversarial Networks
2105.14148 (2021-05)
OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers
2110.03006 (2021-10)
Unsupervised Selective Labeling for More Effective Semi-Supervised Learning
and 16 more not named here
get_parameters 6 other papers
5 dated earlier, 1 later
1807.11164 (2018-07)
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
1903.10979 (2019-03)
DetNAS: Backbone Search for Object Detection
1904.00420 (2019-04)
Single Path One-Shot Neural Architecture Search with Uniform Sampling
and 3 more not named here
keep_top_k 3 other papers
2 dated earlier, 1 later
2312.03526 (2023-12)
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
2407.15138 (2024-07)
D$^4$M: Dataset Distillation via Disentangled Diffusion Model
2412.21197 (2024-12)
A Large-Scale Study on Video Action Dataset Condensation
get_state_dict 2 other papers
2 dated earlier
2307.16177 (2023-07)
Fusing VHR Post-disaster Aerial Imagery and LiDAR Data for Roof Classification in the Caribbean
2312.03526 (2023-12)
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
pad 2 other papers
1 dated earlier, 1 later
2312.03526 (2023-12)
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
2412.05186 (2024-12)
One-shot Federated Learning via Synthetic Distiller-Distillate Communication
batched_forward 1 other paper
1 dated earlier
2312.03526 (2023-12)
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Recent advances in dataset distillation have led to solutions in two main directions. The conventional batch-to-batch matching mechanism is ideal for small-scale datasets and includes bi-level optimization methods on models and syntheses, such as FRePo, RCIG, and RaT-BPTT, as well as other methods like distribution matching, gradient matching, and weight trajectory matching. Conversely, batch-to-global matching typifies decoupled methods, which are particularly advantageous for large-scale datasets. This approach has garnered substantial interest within the community, as seen in SRe$^2$L, G-VBSM, WMDD, and CDA. A primary challenge with the second approach is the lack of diversity among syntheses within each class since samples are optimized independently and the same global supervision signals are reused across different synthetic images. In this study, we propose a new Diversity-driven EarlyLate Training (DELT) scheme to enhance the diversity of images in batch-to-global matching with less computation. Our approach is conceptually simple yet effective, it partitions predefined IPC samples into smaller subtasks and employs local optimizations to distill each subset into distributions from distinct phases, reducing the uniformity induced by the unified optimization process. These distilled images from the subtasks demonstrate effective generalization when applied to the entire task. We conduct extensive experiments on CIFAR, Tiny-ImageNet, ImageNet-1K, and its sub-datasets. Our approach outperforms the previous state-of-the-art by 2$\sim$5% on average across different datasets and IPCs (images per class), increasing diversity per class by more than 5% while reducing synthesis time by up to 39.3% for enhancing the training efficiency. Code is available at: https://github.com/VILA-Lab/DELT.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2411.19946")
get_code_for_paper("2411.19946")
have("2411.19946")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2411.19946.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2411.19946.svg)](https://syntology.ai/paper/2411.19946)

Connect an agent — have() is free.