SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2602.12172 · 2026

Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation

Philip Yu, Xue Liu, Chen Ma, Mbzuai, Sjtu, Linghe Kong, Xiaokun Zhang, Mcgill, Bowei He, Yankai Chen, Cityuhk

arXiv · PDF · Open in the Atlas

Code that ran

12 of 23 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 1 honoured the contract we drafted, 0 violated it and 3 have no contract verdict; 8 failures of our instrument; 11 no recorded run), measured 2026-11-22; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2602.12172.json · badge: /api/ran/2602.12172.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
BokwaiHo/IOA community
Papers with Code archive
12 ran · 11 no recorded run
FunctionStatusWhere it lives
Curriculum Ran
ran on a synthesized input
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("0f420925ca718d21")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

SeedDataset Ran
ran on a synthesized input
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("4a65ac1b48fab0fa")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

SyntheticDataItem Ran
ran on a synthesized input
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("84de83a5b37a0c4d")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

compute_rouge_l Ran
ran, honoured the contract we drafted
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("05d5ee00837b335c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

create_few_shot_examples Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("593ed6eed8bcb693")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

filter_by_verification Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("ca2b8ff7c6161bf1")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_bridging_prompt Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("76c4f3cbeb2ebfff")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_difficulty_constraints Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("6cd1bf204662c48c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_remedial_prompt Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("d763e3a8697f3bb0")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_synthesis_user_prompt Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("82543baf32fdbe31")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

parse_llm_json_response Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("3036da6a01204909")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

validate_synthetic_item Ran
ran; our contract draft was wrong, not the code
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("b3ad971ff3710f6d")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

AdapterConfig Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("372ebe3c86e3742b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

BaseLLMClient Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("61aeea8be7b1847c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

CurriculumStage Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("2375ec748baafbcb")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

DataSynthesizer Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("b6ae4f0d1230846b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

DeepSeekClient Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("d19f4df95b1d9dce")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

LLMClient Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("5c90ffa3922ef68e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

LocalLLMClient Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("7c45dc690c4a9c48")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

OpenAIClient Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("efb083f3030cea4b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

SeedDataItem Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("c0f2398feff7a099")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

deduplicate_items Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("23016162ec5d7fea")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

save_synthetic_data Not yet run
unverified (harvested, no recorded run)
BokwaiHo/IOA/synthesis/synthesizer.py
pointer only (licence: NONE) · get_code("a1018b75f9b0ae06")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, BokwaiHo/IOA when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 23 samples lifted from this paper's linked repositories, 23 carry a function identity and 0 do not. Of the 23 distinct functions with an identity, 0 are also present in other papers whose code we hold (0 with at least one paper dated earlier, 0 the same month, 0 later) and 23 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Knowledge distillation from Large Language Models (LLMs) to smaller models has emerged as a critical technique for deploying efficient AI systems. However, current methods for distillation via synthetic data lack pedagogical awareness, treating knowledge transfer as a one-off data synthesis and training task rather than a systematic learning process. In this paper, we propose a novel pedagogically-inspired framework for LLM knowledge distillation that draws from fundamental educational principles. Our approach introduces a three-stage pipeline-Knowledge Identifier, Organizer, and Adapter (IOA)-that systematically identifies knowledge deficiencies in student models, organizes knowledge delivery through progressive curricula, and adapts representations to match the cognitive capacity of student models. We integrate Bloom's Mastery Learning Principles and Vygotsky's Zone of Proximal Development to create a dynamic distillation process where student models approach teacher model's performance on prerequisite knowledge before advancing, and new knowledge is introduced with controlled, gradual difficulty increments. Extensive experiments using LLaMA-3.1/3.2 and Qwen2.5 as student models demonstrate that IOA achieves significant improvements over baseline distillation methods, with student models retaining 94.7% of teacher performance on DollyEval while using less than 1/10th of the parameters. Our framework particularly excels in complex reasoning tasks, showing 19.2% improvement on MATH and 22.3% on HumanEval compared with state-of-the-art baselines.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2602.12172")
get_code_for_paper("2602.12172")
have("2602.12172")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2602.12172.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2602.12172.svg)](https://syntology.ai/paper/2602.12172)

Connect an agent — have() is free.