Jordan Boyd-Graber, Shi Feng, Alexander Hoyle, Nishant Balepur, Seraphina Goldfarb-Tarrant, Matthew Shu, Alison Robey
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Keyword mnemonics are memorable explanations that link new terms to simpler keywords. Prior work generates mnemonics for students, but they do not train models using mnemonics students prefer and aid learning. We build SMART, a mnemonic generator trained on feedback from real students learning new terms. To train SMART, we first fine-tune LLaMA-2 on a curated set of user-written mnemonics. We then use LLM alignment to enhance SMART: we deploy mnemonics generated by SMART in a flashcard app to find preferences on mnemonics students favor. We gather 2684 preferences from 45 students across two types: expressed (inferred from ratings) and observed (inferred from student learning), yielding three key findings. First, expressed and observed preferences disagree; what students think is helpful does not always capture what is truly helpful. Second, Bayesian models can synthesize complementary data from multiple preference types into a single effectiveness signal. SMART is tuned via Direct Preference Optimization on this signal, which resolves ties and missing labels in the typical method of pairwise comparisons, augmenting data for LLM output quality gains. Third, mnemonic experts assess SMART as matching GPT-4 at much lower deployment costs, showing the utility of capturing diverse student feedback to align LLMs in education. 1 Keyword mnemonics promote efficient and engaging vocabulary (vocab) learning (Benge and Robbins, 2009). These tools help students learn a new term's meaning (e.g. Benevolent) by relating it to a simpler keyword (e.g. Benevolent sounds like benefit), and explaining how the keyword and term are linked (e.g. A boss giving employee benefits is kind, which is the meaning of benevolent) (Pressley et al., 1982). Students use mnemonics to prepare for exams like the GRE (Fairbanks, 1977) which involve
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2406.15352")
get_code_for_paper("2406.15352")
have("2406.15352")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2406.15352.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2406.15352)
Connect an agent — have() is free.