We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We present a novel Speech Augmented Language Model (SALM) with {\em multitask} and {\em in-context} learning capabilities. SALM comprises a frozen text LLM, a audio encoder, a modality adapter module, and LoRA layers to accommodate speech input and associated task instructions. The unified SALM not only achieves performance on par with task-specific Conformer baselines for Automatic Speech Recognition (ASR) and Speech Translation (AST), but also exhibits zero-shot in-context learning capabilities, demonstrated through keyword-boosting task for ASR and AST. Moreover, {\em speech supervised in-context training} is proposed to bridge the gap between LLM training and downstream speech tasks, which further boosts the in-context learning ability of speech-to-text models. Proposed model is open-sourced via NeMo toolkit.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2310.09424")
get_code_for_paper("2310.09424")
have("2310.09424")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2310.09424.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2310.09424)
Connect an agent — have() is free.