SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2401.03506 · 2024

DiarizationLM: Speaker Diarization Post-Processing with Large Language Models

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 5 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
google/speaker-id canonical 3 of 5
FunctionStatusWhere it lives
levenshtein_with_edits Ran google/speaker-id/DiarizationLM/diarizationlm/levenshtein.py
code served (permissive licence) · get_code("b29d162657552226")
normalize_text Ran google/speaker-id/DiarizationLM/diarizationlm/utils.py
code served (permissive licence) · get_code("cca62276ec792e36")
speakers_transform Ran google/speaker-id/DiarizationLM/diarizationlm/utils.py
code served (permissive licence) · get_code("9212298bbc895c2b")
get_aligned_hyp_speakers Not yet run google/speaker-id/DiarizationLM/diarizationlm/utils.py
code served (permissive licence) · get_code("0c1ae59c10f86053")
get_completion Not yet run google/speaker-id/DiarizationLM/run_finetuned_gpt.py
code served (permissive licence) · get_code("89a117349f149bd9")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In this paper, we introduce DiarizationLM, a framework to leverage large language models (LLM) to post-process the outputs from a speaker diarization system. Various goals can be achieved with the proposed framework, such as improving the readability of the diarized transcript, or reducing the word diarization error rate (WDER). In this framework, the outputs of the automatic speech recognition (ASR) and speaker diarization systems are represented as a compact textual format, which is included in the prompt to an optionally finetuned LLM. The outputs of the LLM can be used as the refined diarization results with the desired enhancement. As a post-processing step, this framework can be easily applied to any off-the-shelf ASR and speaker diarization systems without retraining existing components. Our experiments show that a finetuned PaLM 2-S model can reduce the WDER by rel. 55.5% on the Fisher telephone conversation dataset, and rel. 44.9% on the Callhome English dataset.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2401.03506")
get_code_for_paper("2401.03506")
have("2401.03506")

Connect an agent — have() is free.