We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Lexical Substitution discovers appropriate substitutes for a given target word in a context sentence. However, the task fails to consider substitutes that are of equal or higher proficiency than the target, an aspect that could be beneficial for language learners looking to improve their writing. To bridge this gap, we propose a new task, language proficiency-oriented lexical substitution. We also introduce ProLex, a novel benchmark designed to assess systems' ability to generate not only appropriate substitutes but also substitutes that demonstrate better language proficiency. Besides the benchmark, we propose models that can automatically perform the new task. We show that our best model, a Llama2-13B model fine-tuned with task-specific synthetic data, outperforms ChatGPT by an average of 3.2% in F-score and achieves comparable results with GPT-4 on ProLex.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2401.11356")
get_code_for_paper("2401.11356")
have("2401.11356")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2401.11356.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2401.11356)
Connect an agent — have() is free.