Terry Ruas, Jan Wahle, Bela Gipp, Frederic Kirstein
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The recent success of large language models for text generation poses a severe threat to academic integrity, as plagiarists can generate realistic paraphrases indistinguishable from original work. However, the role of large autoregressive transformers in generating machineparaphrased plagiarism and their detection is still developing in the literature. This work explores T5 and GPT-3 for machine-paraphrase generation on scientific articles from arXiv, student theses, and Wikipedia. We evaluate the detection performance of six automated solutions and one commercial plagiarism detection software and perform a human study with 105 participants regarding their detection performance and the quality of generated examples. Our results suggest that large models can rewrite text humans have difficulty identifying as machine-paraphrased (53% mean acc.). Human experts rate the quality of paraphrases generated by GPT-3 as high as original texts (clarity 4.0/5, fluency 4.2/5, coherence 3.8/5). The best-performing detection model (GPT-3) achieves a 66% F1-score in detecting paraphrases. We make our code, data, and findings publicly available for research purposes.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2210.03568")
get_code_for_paper("2210.03568")
have("2210.03568")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2210.03568.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2210.03568)
Connect an agent — have() is free.