SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2301.00876 · EMNLP · 2023

MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding

Wei Chen, Dan Hendrycks, Anya Chen, Spencer Ball, Steven Wang, Leonard Tang, Thomas Woodside, Antoine Scardigli, Oliver Zhang, Dimitry Levkin

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Reading comprehension of legal text can be a particularly challenging task due to the length and complexity of legal clauses and a shortage of expert-annotated datasets. To address this challenge, we introduce the Merger Agreement Understanding Dataset (MAUD), an expert-annotated reading comprehension dataset based on the American Bar Association's 2021 Public Target Deal Points Study, with over 39,000 examples and over 47,000 total annotations. Our fine-tuned Transformer baselines show promising results, with models performing well above random on most questions. However, on a large subset of questions, there is still room for significant improvement. As the only expert-annotated merger agreement dataset, MAUD is valuable as a benchmark for both the legal profession and the NLP community.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2301.00876")
get_code_for_paper("2301.00876")
have("2301.00876")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2301.00876.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2301.00876.svg)](https://syntology.ai/paper/2301.00876)

Connect an agent — have() is free.