SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2405.06258 · NAACL · 2024

Automatic Generation of Model and Data Cards: A Step Towards Responsible AI

Zhijing Jin, Jiarui Liu, Mona Diab, Wenkai Li, # Metrics

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In an era of model and data proliferation in machine learning/AI especially marked by the rapid advancement of open-sourced technologies, there arises a critical need for standardized consistent documentation. Our work addresses the information incompleteness in current human-generated model and data cards. We propose an automated generation approach using Large Language Models (LLMs). Our key contributions include the establishment of CARDBENCH, a comprehensive dataset aggregated from over 4.8k model cards and 1.4k data cards, coupled with the development of the CARDGEN pipeline comprising a two-step retrieval process. Our approach exhibits enhanced completeness, objectivity, and faithfulness in generated model and data cards, a significant step in responsible AI documentation practices ensuring better accountability and traceability. 1 Lack import information: training details, evaluation metrics, and results, etc. Incomprehensible: Lacking essential technical information and explanation N/A You can use the raw model for optical character recognition on single text-line images.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2405.06258")
get_code_for_paper("2405.06258")
have("2405.06258")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2405.06258.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2405.06258.svg)](https://syntology.ai/paper/2405.06258)

Connect an agent — have() is free.