SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2310.08475 · EMNLP · 2023

Can We Edit Multimodal Large Language Models?

Xi Chen, Ningyu Zhang, Huajun Chen, Siyuan Cheng, Qingbin Liu, Bozhong Tian, Yongheng Wang

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In this paper, we focus on editing Multimodal Large Language Models (MLLMs). Compared to editing single-modal LLMs, multimodal model editing is more challenging, which demands a higher level of scrutiny and careful consideration in the editing process. To facilitate research in this area, we construct a new benchmark, dubbed MMEdit, for editing multimodal LLMs and establishing a suite of innovative metrics for evaluation. We conduct comprehensive experiments involving various model editing baselines and analyze the impact of editing different components for multimodal LLMs. Empirically, we notice that previous baselines can implement editing multimodal LLMs to some extent, but the effect is still barely satisfactory, indicating the potential difficulty of this task. We hope that our work can provide the NLP community with insights1. * Equal contribution. † Corresponding author. 1Code and dataset are available in https://github.com/ zjunlp/EasyEdit.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2310.08475")
get_code_for_paper("2310.08475")
have("2310.08475")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2310.08475.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2310.08475.svg)](https://syntology.ai/paper/2310.08475)

Connect an agent — have() is free.