Ana Marasović, Kaiser Sun
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
An attention matrix of a transformer selfattention sublayer can provably be decomposed into two components and only one of them (effective attention) contributes to the model output. This leads us to ask whether visualizing effective attention gives different conclusions than interpretation of standard attention. Using a subset of the GLUE tasks and BERT, we carry out an analysis to compare the two attention matrices, and show that their interpretations differ. Effective attention is less associated with the features related to the language modeling pretraining such as the separator token, and it has more potential to illustrate linguistic features captured by the model for solving the end-task. Given the found differences, we recommend using effective attention for studying a transformer's behavior since it is more pertinent to the model output by design.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2105.08855")
get_code_for_paper("2105.08855")
have("2105.08855")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2105.08855.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2105.08855)
Connect an agent — have() is free.