Qi Zhang, Xuanjing Huang, Shihan Dou, Songyang Gao
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Dataset bias has attracted increasing attention recently for its detrimental effect on the generalization ability of fine-tuned models. The current mainstream solution is designing an additional shallow model to pre-identify biased instances. However, such two-stage methods scale up the computational complexity of training process and obstruct valid feature information while mitigating bias. To address this issue, we utilize the representation normalization method which aims at disentangling the correlations between features of encoded sentences. We find it also promising in eliminating the bias problem by providing isotropic data distribution. We further propose Kernel-Whitening, a Nyström kernel approximation method to achieve more thorough debiasing on nonlinear spurious correlations. Our framework is end-to-end with similar time consumption to fine-tuning. Experiments show that Kernel-Whitening significantly improves the performance of BERT on out-of-distribution datasets while maintaining in-distribution accuracy.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2210.07547")
get_code_for_paper("2210.07547")
have("2210.07547")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2210.07547.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2210.07547)
Connect an agent — have() is free.