We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
To reduce the inference cost of large language models, model compression is increasingly used to create smaller scalable models. However, little is known about their robustness to minority subgroups defined by the labels and attributes of a dataset. In this paper, we investigate the effects of 18 different compression methods and settings on the subgroup robustness of BERT language models. We show that worst-group performance does not depend on model size alone, but also on the compression method used. Additionally, we find that model compression does not always worsen the performance on minority subgroups. Altogether, our analysis serves to further research into the subgroup robustness of model compression.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2403.17811")
get_code_for_paper("2403.17811")
have("2403.17811")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2403.17811.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2403.17811)
Connect an agent — have() is free.