We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Adapters present a promising solution to the catastrophic forgetting problem in continual learning. However, training independent Adapter modules for every new task misses an opportunity for cross-task knowledge transfer. We propose Improvise to Initialize (I2I), a continual learning algorithm that initializes Adapters for incoming tasks by distilling knowledge from previously-learned tasks' Adapters. We evaluate I2I on CLiMB, a multimodal continual learning benchmark, by conducting experiments on sequences of visual question answering tasks. Adapters trained with I2I consistently achieve better task accuracy than independently-trained Adapters, demonstrating that our algorithm facilitates knowledge transfer between task Adapters. I2I also results in better cross-task knowledge transfer than the state-of-the-art AdapterFusion without incurring the associated parametric cost.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2304.02168")
get_code_for_paper("2304.02168")
have("2304.02168")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2304.02168.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2304.02168)
Connect an agent — have() is free.