Sergey Tulyakov, Yanzhi Wang, Jian Ren, Geng Yuan, Qing Jin, Oliver Woodford, Jiazhuo Wang
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs show noticeable progress in obtaining smaller generators by sacrificing image quality or involving a time-consuming searching process. In this work, we aim to address these issues by introducing a teacher network that provides a search space in which efficient network architectures can be found, in addition to performing knowledge distillation. First, we revisit the search space of generative models, introducing an inception-based residual block into generators. Second, to achieve target computation cost, we propose a one-step pruning algorithm that searches a student architecture from the teacher model and substantially reduces searching cost. It requires no ℓ 1 sparsity regularization and its associated hyper-parameters, simplifying the training procedure. Finally, we propose to distill knowledge through maximizing feature similarity between teacher and student via an index named Global Kernel Alignment (GKA). Our compressed networks achieve similar or even better image fidelity (FID, mIoU) than the original models with much-reduced computational cost, e.g., MACs. Code will be released at https://github.com/snap-research/CAT.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2103.03467")
get_code_for_paper("2103.03467")
have("2103.03467")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2103.03467.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2103.03467)
Connect an agent — have() is free.