Varun Jampani, R Venkatesh Babu, Jogendra Nath, Siddharth Seth, Anirudh Jamkhandi, Pradyumna Ym, Anirban Chakraborty
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
Available 3D human pose estimation approaches leverage different forms of strong (2D/3D pose) or weak (multi-view or depth) paired supervision. Barring synthetic or in-studio domains, acquiring such supervision for each new target environment is highly inconvenient. To this end, we cast 3D pose learning as a self-supervised adaptation problem that aims to transfer the task knowledge from a labeled source domain to a completely unpaired target. We propose to infer image-to-pose via two explicit mappings viz. image-to-latent and latent-to-pose where the latter is a pre-learned decoder obtained from a prior-enforcing generative adversarial auto-encoder. Next, we introduce relation distillation as a means to align the unpaired cross-modal samples i.e. the unpaired target videos and unpaired 3D pose sequences. To this end, we propose a new set of non-local relations in order to characterize long-range latent pose interactions unlike general contrastive relations where positive couplings are limited to a local neighborhood structure. Further, we provide an objective way to quantify non-localness in order to select the most effective relation set. We evaluate different self-adaptation settings and demonstrate state-of-the-art 3D human pose estimation performance on standard benchmarks. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2204.01971")
get_code_for_paper("2204.01971")
have("2204.01971")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2204.01971.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2204.01971)
Connect an agent — have() is free.