Tushar Nagarajan, Kristen Grauman, Yanghao Li, Bo Xiong
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We introduce an approach for pre-training egocentric video models using large-scale third-person video datasets. Learning from purely egocentric data is limited by low dataset scale and diversity, while using purely exocentric (third-person) data introduces a large domain mismatch. Our idea is to discover latent signals in third-person video that are predictive of key egocentric-specific properties. Incorporating these signals as knowledge distillation losses during pre-training results in models that benefit from both the scale and diversity of third-person video data, as well as representations that capture salient egocentric properties. Our experiments show that our "Ego-Exo" framework can be seamlessly integrated into standard video models; it outperforms all baselines when fine-tuned for egocentric activity recognition, achieving state-of-the-art results on Charades-Ego and EPIC-Kitchens-100.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2104.07905")
get_code_for_paper("2104.07905")
have("2104.07905")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2104.07905.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2104.07905)
Connect an agent — have() is free.