We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Learning specific hands-on skills such as cooking, car maintenance, and home repairs increasingly happens via instructional videos. The user experience with such videos is known to be improved by meta-information such as time-stamped annotations for the main steps involved. Generating such annotations automatically is challenging, and we describe here two relevant contributions. First, we construct and release a new dense video captioning dataset, Video Timeline Tags (ViTT), featuring a variety of instructional videos together with time-stamped annotations. Second, we explore several multimodal sequence-to-sequence pretraining strategies that leverage large unsupervised datasets of videos and caption-like texts. We pretrain and subsequently finetune dense video captioning models using both YouCook2 and ViTT. We show that such models generalize well and are robust over a wide variety of instructional videos.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2011.11760")
get_code_for_paper("2011.11760")
have("2011.11760")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2011.11760.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2011.11760)
Connect an agent — have() is free.