Bernard Ghanem, Mattia Soldan, Wayner Barrios, Fabian Caba Heilbron, Alberto Ceballos-Arroyo
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The recent introduction of the large-scale, long-form MAD and Ego4D datasets has enabled researchers to investigate the performance of current state-of-the-art methods for video grounding in the long-form setup, with interesting findings: current grounding methods alone fail at tackling this challenging task and setup due to their inability to process long video sequences. In this paper, we propose a method for improving the performance of natural language grounding in long videos by identifying and pruning out non-describable windows. We design a guided grounding framework consisting of a Guidance Model and a base grounding model. The Guidance Model emphasizes describable windows, while the base grounding model analyzes short temporal windows to determine which segments accurately match a given language query. We offer two designs for the Guidance Model: Query-Agnostic and Query-Dependent, which balance efficiency and accuracy. Experiments demonstrate that our proposed method outperforms state-of-the-art models by 4.1% in MAD and 4.52% in Ego4D (NLQ), respectively. Code, data and MAD's audio features necessary to reproduce our experiments are available at: https://github.com/waybarrios/guidancebased-video-grounding.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2302.13372")
get_code_for_paper("2302.13372")
have("2302.13372")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2302.13372.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2302.13372)
Connect an agent — have() is free.