SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2308.04549 · ICCV · 2023

Prune Spatio-temporal Tokens by Semantic-aware Temporal Accumulation

Rui Qian, Qi Tian, Xiaopeng Zhang, Hongkai Xiong, Shuangrui Ding, Peisen Zhao

arXiv · PDF · Open in the Atlas

Code that ran

14 of 17 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 4 honoured the contract we drafted, 0 violated it and 1 has no contract verdict; 9 failures of our instrument; 3 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2308.04549.json · badge: /api/ran/2308.04549.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
mark12ding/sta canonical (classifier label)
classifier basis: census
13 ran · 1 no recorded run
Mark12Ding/STA community
Papers with Code archive
1 ran · 2 no recorded run
FunctionStatusWhere it lives
Attention Ran
ran on a synthesized input
Mark12Ding/STA/model_vit.py
code served (permissive licence) · get_code("a40d0b88efe57389")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, class construct-then-call prompt, model not recorded) and returned tuple. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import torch
import torch.nn as nn
import torch.nn.functional as F

class Attention(nn.Module):

    def __init__(self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0.0, proj_drop=0.0, attn_head_dim=None):
        super().__init__()
        self.num_heads = num_heads
        head_dim = dim // num_heads
        if attn_head_dim is not None:
            head_dim = attn_head_dim
        all_head_dim = head_dim * self.num_heads
        self.scale = qk_scale or head_dim ** (-0.5)
        self.qkv = nn.Linear(dim, all_head_dim * 3, bias=False)
        if qkv_bias:
            self.q_bias = nn.Parameter(torch.zeros(all_head_dim))
            self.v_bias = nn.Parameter(torch.zeros(all_head_dim))
        else:
            self.q_bias = None
            self.v_bias = None
        self.attn_drop = nn.Dropout(attn_drop)
        self.proj = nn.Linear(all_head_dim, dim)
        self.proj_drop = nn.Dropout(proj_drop)

    def forward(self, x):
        B, N, C = x.shape
        qkv_bias = None
        if self.q_bias is not None:
            qkv_bias = torch.cat((self.q_bias, torch.zeros_like(self.v_bias, requires_grad=False), self.v_bias))
        qkv = F.linear(input=x, weight=self.qkv.weight, bias=qkv_bias)
        qkv = qkv.reshape(B, N, 3, self.num_heads, -1).permute(2, 0, 3, 1, 4)
        q, k, v = (qkv[0], qkv[1], qkv[2])
        q = q * self.scale
        attn = q @ k.transpose(-2, -1)
        attn = attn.softmax(dim=-1)
        attn = self.attn_drop(attn)
        x = (attn @ v).transpose(1, 2).reshape(B, N, -1)
        x = self.proj(x)
        x = self.proj_drop(x)
        return (x, k.mean(1))


INIT_ARGS = {
    'dim': 8,
    'num_heads': 2,
    'qkv_bias': False,
    'qk_scale': None,
    'attn_drop': 0.0,
    'proj_drop': 0.0,
    'attn_head_dim': None,
}

ARGS = {
    'x': torch.randn(2, 3, 8),
}

if __name__ == '__main__':
    attention = Attention(**INIT_ARGS)
    output, k_mean = attention(**ARGS)
    print(f"Output shape: {output.shape}")
    print(f"K mean shape: {k_mean.shape}")
    print("Success!")
Setup block drafted by
a language model, class construct-then-call prompt, model not recorded
Imports
torch — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type tuple — a tuple output has no array shape of its own; none is stated
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: torch and numpy seeded to 0 by the harness immediately before the class was constructed from INIT_ARGS (fixture_check.py)
cosine_scheduler Ran
ran, honoured the contract we drafted
mark12ding/sta/utils.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from boyazeng/understand_bias, is pointer only (licence: NONE) · get_code("b700fb0a3496b255")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from boyazeng/understand_bias, and GitHub detected no licence in that repository when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

crop_clip Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
mark12ding/sta/functional.py
code served (permissive licence) · get_code("bc39b8ed5fefa7eb")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned list, ndim 4, dtype family int; no output shape is stated. The image it ran in was not recorded. If your copy returns the same type and ndim on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import numpy as np
import PIL
from PIL import Image

# Create a small numpy array-based clip
np_clip = [
    np.random.randint(0, 256, (100, 120, 3), dtype=np.uint8),
    np.random.randint(0, 256, (100, 120, 3), dtype=np.uint8),
]

# Create a small PIL Image-based clip
pil_clip = [
    Image.new('RGB', (120, 100), color=(73, 109, 137)),
    Image.new('RGB', (120, 100), color=(200, 150, 100)),
]

# Test with numpy arrays
ARGS = {
    'clip': np_clip,
    'min_h': 10,
    'min_w': 15,
    'h': 50,
    'w': 60,
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
PIL, numpy — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type list, ndim 4, dtype family int — a list output has no array shape of its own; none is stated
dtype family
int means an integer dtype; float means any other dtype the instrument saw, bool and complex included (fixture_check.py records only these two families)
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
get_resize_sizes Ran
ran, honoured the contract we drafted
mark12ding/sta/functional.py
code served (permissive licence) · get_code("2b53e457d5632b4e")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned tuple, ndim 1, dtype family int; no output shape is stated. The image it ran in was not recorded. If your copy returns the same type and ndim on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import torch
import numpy as np

# Analyze the function: get_resize_sizes takes im_h (image height), 
# im_w (image width), and size (a target dimension). It uses basic 
# arithmetic operations on these numeric values and returns a tuple.

torch.manual_seed(0)

# Create simple numeric arguments
im_h = 480  # image height - distinct value
im_w = 640  # image width - distinct value
size = 256  # target resize dimension - distinct value

ARGS = {
    "im_h": im_h,
    "im_w": im_w,
    "size": size,
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
numpy, torch — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type tuple, ndim 1, dtype family int — a tuple output has no array shape of its own; none is stated
dtype family
int means an integer dtype; float means any other dtype the instrument saw, bool and complex included (fixture_check.py records only these two families)
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
get_sinusoid_encoding_table Ran
ran, honoured the contract we drafted
mark12ding/sta/model_vit.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from khu-vll/cast, is pointer only (licence: NOASSERTION) · get_code("9b2250a3d13ed688")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from khu-vll/cast, and GitHub could not classify the licence of that repository (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

mixup_target Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/mixup.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from terrypei/efficientvmamba, is pointer only (licence: NONE) · get_code("8733e0d87f232d11")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from terrypei/efficientvmamba, and GitHub detected no licence in that repository when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

multiple_samples_collate Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/utils.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from Alvin-Zeng/temporal-robustness-benchmark, is pointer only (licence: NONE) · get_code("024894a396cde124")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from Alvin-Zeng/temporal-robustness-benchmark, and GitHub detected no licence in that repository when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

one_hot Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/mixup.py
code served (permissive licence) · get_code("4728dc2025227bba")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned Tensor, ndim 2, dtype family float, shape (2, 4) as a later run recorded it. The image it ran in was not recorded. The code mentions cuda, and the harness aliases cuda to the CPU for every sample; whether this run needed that is not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import torch

torch.manual_seed(0)

# Create a small input tensor with class indices
# Shape: (2,) - batch of 2 samples with class indices
x = torch.tensor([0, 2], dtype=torch.long)

# Number of classes
num_classes = 4

# On value for one-hot encoding
on_value = 1.0

# Off value for one-hot encoding
off_value = 0.0

# Device - use CPU only
device = 'cpu'

ARGS = {
    'x': x,
    'num_classes': num_classes,
    'on_value': on_value,
    'off_value': off_value,
    'device': device
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
torch — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type Tensor, ndim 2, dtype family float, shape (2, 4) — shape (2, 4) as a later run recorded it
dtype family
int means an integer dtype; float means any other dtype the instrument saw, bool and complex included (fixture_check.py records only these two families)
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
rand_bbox Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/mixup.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from terrypei/efficientvmamba, is pointer only (licence: NONE) · get_code("3913c620f6926f42")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from terrypei/efficientvmamba, and GitHub detected no licence in that repository when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

resize_clip Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
mark12ding/sta/functional.py
code served (permissive licence) · get_code("981936c73d3cdd12")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned list, ndim 4, dtype family int; no output shape is stated. The image it ran in was not recorded. If your copy returns the same type and ndim on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import numbers
import cv2
import numpy as np
import PIL
from PIL import Image

# Create a small numpy array clip (list of frames)
frame1 = np.random.randint(0, 256, (480, 640, 3), dtype=np.uint8)
frame2 = np.random.randint(0, 256, (480, 640, 3), dtype=np.uint8)
np_clip = [frame1, frame2]

# Create a PIL Image clip
pil_frame1 = Image.fromarray(np.random.randint(0, 256, (480, 640, 3), dtype=np.uint8))
pil_frame2 = Image.fromarray(np.random.randint(0, 256, (480, 640, 3), dtype=np.uint8))
pil_clip = [pil_frame1, pil_frame2]

ARGS = {
    'clip': np_clip,
    'size': 256,
    'interpolation': 'bilinear'
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
PIL, cv2, numpy — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type list, ndim 4, dtype family int — a list output has no array shape of its own; none is stated
dtype family
int means an integer dtype; float means any other dtype the instrument saw, bool and complex included (fixture_check.py records only these two families)
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
shear_x Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/rand_augment.py
code served (permissive licence) · get_code("e866e1196986f728")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned Image. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import random
import PIL
from PIL import Image, ImageEnhance, ImageOps

# Create a simple PIL Image object
img = Image.new('RGB', (100, 100), color='red')

# Define ARGS dict with all parameters for shear_x
ARGS = {
    'img': img,
    'factor': 0.5,
    'resample': Image.BILINEAR,
    'fillcolor': (255, 255, 255)
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
PIL — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type Image — a Image output has no array shape of its own; none is stated — the instrument coerces any output to an array; for a Image output the recorded ndim 3 and dtype family int describe that coercion, not the output, and are not stated
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
shear_y Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/rand_augment.py
code served (permissive licence) · get_code("7b2503c99c9447fb")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned Image. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import random
import PIL
from PIL import Image, ImageEnhance, ImageOps

# Create a simple PIL Image for testing
img = Image.new('RGB', (100, 100), color='red')

# Define ARGS dict with all parameters for shear_y function
ARGS = {
    'img': img,
    'factor': 0.5,
    'resample': Image.BILINEAR,
    'fillcolor': (255, 255, 255)
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
PIL — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type Image — a Image output has no array shape of its own; none is stated — the instrument coerces any output to an array; for a Image output the recorded ndim 3 and dtype family int describe that coercion, not the output, and are not stated
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
tensor_normalize Ran
ran, honoured the contract we drafted
mark12ding/sta/kinetics.py
pointer only (licence: BSD-2-Clause); the stored copy get_code serves, from kangsankim07/videoicl, is pointer only (licence: NONE) · get_code("14b3b13b2e7ee844")
How it ran

The body of this sample is withheld: this paper's link allows the body inline (BSD-2-Clause), but get_code serves the stored copy, first harvested from kangsankim07/videoicl, and GitHub detected no licence in that repository when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

translate_x_rel Ran
ran; our contract draft was wrong, not the code
mark12ding/sta/rand_augment.py
code served (permissive licence) · get_code("323759f906fbb394")
How it ran

Ran in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned Image. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.

import random
import PIL
from PIL import Image
import numpy as np

# Create a small PIL Image object for testing
# The function uses img.size[0] and img.transform()
test_img = Image.new('RGB', (100, 80), color='red')

# Define ARGS dict with all parameters for translate_x_rel
ARGS = {
    'img': test_img,
    'pct': 0.2,
    'resample': Image.BILINEAR,
    'fillcolor': (255, 255, 255)
}
Setup block drafted by
a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API
Imports
PIL, numpy — import names as written, not package names to install; a name the repository itself provides is not a package
Returned
type Image — a Image output has no array shape of its own; none is stated — the instrument coerces any output to an array; for a Image output the recorded ndim 3 and dtype family int describe that coercion, not the output, and are not stated
Environment
image not recorded; re-verify against syntology-harvest-sandbox:v5-deps; not recorded for this sample: the harness installs a cuda-to-cpu shim (cuda_shim.py) before every sample and no run records whether a sample needed it; seed: none by the harness; any seed is in the setup block
Block Not yet run
unverified (harvested, no recorded run)
Mark12Ding/STA/model_vit.py
code served (permissive licence) · get_code("981e00fd80e33c21")
How it ran

no invocation recorded.

VisionTransformer Not yet run
unverified (harvested, no recorded run)
Mark12Ding/STA/model_vit.py
code served (permissive licence) · get_code("ae539267a5c6d2d3")
How it ran

no invocation recorded.

merge Not yet run
unverified (harvested, no recorded run)
mark12ding/sta/engine.py
code served (permissive licence) · get_code("2c569f5fd03e74b4")
How it ran

no invocation recorded.

Also present in other papers' code

Of 17 samples lifted from this paper's linked repositories, 17 carry a function identity and 0 do not. Of the 17 distinct functions with an identity, 13 are also present in other papers whose code we hold (12 with at least one paper dated earlier, 3 the same month, 13 later) and 4 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
shear_x 27 other papers
13 dated earlier, 14 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
shear_y 27 other papers
13 dated earlier, 14 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
cosine_scheduler 26 other papers
10 dated earlier, 14 later, 2 same year, order not determinable
1905.02244 (2019-05)
Searching for MobileNetV3
136810051 (2022 (year only))
AMixer: Adaptive Weight Mixing for Self-Attention Free Vision Transformers
136860514 (2022 (year only))
SLIP: Self-supervision meets Language-Image Pre-training
and 23 more not named here
translate_x_rel 26 other papers
13 dated earlier, 13 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 23 more not named here
get_sinusoid_encoding_table
brick of this paper's assembly: helper
21 other papers
7 dated earlier, 14 later · 1 only as an assembly brick
2111.06377 (2021-11)
Masked Autoencoders Are Scalable Vision Learners
2208.07049 (2022-08)
Self-Supervised Vision Transformers for Malware Detection
2302.14042 (2023-02)
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images
and 18 more not named here
tensor_normalize 15 other papers
3 dated earlier, 1 the same month, 11 later
2210.00788 (2022-10)
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
2211.09120 (2022-11)
AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders
2307.02227 (2023-07)
MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition
and 12 more not named here
rand_bbox 14 other papers
9 dated earlier, 5 later
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2111.06377 (2021-11)
Masked Autoencoders Are Scalable Vision Learners
2206.13559 (2022-06)
ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning
and 11 more not named here
crop_clip 13 other papers
6 dated earlier, 1 the same month, 6 later
2112.02815 (2021-12)
Make It Move: Controllable Image-to-Video Generation with Text Descriptions
2209.10340 (2022-09)
FNeVR: Neural Volume Rendering for Face Animation
2210.00788 (2022-10)
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
and 10 more not named here
one_hot 12 other papers
9 dated earlier, 3 later · 1 only as an assembly brick
1710.09412 (2017-10)
mixup: BEYOND EMPIRICAL RISK MINIMIZATION
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2212.00776 (2022-12)
ResFormer: Scaling ViTs with Multi-Resolution Training
and 9 more not named here
get_resize_sizes 10 other papers
3 dated earlier, 1 the same month, 6 later
2210.00788 (2022-10)
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
2211.09120 (2022-11)
AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders
2307.02227 (2023-07)
MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition
and 7 more not named here
resize_clip 9 other papers
3 dated earlier, 6 later
2210.00788 (2022-10)
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
2211.09120 (2022-11)
AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders
2307.02227 (2023-07)
MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition
and 6 more not named here
mixup_target 7 other papers
5 dated earlier, 2 later
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2212.00776 (2022-12)
ResFormer: Scaling ViTs with Multi-Resolution Training
2301.03580 (2023-01)
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
and 4 more not named here
multiple_samples_collate 2 other papers
2 later
2403.19638 (2024-03)
Siamese Vision Transformers are Scalable Audio-visual Learners
2403.20254 (2024-03)
Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Transformers have become the primary backbone of the computer vision community due to their impressive performance. However, the unfriendly computation cost impedes their potential in the video recognition domain. To optimize the speed-accuracy trade-off, we propose Semanticaware Temporal Accumulation score (STA) to prune spatiotemporal tokens integrally. STA score considers two critical factors: temporal redundancy and semantic importance. The former depicts a specific region based on whether it is a new occurrence or a seen entity by aggregating token-to-token similarity in consecutive frames while the latter evaluates each token based on its contribution to the overall prediction. As a result, tokens with higher scores of STA carry more temporal redundancy as well as lower semantics thus being pruned. Based on the STA score, we are able to progressively prune the tokens without introducing any additional parameters or requiring further re-training. We directly apply the STA module to off-the-shelf ViT and VideoSwin backbones, and the empirical results on Kinetics-400 and Something-Something V2 achieve over 30% computation reduction with a negligible ∼ 0.2% accuracy drop. The code is released at https://github.com/Mark12Ding/STA.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2308.04549")
get_code_for_paper("2308.04549")
have("2308.04549")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2308.04549.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2308.04549.svg)](https://syntology.ai/paper/2308.04549)

Connect an agent — have() is free.