SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2306.02898 · 2023

Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmark

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 12 functions out of this paper's own repositories and ran 6 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
Shuyu-XJTU/APTM canonical 6 of 12
FunctionStatusWhere it lives
whitespace_tokenize Ran Shuyu-XJTU/APTM/models/tokenization_bert.py
code served (permissive licence) · get_code("cf9ffa02a42184af")
window_partition Ran Shuyu-XJTU/APTM/models/swin_transformer.py
code served (permissive licence) · get_code("144d10b49baeb8a6")
build_mlp Ran Shuyu-XJTU/APTM/models/aptm.py
code served (permissive licence) · get_code("51e7514fd736cca3")
load_vocab Ran Shuyu-XJTU/APTM/models/tokenization_bert.py
code served (permissive licence) · get_code("e7fbc7a74a3457c7")
top_k_top_p_filtering Ran Shuyu-XJTU/APTM/models/bert.py
code served (permissive licence) · get_code("9e8f81565e828ebf")
window_reverse Ran Shuyu-XJTU/APTM/models/swin_transformer.py
code served (permissive licence) · get_code("61bf152e6a42a184")
accs Not yet run Shuyu-XJTU/APTM/reTools.py
code served (permissive licence) · get_code("d7bf59874fc1bb8f")
create_optimizer Not yet run Shuyu-XJTU/APTM/optim.py
code served (permissive licence) · get_code("0aa5e4369a69b540")
create_scheduler Not yet run Shuyu-XJTU/APTM/scheduler.py
code served (permissive licence) · get_code("37c7bac7616d388a")
interpolate_relative_pos_embed Not yet run Shuyu-XJTU/APTM/models/swin_transformer.py
code served (permissive licence) · get_code("199b2766250bd139")
load_tf_weights_in_bert Not yet run Shuyu-XJTU/APTM/models/bert.py
code served (permissive licence) · get_code("26be70dca3249c0b")
mlm Not yet run Shuyu-XJTU/APTM/train_tools.py
code served (permissive licence) · get_code("c28a1bc789b78770")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In this paper, we introduce a large Multi-Attribute and Language Search dataset for text-based person retrieval, called MALS, and explore the feasibility of performing pre-training on both attribute recognition and image-text matching tasks in one stone. In particular, MALS contains 1,510,330 image-text pairs, which is about 37.5 times larger than prevailing CUHK-PEDES, and all images are annotated with 27 attributes. Considering the privacy concerns and annotation costs, we leverage the off-the-shelf diffusion models to generate the dataset. To verify the feasibility of learning from the generated data, we develop a new joint Attribute Prompt Learning and Text Matching Learning (APTM) framework, considering the shared knowledge between attribute and text. As the name implies, APTM contains an attribute prompt learning stream and a text matching learning stream. (1) The attribute prompt learning leverages the attribute prompts for image-attribute alignment, which enhances the text matching learning. (2) The text matching learning facilitates the representation learning on fine-grained details, and in turn, boosts the attribute prompt learning. Extensive experiments validate the effectiveness of the pre-training on MALS, achieving state-of-the-art retrieval performance via APTM on three challenging real-world benchmarks. In particular, APTM achieves a consistent improvement of +6.96%, +7.68%, and +16.95% Recall@1 accuracy on CUHK-PEDES, ICFG-PEDES, and RSTPReid datasets by a clear margin, respectively.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2306.02898")
get_code_for_paper("2306.02898")
have("2306.02898")

Connect an agent — have() is free.