SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2412.01812 · 2024

V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 20 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
Zewei-Zhou/V2XPnP canonical 1 of 20
FunctionStatusWhere it lives
check_numpy_to_torch Ran Zewei-Zhou/V2XPnP/opencood/utils/common_utils.py
pointer only (licence: NONE) · get_code("5c4bac81583c34e1")
cal_avg_num_kpts Not yet run Zewei-Zhou/V2XPnP/opencood/utils/draco_compression.py
pointer only (licence: NONE) · get_code("bb064854066d4e97")
check_contain_nan Not yet run Zewei-Zhou/V2XPnP/opencood/utils/common_utils.py
pointer only (licence: NONE) · get_code("ef1996d97918f1f1")
corner_to_center Not yet run Zewei-Zhou/V2XPnP/opencood/utils/box_utils.py
pointer only (licence: NONE) · get_code("17f6dd8d9b2fa082")
decode_map_features_from_proto Not yet run Zewei-Zhou/V2XPnP/opencood/data_utils/datasets/map/map_data_utils.py
pointer only (licence: NONE) · get_code("1afc5a9fe126323b")
draco_compression Not yet run Zewei-Zhou/V2XPnP/opencood/utils/draco_compression.py
pointer only (licence: NONE) · get_code("4727252ee41d9c9e")
draco_compression_one Not yet run Zewei-Zhou/V2XPnP/opencood/utils/draco_compression.py
pointer only (licence: NONE) · get_code("8006ff8fded18e86")
draw_box_plt Not yet run Zewei-Zhou/V2XPnP/opencood/utils/visulizor.py
pointer only (licence: NONE) · get_code("b8661bb4d011ffa0")
draw_points_boxes_plt_2d Not yet run Zewei-Zhou/V2XPnP/opencood/utils/visulizor.py
pointer only (licence: NONE) · get_code("2308ea2b261534a2")
get_polyline_heading Not yet run Zewei-Zhou/V2XPnP/opencood/data_utils/datasets/map/map_data_utils.py
pointer only (licence: NONE) · get_code("68a66ac290e0ac56")
load_lidar_bin Not yet run Zewei-Zhou/V2XPnP/opencood/utils/pcd_utils.py
pointer only (licence: NONE) · get_code("405ba490c7790f82")
mask_points_by_range Not yet run Zewei-Zhou/V2XPnP/opencood/utils/pcd_utils.py
pointer only (licence: NONE) · get_code("96976f3c92750b04")
max_consensus1 Not yet run Zewei-Zhou/V2XPnP/opencood/utils/max_consensus.py
pointer only (licence: NONE) · get_code("c3963f628c05954f")
max_consensus2 Not yet run Zewei-Zhou/V2XPnP/opencood/utils/max_consensus.py
pointer only (licence: NONE) · get_code("1e2e4182d530e224")
max_consunsus_hierarchical Not yet run Zewei-Zhou/V2XPnP/opencood/utils/max_consensus.py
pointer only (licence: NONE) · get_code("beac0d7f0ca2518c")
normalize_angle Not yet run Zewei-Zhou/V2XPnP/opencood/data_utils/datasets/map/map_data_utils.py
pointer only (licence: NONE) · get_code("7b748d3524b4c3f4")
rotate_points_along_z Not yet run Zewei-Zhou/V2XPnP/opencood/utils/common_utils.py
pointer only (licence: NONE) · get_code("bc99268dda249805")
world_to_x Not yet run Zewei-Zhou/V2XPnP/opencood/utils/transformation_utils.py
pointer only (licence: NONE) · get_code("cd6e2f202d8dd272")
x1_to_x2 Not yet run Zewei-Zhou/V2XPnP/opencood/utils/transformation_utils.py
pointer only (licence: NONE) · get_code("8a094784255aaf1e")
x_to_world Not yet run Zewei-Zhou/V2XPnP/opencood/utils/transformation_utils.py
pointer only (licence: NONE) · get_code("ac1b997b30ad8515")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Vehicle-to-everything (V2X) technologies offer a promising paradigm to mitigate the limitations of constrained observability in single-vehicle systems. Prior work primarily focuses on single-frame cooperative perception, which fuses agents' information across different spatial locations but ignores temporal cues and temporal tasks (e.g., temporal perception and prediction). In this paper, we focus on the spatio-temporal fusion in V2X scenarios and design one-step and multi-step communication strategies (when to transmit) as well as examine their integration with three fusion strategies - early, late, and intermediate (what to transmit), providing comprehensive benchmarks with 11 fusion models (how to fuse). Furthermore, we propose V2XPnP, a novel intermediate fusion framework within one-step communication for end-to-end perception and prediction. Our framework employs a unified Transformer-based architecture to effectively model complex spatio-temporal relationships across multiple agents, frames, and high-definition maps. Moreover, we introduce the V2XPnP Sequential Dataset that supports all V2X collaboration modes and addresses the limitations of existing real-world datasets, which are restricted to single-frame or single-mode cooperation. Extensive experiments demonstrate that our framework outperforms state-of-the-art methods in both perception and prediction tasks.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2412.01812")
get_code_for_paper("2412.01812")
have("2412.01812")

Connect an agent — have() is free.