SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2002.08397 · 2020

JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 16 functions out of this paper's own repositories and ran 15 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
StanfordVL/JRMOT_ROS canonical 15 of 16
FunctionStatusWhere it lives
conv3x3 Ran StanfordVL/JRMOT_ROS/src/aligned_reid_model.py
code served (permissive licence) · get_code("fac5364e2f53c6db")
find_area Ran StanfordVL/JRMOT_ROS/src/distances.py
code served (permissive licence) · get_code("03de75aaa3b406e0")
get_unmatched Ran StanfordVL/JRMOT_ROS/src/JPDA_matching.py
code served (permissive licence) · get_code("f3c57153547a2d6d")
iou_matrix Ran StanfordVL/JRMOT_ROS/src/distances.py
code served (permissive licence) · get_code("d3e27588bb89e7f2")
load_pickle Ran StanfordVL/JRMOT_ROS/src/aligned_reid_utils.py
code served (permissive licence) · get_code("3bd76346246df44c")
norm2squared_matrix Ran StanfordVL/JRMOT_ROS/src/distances.py
code served (permissive licence) · get_code("84e275a207526fa2")
remove_fc Ran StanfordVL/JRMOT_ROS/src/aligned_reid_model.py
code served (permissive licence) · get_code("91c9512a42be21c4")
resnet18 Ran StanfordVL/JRMOT_ROS/src/aligned_reid_model.py
code served (permissive licence) · get_code("2c1c8a02c1ba4103")
rotx Ran StanfordVL/JRMOT_ROS/src/calibration.py
code served (permissive licence) · get_code("8843d80ab666c4e9")
roty Ran StanfordVL/JRMOT_ROS/src/calibration.py
code served (permissive licence) · get_code("ae86074e10e1dfd7")
rotz Ran StanfordVL/JRMOT_ROS/src/calibration.py
code served (permissive licence) · get_code("082920adf6e29c94")
squared_mahalanobis_distance Ran StanfordVL/JRMOT_ROS/src/EKF.py
code served (permissive licence) · get_code("2eea9d292de00db2")
swap Ran StanfordVL/JRMOT_ROS/src/double_measurement_kf.py
code served (permissive licence) · get_code("d99bf42088f3299d")
time_str Ran StanfordVL/JRMOT_ROS/src/aligned_reid_utils.py
code served (permissive licence) · get_code("da7227beeb4bcf4f")
to_scalar Ran StanfordVL/JRMOT_ROS/src/aligned_reid_utils.py
code served (permissive licence) · get_code("fba558bcab745072")
non_max_suppression Not yet run StanfordVL/JRMOT_ROS/src/deep_sort_utils.py
code served (permissive licence) · get_code("e8fe9fcc53566f61")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Robots navigating autonomously need to perceive and track the motion of objects and other agents in its surroundings. This information enables planning and executing robust and safe trajectories. To facilitate these processes, the motion should be perceived in 3D Cartesian space. However, most recent multi-object tracking (MOT) research has focused on tracking people and moving objects in 2D RGB video sequences. In this work we present JRMOT, a novel 3D MOT system that integrates information from RGB images and 3D point clouds to achieve real-time, state-of-the-art tracking performance. Our system is built with recent neural networks for re-identification, 2D and 3D detection and track description, combined into a joint probabilistic data-association framework within a multi-modal recursive Kalman architecture. As part of our work, we release the JRDB dataset, a novel large scale 2D+3D dataset and benchmark, annotated with over 2 million boxes and 3500 time consistent 2D+3D trajectories across 54 indoor and outdoor scenes. JRDB contains over 60 minutes of data including 360 degree cylindrical RGB video and 3D pointclouds in social settings that we use to develop, train and evaluate JRMOT. The presented 3D MOT system demonstrates state-of-the-art performance against competing methods on the popular 2D tracking KITTI benchmark and serves as first 3D tracking solution for our benchmark. Real-robot tests on our social robot JackRabbot indicate that the system is capable of tracking multiple pedestrians fast and reliably. We provide the ROS code of our tracker at https://sites.google.com/view/jrmot.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2002.08397")
get_code_for_paper("2002.08397")
have("2002.08397")

Connect an agent — have() is free.