SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2306.06799 · 2023

On the Efficacy of 3D Point Cloud Reinforcement Learning

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
lz1oceani/pointcloud_rl canonical 0 of 6
FunctionStatusWhere it lives
combine_obs_with_action Not yet run lz1oceani/pointcloud_rl/pyrl/networks/utils.py
code served (permissive licence) · get_code("7d625e327e37113e")
convert_observation_to_space Not yet run lz1oceani/pointcloud_rl/pyrl/env/env_utils.py
code served (permissive licence) · get_code("2ecd2d963ce46fd0")
get_gym_env_type Not yet run lz1oceani/pointcloud_rl/pyrl/env/env_utils.py
code served (permissive licence) · get_code("728777affbf74070")
get_kwargs_from_shape Not yet run lz1oceani/pointcloud_rl/pyrl/networks/utils.py
code served (permissive licence) · get_code("0710db33009b5cc1")
parse_level_range Not yet run lz1oceani/pointcloud_rl/mani_skill/evaluate_policy.py
code served (permissive licence) · get_code("806a2ec8e223f968")
unstack_action_space Not yet run lz1oceani/pointcloud_rl/pyrl/env/action_space_utils.py
code served (permissive licence) · get_code("7ee6c2af08a4966e")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Recent studies on visual reinforcement learning (visual RL) have explored the use of 3D visual representations. However, none of these work has systematically compared the efficacy of 3D representations with 2D representations across different tasks, nor have they analyzed 3D representations from the perspective of agent-object / object-object relationship reasoning. In this work, we seek answers to the question of when and how do 3D neural networks that learn features in the 3D-native space provide a beneficial inductive bias for visual RL. We specifically focus on 3D point clouds, one of the most common forms of 3D representations. We systematically investigate design choices for 3D point cloud RL, leading to the development of a robust algorithm for various robotic manipulation and control tasks. Furthermore, through comparisons between 2D image vs 3D point cloud RL methods on both minimalist synthetic tasks and complex robotic manipulation tasks, we find that 3D point cloud RL can significantly outperform the 2D counterpart when agent-object / object-object relationship encoding is a key factor.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2306.06799")
get_code_for_paper("2306.06799")
have("2306.06799")

Connect an agent — have() is free.