SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2108.04584 · 2021

UniNet: A Unified Scene Understanding Network and Exploring Multi-Task Relationships through the Lens of Adversarial Attacks

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 9 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
NeurAI-Lab/UniNet canonical 0 of 9
FunctionStatusWhere it lives
conv1x1 Not yet run NeurAI-Lab/UniNet/encoding_custom/backbones/vovnet.py
code served (permissive licence) · get_code("e13e152fbb36748b")
conv3x3 Not yet run NeurAI-Lab/UniNet/encoding_custom/backbones/vovnet.py
code served (permissive licence) · get_code("d1fbadb5d1136a50")
dilate Not yet run NeurAI-Lab/UniNet/encoding_custom/losses/aux_losses.py
code served (permissive licence) · get_code("5f67ca80df21fa9b")
dw_conv3x3 Not yet run NeurAI-Lab/UniNet/encoding_custom/backbones/vovnet.py
code served (permissive licence) · get_code("72cc03000cea45ba")
extract_semantic_contours Not yet run NeurAI-Lab/UniNet/encoding_custom/losses/aux_losses.py
code served (permissive licence) · get_code("23a56af97258a878")
extract_surface_normals Not yet run NeurAI-Lab/UniNet/encoding_custom/losses/aux_losses.py
code served (permissive licence) · get_code("a3aa2800740d499d")
get_city_pairs Not yet run NeurAI-Lab/UniNet/encoding_custom/datasets/uninet_cs.py
code served (permissive licence) · get_code("ca0c391e4de37786")
get_image_paths Not yet run NeurAI-Lab/UniNet/encoding_custom/datasets/uninet_cs.py
code served (permissive licence) · get_code("c4200f79888d9a2f")
get_intrisics Not yet run NeurAI-Lab/UniNet/encoding_custom/datasets/uninet_cs.py
code served (permissive licence) · get_code("c3100dbadeb7098b")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Scene understanding is crucial for autonomous systems which intend to operate in the real world. Single task vision networks extract information only based on some aspects of the scene. In multi-task learning (MTL), on the other hand, these single tasks are jointly learned, thereby providing an opportunity for tasks to share information and obtain a more comprehensive understanding. To this end, we develop UniNet, a unified scene understanding network that accurately and efficiently infers vital vision tasks including object detection, semantic segmentation, instance segmentation, monocular depth estimation, and monocular instance depth prediction. As these tasks look at different semantic and geometric information, they can either complement or conflict with each other. Therefore, understanding inter-task relationships can provide useful cues to enable complementary information sharing. We evaluate the task relationships in UniNet through the lens of adversarial attacks based on the notion that they can exploit learned biases and task interactions in the neural network. Extensive experiments on the Cityscapes dataset, using untargeted and targeted attacks reveal that semantic tasks strongly interact amongst themselves, and the same holds for geometric tasks. Additionally, we show that the relationship between semantic and geometric tasks is asymmetric and their interaction becomes weaker as we move towards higher-level representations.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2108.04584")
get_code_for_paper("2108.04584")
have("2108.04584")

Connect an agent — have() is free.