SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1807.01696 · 2018

Localization Recall Precision (LRP): A New Performance Metric for Object Detection

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 5 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
cancam/LRP canonical 0 of 5
FunctionStatusWhere it lives
get_output_dir Not yet run cancam/LRP/pascal-voc-lrp/utils/config.py
code served (permissive licence) · get_code("d2840813f8bef8d7")
get_output_tb_dir Not yet run cancam/LRP/pascal-voc-lrp/utils/config.py
code served (permissive licence) · get_code("b4096d8dc1f6bcc3")
unique_boxes Not yet run cancam/LRP/pascal-voc-lrp/utils/ds_utils.py
code served (permissive licence) · get_code("8a015c012f507631")
xywh_to_xyxy Not yet run cancam/LRP/pascal-voc-lrp/utils/ds_utils.py
code served (permissive licence) · get_code("d3e019b11b709edb")
xyxy_to_xywh Not yet run cancam/LRP/pascal-voc-lrp/utils/ds_utils.py
code served (permissive licence) · get_code("a832e5017f504280")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Average precision (AP), the area under the recall-precision (RP) curve, is the standard performance measure for object detection. Despite its wide acceptance, it has a number of shortcomings, the most important of which are (i) the inability to distinguish very different RP curves, and (ii) the lack of directly measuring bounding box localization accuracy. In this paper, we propose 'Localization Recall Precision (LRP) Error', a new metric which we specifically designed for object detection. LRP Error is composed of three components related to localization, false negative (FN) rate and false positive (FP) rate. Based on LRP, we introduce the 'Optimal LRP', the minimum achievable LRP error representing the best achievable configuration of the detector in terms of recall-precision and the tightness of the boxes. In contrast to AP, which considers precisions over the entire recall domain, Optimal LRP determines the 'best' confidence score threshold for a class, which balances the trade-off between localization and recall-precision. In our experiments, we show that, for state-of-the-art object (SOTA) detectors, Optimal LRP provides richer and more discriminative information than AP. We also demonstrate that the best confidence score thresholds vary significantly among classes and detectors. Moreover, we present LRP results of a simple online video object detector which uses a SOTA still image object detector and show that the class-specific optimized thresholds increase the accuracy against the common approach of using a general threshold for all classes. At https://github.com/cancam/LRP we provide the source code that can compute LRP for the PASCAL VOC and MSCOCO datasets. Our source code can easily be adapted to other datasets as well.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1807.01696")
get_code_for_paper("1807.01696")
have("1807.01696")

Connect an agent — have() is free.