SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2103.16831 · CVPR · 2021

Convolutional Hough Matching Networks

Minsu Cho, Juhong Min

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM). The method distributes similarities of candidate matches over a geometric transformation space and evaluate them in a convolutional manner. We cast it into a trainable neural layer with a semi-isotropic high-dimensional kernel, which learns non-rigid matching with a small number of interpretable parameters. To validate the effect, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra-class variations. Predicted keypoints on 𝐼′ { መ 𝐤𝑚 ′ } 𝑚=1 𝑀 6D correlation 𝐂 (1) ∈ ℝ 𝐻×𝑊×𝑆×𝐻×𝑊×𝑆 High-dimensional correlation computation Convolutional Hough Matching Keypoint transfer & Loss Conv (𝜃 3 ) Conv (𝜃 2 ) Conv (𝜃 1 ) Copy & interpolate 𝐼 Copy & interpolate 𝐼′ Conv (𝜃 3 ) Conv (𝜃 2 ) Conv (𝜃 1 ) 0 (𝑘 psi 6D ) CHM 0 (𝑘 psi 4D ) CHM Non-linearity + Maxpool + Upsample Predicted correlation 𝐂 ∈ ℝ ഥ 𝐻× ഥ 𝑊× ഥ 𝐻× ഥ 𝑊 Flow formation Keypoint transfer Keypoints on 𝐼 {𝐤𝑚} 𝑚=1 𝑀 Keypoints on 𝐼′ {𝐤𝑚 ′ } 𝑚=1 𝑀 Training objective ℒ {𝐅𝑠 ′ } 𝑠=1 𝑆 {𝐅𝑠} 𝑠=1 𝑆 0 Scale-space maxpool Upsample 4D Sigmoid

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2103.16831")
get_code_for_paper("2103.16831")
have("2103.16831")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2103.16831.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2103.16831.svg)](https://syntology.ai/paper/2103.16831)

Connect an agent — have() is free.