IMW 2020: Leaderboard

Current version: cc249665 (2020-03-26, 17:42 UTC)

Categories are non-exclusive: e.g. small descriptors compete with larger descriptors, but not vice-versa. For the sake of clarity, we do separate 2k and 8k in the leaderboards. Please note that this is a static website: you may want to force a reload if it does not update properly. We are working on new features and tracks: the organizers reserve the right to update terms and conditions within the next few weeks.

Prize #1: unlimited keypoints (8k) / standard descriptors (512 bytes)


Prize #2: restricted keypoints (2k) / standard descriptors (512 bytes)



Phototourism: unlimited keypoints / standard descriptors (512 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
GeoDesc-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 301.28
Rank: 45/54
0.484
Rank: 9/54
0.835
Rank: 20/54
0.48067
(±0.00047)
Rank: 43/54
368.18
Rank: 39/54
3594.18
Rank: 32/54
4.252
Rank: 27/54
0.493
Rank: 33/54
0.62500
(±0.00188)
Rank: 40/54
0.55283
Rank: 41/54
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-29
SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7874.85 226.69
Rank: 51/54
0.470
Rank: 29/54
0.809
Rank: 44/54
0.44473
(±0.00120)
Rank: 50/54
399.54
Rank: 30/54
3265.87
Rank: 45/54
3.883
Rank: 51/54
0.561
Rank: 51/54
0.54747
(±0.00225)
Rank: 51/54
0.49610
Rank: 51/54
Challenge organizers (contact) sift-lowth sift (128 float32: 512 bytes) SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
HardNet-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 552.53
Rank: 7/54
0.484
Rank: 9/54
0.827
Rank: 29/54
0.52886
(±0.00080)
Rank: 15/54
443.64
Rank: 22/54
3862.00
Rank: 19/54
4.441
Rank: 6/54
0.467
Rank: 9/54
0.66509
(±0.00391)
Rank: 9/54
0.59698
Rank: 13/54
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
HardNet-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 667.85
Rank: 2/54
0.484
Rank: 9/54
0.838
Rank: 18/54
0.55424
(±0.00070)
Rank: 4/54
469.07
Rank: 16/54
3935.20
Rank: 14/54
4.423
Rank: 8/54
0.462
Rank: 5/54
0.67278
(±0.00078)
Rank: 3/54
0.61351
Rank: 4/54
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-03-01
L2-Net w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 457.87
Rank: 18/54
0.469
Rank: 32/54
0.816
Rank: 38/54
0.51709
(±0.00047)
Rank: 20/54
314.34
Rank: 49/54
3167.35
Rank: 47/54
4.099
Rank: 43/54
0.498
Rank: 38/54
0.61574
(±0.00135)
Rank: 42/54
0.56642
Rank: 36/54
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
SOSNet-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 384.96
Rank: 32/54
0.484
Rank: 9/54
0.850
Rank: 8/54
0.53280
(±0.00065)
Rank: 12/54
484.00
Rank: 10/54
4159.89
Rank: 7/54
4.464
Rank: 1/54
0.465
Rank: 7/54
0.67058
(±0.00316)
Rank: 5/54
0.60169
Rank: 8/54
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
7131.47 154.44
Rank: 53/54
0.506
Rank: 4/54
0.638
Rank: 54/54
0.15923
(±0.00080)
Rank: 54/54
902.07
Rank: 3/54
1303.19
Rank: 54/54
2.669
Rank: 54/54
0.911
Rank: 54/54
0.07230
(±0.00216)
Rank: 54/54
0.11577
Rank: 54/54
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 283.61
Rank: 46/54
0.469
Rank: 32/54
0.822
Rank: 33/54
0.48862
(±0.00019)
Rank: 39/54
292.99
Rank: 52/54
3064.01
Rank: 49/54
4.091
Rank: 45/54
0.527
Rank: 49/54
0.60477
(±0.00237)
Rank: 45/54
0.54670
Rank: 43/54
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
SOSNet-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 510.11
Rank: 12/54
0.484
Rank: 9/54
0.827
Rank: 28/54
0.52699
(±0.00051)
Rank: 16/54
484.00
Rank: 10/54
4159.89
Rank: 7/54
4.464
Rank: 1/54
0.465
Rank: 8/54
0.67058
(±0.00316)
Rank: 5/54
0.59879
Rank: 12/54
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ASLFeat (MS) w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
6871.78 368.39
Rank: 34/54
0.545
Rank: 3/54
0.781
Rank: 49/54
0.44836
(±0.00063)
Rank: 49/54
476.34
Rank: 12/54
3565.75
Rank: 36/54
4.445
Rank: 5/54
0.498
Rank: 39/54
0.62994
(±0.00142)
Rank: 35/54
0.53915
Rank: 46/54
Zixin Luo, Jiahui Zhang (contact) aslfeat aslfeat (128 float32: 512 bytes) ASLFeat (MS) with 8000 features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC. FLANN disabled. https://arxiv.org/abs/2003.10071 https://github.com/lzx551402/ASLFeat 20-03-25
L2-Net-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 340.37
Rank: 39/54
0.484
Rank: 9/54
0.832
Rank: 22/54
0.51205
(±0.00110)
Rank: 25/54
342.55
Rank: 45/54
3269.23
Rank: 43/54
4.289
Rank: 16/54
0.494
Rank: 34/54
0.62936
(±0.00110)
Rank: 36/54
0.57070
Rank: 31/54
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
SOSNet w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 533.71
Rank: 10/54
0.469
Rank: 32/54
0.832
Rank: 23/54
0.54251
(±0.00040)
Rank: 7/54
472.07
Rank: 13/54
4179.96
Rank: 5/54
4.261
Rank: 22/54
0.453
Rank: 2/54
0.66617
(±0.00260)
Rank: 7/54
0.60434
Rank: 6/54
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
L2-Net-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 411.11
Rank: 27/54
0.484
Rank: 9/54
0.845
Rank: 9/54
0.53573
(±0.00007)
Rank: 10/54
365.36
Rank: 43/54
3328.26
Rank: 41/54
4.270
Rank: 20/54
0.497
Rank: 37/54
0.63462
(±0.00358)
Rank: 31/54
0.58518
Rank: 15/54
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
GeoDesc w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 346.25
Rank: 37/54
0.469
Rank: 32/54
0.802
Rank: 47/54
0.46252
(±0.00019)
Rank: 48/54
328.16
Rank: 47/54
3352.38
Rank: 39/54
4.115
Rank: 41/54
0.502
Rank: 45/54
0.60465
(±0.00332)
Rank: 47/54
0.53359
Rank: 49/54
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-28
LogPolar w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 418.89
Rank: 25/54
0.469
Rank: 32/54
0.839
Rank: 15/54
0.52562
(±0.00090)
Rank: 17/54
385.90
Rank: 33/54
3763.78
Rank: 23/54
4.199
Rank: 35/54
0.487
Rank: 30/54
0.63955
(±0.00398)
Rank: 27/54
0.58259
Rank: 18/54
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-13
LogPolar w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 562.58
Rank: 6/54
0.469
Rank: 32/54
0.818
Rank: 36/54
0.51592
(±0.00096)
Rank: 22/54
385.90
Rank: 33/54
3763.78
Rank: 23/54
4.199
Rank: 35/54
0.487
Rank: 29/54
0.63955
(±0.00398)
Rank: 27/54
0.57773
Rank: 27/54
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-13
SURF (OpenCV), DEGENSAC
Size: 256 bytes. Matches: built-in
7750.71 121.14
Rank: 54/54
0.433
Rank: 54/54
0.667
Rank: 53/54
0.24110
(±0.00061)
Rank: 53/54
913.30
Rank: 2/54
3217.44
Rank: 46/54
3.353
Rank: 52/54
0.780
Rank: 53/54
0.36598
(±0.00337)
Rank: 52/54
0.30354
Rank: 53/54
Challenge organizers (contact) surf-lowth surf (64 float32: 256 bytes) SURF with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
LogPolar-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 511.89
Rank: 11/54
0.484
Rank: 9/54
0.851
Rank: 6/54
0.54174
(±0.00008)
Rank: 8/54
466.74
Rank: 18/54
4092.23
Rank: 10/54
4.390
Rank: 12/54
0.476
Rank: 19/54
0.65929
(±0.00187)
Rank: 12/54
0.60051
Rank: 9/54
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-17
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
7871.55 236.04
Rank: 50/54
0.552
Rank: 2/54
0.723
Rank: 52/54
0.30219
(±0.00109)
Rank: 52/54
471.17
Rank: 15/54
2585.81
Rank: 53/54
3.327
Rank: 53/54
0.772
Rank: 52/54
0.32662
(±0.00278)
Rank: 53/54
0.31441
Rank: 52/54
Challenge organizers (contact) akaze-lowth akaze (61 uint8: 61 bytes) AKAZE with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
HardNet w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 455.29
Rank: 19/54
0.469
Rank: 32/54
0.816
Rank: 40/54
0.51084
(±0.00021)
Rank: 27/54
373.32
Rank: 35/54
3600.02
Rank: 30/54
4.227
Rank: 31/54
0.480
Rank: 22/54
0.64191
(±0.00236)
Rank: 25/54
0.57638
Rank: 28/54
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
HardNet w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 545.53
Rank: 9/54
0.469
Rank: 32/54
0.828
Rank: 27/54
0.54085
(±0.00022)
Rank: 9/54
394.91
Rank: 31/54
3707.02
Rank: 28/54
4.229
Rank: 29/54
0.477
Rank: 20/54
0.65870
(±0.00169)
Rank: 14/54
0.59978
Rank: 11/54
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
L2-Net-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 547.25
Rank: 8/54
0.484
Rank: 9/54
0.823
Rank: 32/54
0.52988
(±0.00032)
Rank: 14/54
365.36
Rank: 43/54
3328.26
Rank: 41/54
4.270
Rank: 20/54
0.494
Rank: 35/54
0.63462
(±0.00358)
Rank: 31/54
0.58225
Rank: 19/54
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
LogPolar w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 358.43
Rank: 35/54
0.469
Rank: 32/54
0.825
Rank: 30/54
0.49506
(±0.00051)
Rank: 38/54
372.55
Rank: 37/54
3753.28
Rank: 26/54
4.222
Rank: 33/54
0.483
Rank: 23/54
0.63906
(±0.00170)
Rank: 29/54
0.56706
Rank: 35/54
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
SOSNet-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 477.73
Rank: 15/54
0.484
Rank: 9/54
0.862
Rank: 1/54
0.56349
(±0.00028)
Rank: 1/54
554.52
Rank: 5/54
4425.02
Rank: 3/54
4.452
Rank: 3/54
0.459
Rank: 3/54
0.67871
(±0.00369)
Rank: 1/54
0.62110
Rank: 1/54
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-03
Upright Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7846.57 336.38
Rank: 40/54
0.485
Rank: 5/54
0.830
Rank: 25/54
0.50131
(±0.00017)
Rank: 34/54
516.33
Rank: 7/54
4113.38
Rank: 9/54
4.260
Rank: 24/54
0.490
Rank: 32/54
0.63342
(±0.00110)
Rank: 33/54
0.56737
Rank: 34/54
Challenge organizers (contact) sift-lowth rootsift-upright (128 float32: 512 bytes) Upright Root-SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
SOSNet-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 640.85
Rank: 3/54
0.484
Rank: 9/54
0.840
Rank: 12/54
0.55628
(±0.00021)
Rank: 3/54
554.52
Rank: 5/54
4425.02
Rank: 3/54
4.452
Rank: 3/54
0.459
Rank: 4/54
0.67871
(±0.00369)
Rank: 1/54
0.61750
Rank: 3/54
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-03
HardNet w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 408.72
Rank: 28/54
0.469
Rank: 32/54
0.852
Rank: 5/54
0.54505
(±0.00019)
Rank: 6/54
394.91
Rank: 31/54
3707.02
Rank: 28/54
4.229
Rank: 29/54
0.475
Rank: 17/54
0.65870
(±0.00169)
Rank: 14/54
0.60188
Rank: 7/54
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
GeoDesc-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 386.44
Rank: 31/54
0.484
Rank: 9/54
0.854
Rank: 4/54
0.51777
(±0.00026)
Rank: 19/54
425.30
Rank: 24/54
3845.12
Rank: 21/54
4.284
Rank: 18/54
0.486
Rank: 28/54
0.65020
(±0.00172)
Rank: 19/54
0.58399
Rank: 17/54
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
LogPolar w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 474.57
Rank: 16/54
0.469
Rank: 32/54
0.803
Rank: 46/54
0.48483
(±0.00018)
Rank: 40/54
372.55
Rank: 37/54
3753.28
Rank: 26/54
4.222
Rank: 33/54
0.484
Rank: 24/54
0.63906
(±0.00170)
Rank: 29/54
0.56194
Rank: 39/54
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
LogPolar-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 692.22
Rank: 1/54
0.484
Rank: 9/54
0.830
Rank: 26/54
0.53179
(±0.00040)
Rank: 13/54
466.74
Rank: 18/54
4092.23
Rank: 10/54
4.390
Rank: 12/54
0.475
Rank: 18/54
0.65929
(±0.00187)
Rank: 12/54
0.59554
Rank: 14/54
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-17
ContextDesc (upright)
Size: 512 bytes. Matches: built-in
7531.14 209.61
Rank: 52/54
0.444
Rank: 53/54
0.838
Rank: 19/54
0.49787
(±0.00045)
Rank: 35/54
265.47
Rank: 54/54
2766.49
Rank: 52/54
4.035
Rank: 49/54
0.486
Rank: 27/54
0.64606
(±0.00351)
Rank: 24/54
0.57196
Rank: 30/54
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-02-27
ContextDesc-Upright w/ DEGENSAC (no FLAN...
Size: 512 bytes. Matches: built-in
7879.06 250.61
Rank: 49/54
0.469
Rank: 52/54
0.841
Rank: 11/54
0.50326
(±0.00044)
Rank: 33/54
294.00
Rank: 51/54
2804.01
Rank: 51/54
4.047
Rank: 48/54
0.472
Rank: 16/54
0.64922
(±0.00054)
Rank: 23/54
0.57624
Rank: 29/54
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. FLANN disabled. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-03-18
LogPolar-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 435.12
Rank: 21/54
0.484
Rank: 9/54
0.839
Rank: 17/54
0.51495
(±0.00018)
Rank: 23/54
448.36
Rank: 20/54
4089.03
Rank: 12/54
4.417
Rank: 10/54
0.471
Rank: 14/54
0.65489
(±0.00359)
Rank: 17/54
0.58492
Rank: 16/54
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
Upright SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7846.57 302.54
Rank: 44/54
0.485
Rank: 5/54
0.815
Rank: 41/54
0.47840
(±0.00047)
Rank: 45/54
499.07
Rank: 8/54
3865.68
Rank: 18/54
4.139
Rank: 39/54
0.524
Rank: 48/54
0.60037
(±0.00279)
Rank: 49/54
0.53938
Rank: 45/54
Challenge organizers (contact) sift-lowth sift-upright (128 float32: 512 bytes) Upright SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
GeoDesc w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 431.07
Rank: 23/54
0.469
Rank: 32/54
0.821
Rank: 34/54
0.49759
(±0.00098)
Rank: 36/54
367.86
Rank: 41/54
3571.73
Rank: 34/54
4.147
Rank: 37/54
0.502
Rank: 46/54
0.62849
(±0.00034)
Rank: 38/54
0.56304
Rank: 38/54
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
SOSNet w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 322.90
Rank: 42/54
0.469
Rank: 32/54
0.840
Rank: 13/54
0.51198
(±0.00047)
Rank: 26/54
410.74
Rank: 27/54
3897.05
Rank: 16/54
4.259
Rank: 25/54
0.470
Rank: 12/54
0.64969
(±0.00287)
Rank: 21/54
0.58084
Rank: 21/54
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
HardNet-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 415.31
Rank: 26/54
0.484
Rank: 9/54
0.850
Rank: 7/54
0.53560
(±0.00010)
Rank: 11/54
443.64
Rank: 22/54
3862.00
Rank: 19/54
4.441
Rank: 6/54
0.468
Rank: 11/54
0.66509
(±0.00391)
Rank: 9/54
0.60034
Rank: 10/54
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
GeoDesc w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 267.86
Rank: 47/54
0.469
Rank: 32/54
0.824
Rank: 31/54
0.46659
(±0.00046)
Rank: 47/54
328.16
Rank: 47/54
3352.38
Rank: 39/54
4.115
Rank: 41/54
0.500
Rank: 41/54
0.60465
(±0.00332)
Rank: 47/54
0.53562
Rank: 48/54
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-28
HardNet w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 345.21
Rank: 38/54
0.469
Rank: 32/54
0.840
Rank: 14/54
0.51617
(±0.00067)
Rank: 21/54
373.32
Rank: 35/54
3600.02
Rank: 30/54
4.227
Rank: 31/54
0.477
Rank: 21/54
0.64191
(±0.00236)
Rank: 25/54
0.57904
Rank: 24/54
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
SOSNet w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 423.65
Rank: 24/54
0.469
Rank: 32/54
0.817
Rank: 37/54
0.50694
(±0.00028)
Rank: 28/54
410.74
Rank: 27/54
3897.05
Rank: 16/54
4.259
Rank: 25/54
0.470
Rank: 13/54
0.64969
(±0.00287)
Rank: 21/54
0.57832
Rank: 25/54
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ContextDesc-Upright w/ DEGENSAC (no FLAN...
Size: 512 bytes. Matches: built-in
7875.59 315.85
Rank: 43/54
0.469
Rank: 31/54
0.818
Rank: 35/54
0.50504
(±0.00039)
Rank: 31/54
405.83
Rank: 29/54
3469.37
Rank: 38/54
4.086
Rank: 47/54
0.485
Rank: 26/54
0.65609
(±0.00269)
Rank: 16/54
0.58057
Rank: 22/54
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. FLANN disabled. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-03-25
Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7874.85 260.65
Rank: 48/54
0.470
Rank: 29/54
0.830
Rank: 24/54
0.48001
(±0.00027)
Rank: 44/54
414.38
Rank: 26/54
3552.72
Rank: 37/54
4.032
Rank: 50/54
0.515
Rank: 47/54
0.59585
(±0.00212)
Rank: 50/54
0.53793
Rank: 47/54
Challenge organizers (contact) sift-lowth rootsift (128 float32: 512 bytes) Root-SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 370.49
Rank: 33/54
0.469
Rank: 32/54
0.800
Rank: 48/54
0.48439
(±0.00050)
Rank: 41/54
292.99
Rank: 52/54
3064.01
Rank: 49/54
4.091
Rank: 45/54
0.529
Rank: 50/54
0.60477
(±0.00237)
Rank: 45/54
0.54458
Rank: 44/54
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
GeoDesc-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 390.50
Rank: 30/54
0.484
Rank: 9/54
0.812
Rank: 43/54
0.47532
(±0.00065)
Rank: 46/54
368.18
Rank: 39/54
3594.18
Rank: 32/54
4.252
Rank: 27/54
0.490
Rank: 31/54
0.62500
(±0.00188)
Rank: 40/54
0.55016
Rank: 42/54
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-29
GeoDesc w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 330.17
Rank: 41/54
0.469
Rank: 32/54
0.843
Rank: 10/54
0.50338
(±0.00091)
Rank: 32/54
367.86
Rank: 41/54
3571.73
Rank: 34/54
4.147
Rank: 37/54
0.502
Rank: 44/54
0.62849
(±0.00034)
Rank: 38/54
0.56593
Rank: 37/54
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
HardNet-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 496.25
Rank: 14/54
0.484
Rank: 9/54
0.861
Rank: 2/54
0.56285
(±0.00093)
Rank: 2/54
469.07
Rank: 16/54
3935.20
Rank: 14/54
4.423
Rank: 8/54
0.463
Rank: 6/54
0.67278
(±0.00078)
Rank: 3/54
0.61781
Rank: 2/54
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-03-01
Guided matching with Upright root SIFT (...
Size: 512 bytes. Matches: custom
7846.32 465.77
Rank: 17/54
0.485
Rank: 7/54
0.815
Rank: 42/54
0.49635
(±0.01585)
Rank: 37/54
762.72
Rank: 4/54
5611.16
Rank: 2/54
4.356
Rank: 15/54
0.471
Rank: 15/54
0.65943
(±0.00374)
Rank: 11/54
0.57789
Rank: 26/54
Anonymous (released after deadline) sift upright-root-sift (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-03
L2-Net-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 449.71
Rank: 20/54
0.484
Rank: 9/54
0.809
Rank: 45/54
0.50655
(±0.00046)
Rank: 29/54
342.55
Rank: 45/54
3269.23
Rank: 43/54
4.289
Rank: 16/54
0.494
Rank: 36/54
0.62936
(±0.00110)
Rank: 36/54
0.56795
Rank: 33/54
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
ASLFeat-MS
Size: 512 bytes. Matches: built-in
7361.55 433.00
Rank: 22/54
0.574
Rank: 1/54
0.736
Rank: 51/54
0.41102
(±0.00057)
Rank: 51/54
498.39
Rank: 9/54
3759.66
Rank: 25/54
4.388
Rank: 14/54
0.501
Rank: 43/54
0.61558
(±0.00296)
Rank: 44/54
0.51330
Rank: 50/54
Zixin Luo, Jiahui Zhang (contact) aslfeat-ms aslfeat-ms (128 float32: 512 bytes) ASLFeat (joint predition of detectors and descriptors with multi-scale input) with 8000 features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC. Under preparation N/A 20-02-27
LogPolar-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 580.50
Rank: 4/54
0.484
Rank: 9/54
0.816
Rank: 39/54
0.50539
(±0.00026)
Rank: 30/54
448.36
Rank: 20/54
4089.03
Rank: 12/54
4.417
Rank: 10/54
0.467
Rank: 10/54
0.65489
(±0.00359)
Rank: 17/54
0.58014
Rank: 23/54
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
L2-Net w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 347.07
Rank: 36/54
0.469
Rank: 32/54
0.839
Rank: 16/54
0.52128
(±0.00050)
Rank: 18/54
314.34
Rank: 49/54
3167.35
Rank: 47/54
4.099
Rank: 43/54
0.499
Rank: 40/54
0.61574
(±0.00135)
Rank: 42/54
0.56851
Rank: 32/54
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
SOSNet w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 401.01
Rank: 29/54
0.469
Rank: 32/54
0.854
Rank: 3/54
0.54926
(±0.00054)
Rank: 5/54
472.07
Rank: 13/54
4179.96
Rank: 5/54
4.261
Rank: 22/54
0.452
Rank: 1/54
0.66617
(±0.00260)
Rank: 7/54
0.60772
Rank: 5/54
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
GeoDesc-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 505.26
Rank: 13/54
0.484
Rank: 9/54
0.833
Rank: 21/54
0.51206
(±0.00051)
Rank: 24/54
425.30
Rank: 24/54
3845.12
Rank: 21/54
4.284
Rank: 18/54
0.484
Rank: 25/54
0.65020
(±0.00172)
Rank: 19/54
0.58113
Rank: 20/54
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
Guided matching with Upright root SIFT (...
Size: 512 bytes. Matches: custom
7846.32 579.76
Rank: 5/54
0.485
Rank: 7/54
0.773
Rank: 50/54
0.48095
(±0.00000)
Rank: 42/54
1300.74
Rank: 1/54
7378.75
Rank: 1/54
4.136
Rank: 40/54
0.501
Rank: 42/54
0.63020
(±0.00490)
Rank: 34/54
0.55558
Rank: 40/54
Anonymous (released after deadline) sift upright-root-sift (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-02-28

Phototourism: restricted keypoints, standard descriptors (512 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
HardNet (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 136.15
Rank: 8/32
0.327
Rank: 7/32
0.789
Rank: 1/32
0.43694
(±0.00116)
Rank: 1/32
182.78
Rank: 11/32
1345.73
Rank: 6/32
4.201
Rank: 6/32
0.529
Rank: 5/32
0.57391
(±0.00317)
Rank: 3/32
0.50543
Rank: 2/32
Challenge organizers (contact) sift-def hardnet-upright (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
Guided matching hardnet
Size: 512 bytes. Matches: custom
1892.98 143.70
Rank: 6/32
0.327
Rank: 15/32
0.780
Rank: 4/32
0.41721
(±0.00000)
Rank: 5/32
241.66
Rank: 7/32
1656.72
Rank: 5/32
4.202
Rank: 4/32
0.511
Rank: 1/32
0.59433
(±0.00185)
Rank: 1/32
0.50577
Rank: 1/32
Anonymous (released after deadline) sift upright-hardnet (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-03
DELF-GLD (128D), PyRANSAC
Size: 512 bytes. Matches: built-in
2037.95 94.38
Rank: 24/32
0.110
Rank: 29/32
0.152
Rank: 29/32
0.06771
(±0.00064)
Rank: 30/32
422.01
Rank: 3/32
2016.18
Rank: 1/32
2.524
Rank: 28/32
0.908
Rank: 30/32
0.12029
(±0.00117)
Rank: 28/32
0.09400
Rank: 29/32
Challenge organizers (contact) delf-gld-2k-128d delf-gld-2k-128d (128 float32: 512 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 128 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
SOSNet (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 170.17
Rank: 3/32
0.327
Rank: 7/32
0.769
Rank: 7/32
0.43289
(±0.00101)
Rank: 2/32
173.88
Rank: 13/32
1312.03
Rank: 8/32
4.208
Rank: 2/32
0.531
Rank: 6/32
0.57242
(±0.00097)
Rank: 5/32
0.50266
Rank: 4/32
Challenge organizers (contact) sift-def sosnet-upright (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
SOSNet (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 149.80
Rank: 4/32
0.327
Rank: 7/32
0.781
Rank: 3/32
0.42502
(±0.00011)
Rank: 4/32
173.88
Rank: 13/32
1312.03
Rank: 8/32
4.208
Rank: 2/32
0.529
Rank: 4/32
0.57242
(±0.00097)
Rank: 5/32
0.49872
Rank: 5/32
Challenge organizers (contact) sift-def sosnet-upright (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
R2D2 (r2d2-wasf-n16), DEGENSAC
Size: 512 bytes. Matches: built-in
2048.00 170.97
Rank: 2/32
0.418
Rank: 1/32
0.716
Rank: 25/32
0.35290
(±0.00069)
Rank: 21/32
253.03
Rank: 6/32
1134.39
Rank: 22/32
4.201
Rank: 5/32
0.546
Rank: 7/32
0.55946
(±0.00119)
Rank: 7/32
0.45618
Rank: 10/32
Challenge organizers (contact) r2d2-wasf-n16 r2d2-wasf-n16 (128 float32: 512 bytes) R2D2 (model r2d2-wasf-n16) with 2k features, using the built-in matcher (bidirectional filter with the both strategy) and no ratio test, and DEGENSAC with optimal parameters for stereo. N/A https://opencv.org 20-01-28
GeoDesc (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 139.91
Rank: 7/32
0.327
Rank: 7/32
0.751
Rank: 15/32
0.37669
(±0.00080)
Rank: 15/32
141.85
Rank: 23/32
1155.98
Rank: 20/32
4.111
Rank: 10/32
0.591
Rank: 17/32
0.51746
(±0.00146)
Rank: 12/32
0.44708
Rank: 15/32
Challenge organizers (contact) sift-def geodesc-upright (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
HardNet, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 105.71
Rank: 18/32
0.317
Rank: 19/32
0.765
Rank: 11/32
0.38298
(±0.00073)
Rank: 12/32
146.17
Rank: 21/32
1223.02
Rank: 15/32
3.934
Rank: 17/32
0.587
Rank: 16/32
0.50998
(±0.00237)
Rank: 17/32
0.44648
Rank: 16/32
Challenge organizers (contact) sift-def hardnet (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1939.53 74.14
Rank: 29/32
0.317
Rank: 17/32
0.721
Rank: 24/32
0.30329
(±0.00076)
Rank: 25/32
167.10
Rank: 15/32
986.36
Rank: 29/32
3.596
Rank: 25/32
0.671
Rank: 25/32
0.38429
(±0.00130)
Rank: 25/32
0.34379
Rank: 25/32
Challenge organizers (contact) sift-def sift (128 float32: 512 bytes) SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 133.44
Rank: 10/32
0.327
Rank: 7/32
0.772
Rank: 5/32
0.39481
(±0.00042)
Rank: 7/32
163.19
Rank: 16/32
1245.79
Rank: 13/32
4.115
Rank: 8/32
0.554
Rank: 8/32
0.53872
(±0.00257)
Rank: 8/32
0.46676
Rank: 8/32
Challenge organizers (contact) sift-def l2net-upright (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
DELF-GLD (32D), PyRANSAC
Size: 128 bytes. Matches: built-in
2037.95 91.34
Rank: 25/32
0.110
Rank: 29/32
0.120
Rank: 31/32
0.05664
(±0.00023)
Rank: 32/32
444.19
Rank: 1/32
1680.65
Rank: 3/32
2.420
Rank: 30/32
0.942
Rank: 31/32
0.08292
(±0.00119)
Rank: 30/32
0.06978
Rank: 31/32
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
2033.08 60.68
Rank: 32/32
0.356
Rank: 3/32
0.509
Rank: 28/32
0.08003
(±0.00082)
Rank: 28/32
119.41
Rank: 30/32
252.10
Rank: 32/32
1.974
Rank: 32/32
0.870
Rank: 28/32
0.02068
(±0.00199)
Rank: 32/32
0.05035
Rank: 32/32
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
LogPolarDesc, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 144.16
Rank: 5/32
0.317
Rank: 19/32
0.740
Rank: 21/32
0.38507
(±0.00039)
Rank: 10/32
155.56
Rank: 19/32
1300.54
Rank: 10/32
3.954
Rank: 13/32
0.570
Rank: 10/32
0.52445
(±0.00315)
Rank: 10/32
0.45476
Rank: 11/32
Challenge organizers (contact) sift-def logpolar (128 float32: 512 bytes) LogPolarDesc descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-01-28
L2-Net, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 84.00
Rank: 27/32
0.317
Rank: 25/32
0.767
Rank: 10/32
0.36004
(±0.00079)
Rank: 19/32
132.80
Rank: 28/32
1129.03
Rank: 24/32
3.854
Rank: 22/32
0.591
Rank: 18/32
0.47583
(±0.00180)
Rank: 20/32
0.41793
Rank: 20/32
Challenge organizers (contact) sift-def l2net (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
L2-Net, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 104.04
Rank: 19/32
0.317
Rank: 25/32
0.754
Rank: 14/32
0.35397
(±0.00088)
Rank: 20/32
132.80
Rank: 28/32
1129.03
Rank: 24/32
3.854
Rank: 22/32
0.592
Rank: 19/32
0.47583
(±0.00180)
Rank: 20/32
0.41490
Rank: 21/32
Challenge organizers (contact) sift-def l2net (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
HardNet, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 134.14
Rank: 9/32
0.317
Rank: 19/32
0.746
Rank: 19/32
0.38203
(±0.00091)
Rank: 14/32
146.17
Rank: 21/32
1223.02
Rank: 15/32
3.934
Rank: 17/32
0.585
Rank: 15/32
0.50998
(±0.00237)
Rank: 17/32
0.44601
Rank: 17/32
Challenge organizers (contact) sift-def hardnet (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
Upright SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1893.01 100.40
Rank: 22/32
0.327
Rank: 5/32
0.750
Rank: 16/32
0.36487
(±0.00048)
Rank: 18/32
198.66
Rank: 9/32
1221.16
Rank: 17/32
3.908
Rank: 19/32
0.623
Rank: 23/32
0.47743
(±0.00204)
Rank: 19/32
0.42115
Rank: 19/32
Challenge organizers (contact) sift-def sift-upright (128 float32: 512 bytes) Upright SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
SURF (OpenCV), DEGENSAC
Size: 256 bytes. Matches: built-in
2013.95 69.86
Rank: 30/32
0.319
Rank: 16/32
0.626
Rank: 26/32
0.20564
(±0.00049)
Rank: 26/32
294.61
Rank: 5/32
1130.23
Rank: 23/32
3.466
Rank: 26/32
0.738
Rank: 26/32
0.34357
(±0.00354)
Rank: 26/32
0.27460
Rank: 26/32
Challenge organizers (contact) surf-def surf (64 float32: 256 bytes) SURF with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1939.53 80.40
Rank: 28/32
0.317
Rank: 17/32
0.743
Rank: 20/32
0.33160
(±0.00070)
Rank: 24/32
162.54
Rank: 18/32
1064.73
Rank: 26/32
3.693
Rank: 24/32
0.633
Rank: 24/32
0.42461
(±0.00081)
Rank: 24/32
0.37811
Rank: 24/32
Challenge organizers (contact) sift-def rootsift (128 float32: 512 bytes) Root-SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 106.35
Rank: 17/32
0.327
Rank: 7/32
0.787
Rank: 2/32
0.40199
(±0.00065)
Rank: 6/32
163.19
Rank: 16/32
1245.79
Rank: 13/32
4.115
Rank: 8/32
0.556
Rank: 9/32
0.53872
(±0.00257)
Rank: 8/32
0.47035
Rank: 7/32
Challenge organizers (contact) sift-def l2net-upright (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
SOSNet, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 115.88
Rank: 12/32
0.317
Rank: 19/32
0.757
Rank: 13/32
0.37316
(±0.00044)
Rank: 17/32
138.50
Rank: 26/32
1186.36
Rank: 18/32
3.953
Rank: 15/32
0.572
Rank: 12/32
0.51487
(±0.00216)
Rank: 14/32
0.44402
Rank: 18/32
Challenge organizers (contact) sift-def sosnet (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
DELF-GLD (128D), DEGENSAC
Size: 512 bytes. Matches: built-in
2037.95 100.52
Rank: 21/32
0.110
Rank: 29/32
0.148
Rank: 30/32
0.07695
(±0.00044)
Rank: 29/32
422.01
Rank: 3/32
2016.18
Rank: 1/32
2.524
Rank: 28/32
0.902
Rank: 29/32
0.12029
(±0.00117)
Rank: 28/32
0.09862
Rank: 28/32
Challenge organizers (contact) delf-gld-2k-128d delf-gld-2k-128d (128 float32: 512 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 128 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
DELF-GLD (32D), DEGENSAC
Size: 128 bytes. Matches: built-in
2037.95 96.84
Rank: 23/32
0.110
Rank: 29/32
0.117
Rank: 32/32
0.05987
(±0.00031)
Rank: 31/32
444.19
Rank: 1/32
1680.65
Rank: 3/32
2.420
Rank: 30/32
0.947
Rank: 32/32
0.08292
(±0.00119)
Rank: 30/32
0.07139
Rank: 30/32
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
GeoDesc, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 111.61
Rank: 15/32
0.317
Rank: 25/32
0.731
Rank: 23/32
0.33818
(±0.00032)
Rank: 23/32
114.97
Rank: 31/32
1018.30
Rank: 27/32
3.889
Rank: 20/32
0.609
Rank: 22/32
0.45972
(±0.00065)
Rank: 22/32
0.39895
Rank: 23/32
Challenge organizers (contact) sift-def geodesc (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
1640.91 67.54
Rank: 31/32
0.352
Rank: 4/32
0.621
Rank: 27/32
0.17767
(±0.00068)
Rank: 27/32
219.35
Rank: 8/32
745.29
Rank: 31/32
3.279
Rank: 27/32
0.850
Rank: 27/32
0.21136
(±0.00413)
Rank: 27/32
0.19452
Rank: 27/32
Challenge organizers (contact) akaze-def akaze (61 uint8: 61 bytes) AKAZE with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
GeoDesc, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 90.21
Rank: 26/32
0.317
Rank: 25/32
0.747
Rank: 18/32
0.34028
(±0.00040)
Rank: 22/32
114.97
Rank: 31/32
1018.30
Rank: 27/32
3.889
Rank: 20/32
0.608
Rank: 21/32
0.45972
(±0.00065)
Rank: 22/32
0.40000
Rank: 22/32
Challenge organizers (contact) sift-def geodesc (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
HardNet (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 175.29
Rank: 1/32
0.327
Rank: 7/32
0.768
Rank: 8/32
0.43287
(±0.00055)
Rank: 3/32
182.78
Rank: 11/32
1345.73
Rank: 6/32
4.201
Rank: 6/32
0.527
Rank: 2/32
0.57391
(±0.00317)
Rank: 3/32
0.50339
Rank: 3/32
Challenge organizers (contact) sift-def hardnet-upright (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
Upright Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1893.01 107.42
Rank: 16/32
0.327
Rank: 5/32
0.768
Rank: 9/32
0.38929
(±0.00031)
Rank: 9/32
193.67
Rank: 10/32
1263.61
Rank: 12/32
3.995
Rank: 12/32
0.574
Rank: 13/32
0.51247
(±0.00292)
Rank: 16/32
0.45088
Rank: 12/32
Challenge organizers (contact) sift-def rootsift-upright (128 float32: 512 bytes) Upright Root-SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
SOSNet, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 130.42
Rank: 11/32
0.317
Rank: 19/32
0.748
Rank: 17/32
0.38360
(±0.00045)
Rank: 11/32
138.50
Rank: 26/32
1186.36
Rank: 18/32
3.953
Rank: 15/32
0.576
Rank: 14/32
0.51487
(±0.00216)
Rank: 14/32
0.44923
Rank: 14/32
Challenge organizers (contact) sift-def sosnet (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
LogPolarDesc, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 112.92
Rank: 13/32
0.317
Rank: 19/32
0.759
Rank: 12/32
0.38939
(±0.00082)
Rank: 8/32
155.56
Rank: 19/32
1300.54
Rank: 10/32
3.954
Rank: 13/32
0.571
Rank: 11/32
0.52445
(±0.00315)
Rank: 10/32
0.45692
Rank: 9/32
Challenge organizers (contact) sift-def logpolar (128 float32: 512 bytes) LogPolarDesc descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-01-28
SEKD
Size: 512 bytes. Matches: built-in
1789.04 101.22
Rank: 20/32
0.378
Rank: 2/32
0.738
Rank: 22/32
0.37554
(±0.00082)
Rank: 16/32
140.28
Rank: 25/32
984.90
Rank: 30/32
4.397
Rank: 1/32
0.527
Rank: 3/32
0.58125
(±0.00346)
Rank: 2/32
0.47840
Rank: 6/32
Anonymous (released after deadline) sekd sekd (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-17
GeoDesc (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 112.15
Rank: 14/32
0.327
Rank: 7/32
0.770
Rank: 6/32
0.38207
(±0.00065)
Rank: 13/32
141.85
Rank: 23/32
1155.98
Rank: 20/32
4.111
Rank: 10/32
0.592
Rank: 20/32
0.51746
(±0.00146)
Rank: 12/32
0.44977
Rank: 13/32
Challenge organizers (contact) sift-def geodesc-upright (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28

Phototourism: unlimited keypoints, small descriptors (128 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
7131.47 154.44
Rank: 2/2
0.506
Rank: 2/2
0.638
Rank: 2/2
0.15923
(±0.00080)
Rank: 2/2
902.07
Rank: 1/2
1303.19
Rank: 2/2
2.669
Rank: 2/2
0.911
Rank: 2/2
0.07230
(±0.00216)
Rank: 2/2
0.11577
Rank: 2/2
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
7871.55 236.04
Rank: 1/2
0.552
Rank: 1/2
0.723
Rank: 1/2
0.30219
(±0.00109)
Rank: 1/2
471.17
Rank: 2/2
2585.81
Rank: 1/2
3.327
Rank: 1/2
0.772
Rank: 1/2
0.32662
(±0.00278)
Rank: 1/2
0.31441
Rank: 1/2
Challenge organizers (contact) akaze-lowth akaze (61 uint8: 61 bytes) AKAZE with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28

Phototourism: restricted keypoints, small descriptors (128 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
DELF-GLD (32D), PyRANSAC
Size: 128 bytes. Matches: built-in
2037.95 91.34
Rank: 2/4
0.110
Rank: 3/4
0.120
Rank: 3/4
0.05664
(±0.00023)
Rank: 4/4
444.19
Rank: 1/4
1680.65
Rank: 1/4
2.420
Rank: 2/4
0.942
Rank: 3/4
0.08292
(±0.00119)
Rank: 2/4
0.06978
Rank: 3/4
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
2033.08 60.68
Rank: 4/4
0.356
Rank: 1/4
0.509
Rank: 2/4
0.08003
(±0.00082)
Rank: 2/4
119.41
Rank: 4/4
252.10
Rank: 4/4
1.974
Rank: 4/4
0.870
Rank: 2/4
0.02068
(±0.00199)
Rank: 4/4
0.05035
Rank: 4/4
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
DELF-GLD (32D), DEGENSAC
Size: 128 bytes. Matches: built-in
2037.95 96.84
Rank: 1/4
0.110
Rank: 3/4
0.117
Rank: 4/4
0.05987
(±0.00031)
Rank: 3/4
444.19
Rank: 1/4
1680.65
Rank: 1/4
2.420
Rank: 2/4
0.947
Rank: 4/4
0.08292
(±0.00119)
Rank: 2/4
0.07139
Rank: 2/4
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
1640.91 67.54
Rank: 3/4
0.352
Rank: 2/4
0.621
Rank: 1/4
0.17767
(±0.00068)
Rank: 1/4
219.35
Rank: 3/4
745.29
Rank: 3/4
3.279
Rank: 1/4
0.850
Rank: 1/4
0.21136
(±0.00413)
Rank: 1/4
0.19452
Rank: 1/4
Challenge organizers (contact) akaze-def akaze (61 uint8: 61 bytes) AKAZE with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28

Phototourism: unlimited keypoints, large descriptors (2048 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
GeoDesc-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 301.28
Rank: 46/56
0.484
Rank: 9/56
0.835
Rank: 20/56
0.48067
(±0.00047)
Rank: 43/56
368.18
Rank: 41/56
3594.18
Rank: 34/56
4.252
Rank: 27/56
0.493
Rank: 33/56
0.62500
(±0.00188)
Rank: 40/56
0.55283
Rank: 41/56
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-29
SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7874.85 226.69
Rank: 53/56
0.470
Rank: 29/56
0.809
Rank: 44/56
0.44473
(±0.00120)
Rank: 50/56
399.54
Rank: 32/56
3265.87
Rank: 47/56
3.883
Rank: 51/56
0.561
Rank: 51/56
0.54747
(±0.00225)
Rank: 51/56
0.49610
Rank: 51/56
Challenge organizers (contact) sift-lowth sift (128 float32: 512 bytes) SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
HardNet-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 552.53
Rank: 7/56
0.484
Rank: 9/56
0.827
Rank: 29/56
0.52886
(±0.00080)
Rank: 15/56
443.64
Rank: 24/56
3862.00
Rank: 21/56
4.441
Rank: 6/56
0.467
Rank: 9/56
0.66509
(±0.00391)
Rank: 9/56
0.59698
Rank: 13/56
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
HardNet-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 667.85
Rank: 2/56
0.484
Rank: 9/56
0.838
Rank: 18/56
0.55424
(±0.00070)
Rank: 4/56
469.07
Rank: 18/56
3935.20
Rank: 16/56
4.423
Rank: 8/56
0.462
Rank: 5/56
0.67278
(±0.00078)
Rank: 3/56
0.61351
Rank: 4/56
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-03-01
L2-Net w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 457.87
Rank: 18/56
0.469
Rank: 32/56
0.816
Rank: 38/56
0.51709
(±0.00047)
Rank: 20/56
314.34
Rank: 51/56
3167.35
Rank: 49/56
4.099
Rank: 43/56
0.498
Rank: 38/56
0.61574
(±0.00135)
Rank: 42/56
0.56642
Rank: 36/56
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
SOSNet-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 384.96
Rank: 32/56
0.484
Rank: 9/56
0.850
Rank: 8/56
0.53280
(±0.00065)
Rank: 12/56
484.00
Rank: 12/56
4159.89
Rank: 9/56
4.464
Rank: 1/56
0.465
Rank: 7/56
0.67058
(±0.00316)
Rank: 5/56
0.60169
Rank: 8/56
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
7131.47 154.44
Rank: 55/56
0.506
Rank: 4/56
0.638
Rank: 54/56
0.15923
(±0.00080)
Rank: 56/56
902.07
Rank: 3/56
1303.19
Rank: 56/56
2.669
Rank: 56/56
0.911
Rank: 56/56
0.07230
(±0.00216)
Rank: 56/56
0.11577
Rank: 56/56
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 283.61
Rank: 47/56
0.469
Rank: 32/56
0.822
Rank: 33/56
0.48862
(±0.00019)
Rank: 39/56
292.99
Rank: 54/56
3064.01
Rank: 51/56
4.091
Rank: 45/56
0.527
Rank: 49/56
0.60477
(±0.00237)
Rank: 45/56
0.54670
Rank: 43/56
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
SOSNet-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 510.11
Rank: 12/56
0.484
Rank: 9/56
0.827
Rank: 28/56
0.52699
(±0.00051)
Rank: 16/56
484.00
Rank: 12/56
4159.89
Rank: 9/56
4.464
Rank: 1/56
0.465
Rank: 8/56
0.67058
(±0.00316)
Rank: 5/56
0.59879
Rank: 12/56
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ASLFeat (MS) w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
6871.78 368.39
Rank: 34/56
0.545
Rank: 3/56
0.781
Rank: 49/56
0.44836
(±0.00063)
Rank: 49/56
476.34
Rank: 14/56
3565.75
Rank: 38/56
4.445
Rank: 5/56
0.498
Rank: 39/56
0.62994
(±0.00142)
Rank: 35/56
0.53915
Rank: 46/56
Zixin Luo, Jiahui Zhang (contact) aslfeat aslfeat (128 float32: 512 bytes) ASLFeat (MS) with 8000 features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC. FLANN disabled. https://arxiv.org/abs/2003.10071 https://github.com/lzx551402/ASLFeat 20-03-25
L2-Net-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 340.37
Rank: 39/56
0.484
Rank: 9/56
0.832
Rank: 22/56
0.51205
(±0.00110)
Rank: 25/56
342.55
Rank: 47/56
3269.23
Rank: 45/56
4.289
Rank: 16/56
0.494
Rank: 34/56
0.62936
(±0.00110)
Rank: 36/56
0.57070
Rank: 31/56
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
SOSNet w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 533.71
Rank: 10/56
0.469
Rank: 32/56
0.832
Rank: 23/56
0.54251
(±0.00040)
Rank: 7/56
472.07
Rank: 15/56
4179.96
Rank: 7/56
4.261
Rank: 22/56
0.453
Rank: 2/56
0.66617
(±0.00260)
Rank: 7/56
0.60434
Rank: 6/56
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
L2-Net-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 411.11
Rank: 27/56
0.484
Rank: 9/56
0.845
Rank: 9/56
0.53573
(±0.00007)
Rank: 10/56
365.36
Rank: 45/56
3328.26
Rank: 43/56
4.270
Rank: 20/56
0.497
Rank: 37/56
0.63462
(±0.00358)
Rank: 31/56
0.58518
Rank: 15/56
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
GeoDesc w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 346.25
Rank: 37/56
0.469
Rank: 32/56
0.802
Rank: 47/56
0.46252
(±0.00019)
Rank: 48/56
328.16
Rank: 49/56
3352.38
Rank: 41/56
4.115
Rank: 41/56
0.502
Rank: 45/56
0.60465
(±0.00332)
Rank: 47/56
0.53359
Rank: 49/56
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-28
LogPolar w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 418.89
Rank: 25/56
0.469
Rank: 32/56
0.839
Rank: 15/56
0.52562
(±0.00090)
Rank: 17/56
385.90
Rank: 35/56
3763.78
Rank: 25/56
4.199
Rank: 35/56
0.487
Rank: 30/56
0.63955
(±0.00398)
Rank: 27/56
0.58259
Rank: 18/56
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-13
LogPolar w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 562.58
Rank: 6/56
0.469
Rank: 32/56
0.818
Rank: 36/56
0.51592
(±0.00096)
Rank: 22/56
385.90
Rank: 35/56
3763.78
Rank: 25/56
4.199
Rank: 35/56
0.487
Rank: 29/56
0.63955
(±0.00398)
Rank: 27/56
0.57773
Rank: 27/56
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-13
D2-Net (single-scale), DEGENSAC
Size: 2048 bytes. Matches: built-in
5598.19 242.31
Rank: 51/56
0.285
Rank: 56/56
0.352
Rank: 56/56
0.17876
(±0.00032)
Rank: 55/56
714.41
Rank: 5/56
4274.86
Rank: 6/56
3.456
Rank: 52/56
0.730
Rank: 53/56
0.38157
(±0.00162)
Rank: 53/56
0.28017
Rank: 55/56
Challenge organizers (contact) d2net-singlescale d2net-singlescale (512 float32: 2048 bytes) D2-Net, single-scale model, up to 8000 features. Trained on the MegaDepth dataset, removing scenes which overlap with the Phototourism test set. Stereo with DEGENSAC and optimal parameters http://openaccess.thecvf.com/content_CVPR_2019/papers/Dusmanu_D2-Net_A_Trainable_CNN_for_Joint_Description_and_Detection_of_CVPR_2019_paper.pdf https://github.com/mihaidusmanu/d2-net 20-01-28
SURF (OpenCV), DEGENSAC
Size: 256 bytes. Matches: built-in
7750.71 121.14
Rank: 56/56
0.433
Rank: 54/56
0.667
Rank: 53/56
0.24110
(±0.00061)
Rank: 53/56
913.30
Rank: 2/56
3217.44
Rank: 48/56
3.353
Rank: 53/56
0.780
Rank: 55/56
0.36598
(±0.00337)
Rank: 54/56
0.30354
Rank: 53/56
Challenge organizers (contact) surf-lowth surf (64 float32: 256 bytes) SURF with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
LogPolar-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 511.89
Rank: 11/56
0.484
Rank: 9/56
0.851
Rank: 6/56
0.54174
(±0.00008)
Rank: 8/56
466.74
Rank: 20/56
4092.23
Rank: 12/56
4.390
Rank: 12/56
0.476
Rank: 19/56
0.65929
(±0.00187)
Rank: 12/56
0.60051
Rank: 9/56
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-17
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
7871.55 236.04
Rank: 52/56
0.552
Rank: 2/56
0.723
Rank: 52/56
0.30219
(±0.00109)
Rank: 52/56
471.17
Rank: 17/56
2585.81
Rank: 55/56
3.327
Rank: 54/56
0.772
Rank: 54/56
0.32662
(±0.00278)
Rank: 55/56
0.31441
Rank: 52/56
Challenge organizers (contact) akaze-lowth akaze (61 uint8: 61 bytes) AKAZE with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
HardNet w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 455.29
Rank: 19/56
0.469
Rank: 32/56
0.816
Rank: 40/56
0.51084
(±0.00021)
Rank: 27/56
373.32
Rank: 37/56
3600.02
Rank: 32/56
4.227
Rank: 31/56
0.480
Rank: 22/56
0.64191
(±0.00236)
Rank: 25/56
0.57638
Rank: 28/56
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
HardNet w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 545.53
Rank: 9/56
0.469
Rank: 32/56
0.828
Rank: 27/56
0.54085
(±0.00022)
Rank: 9/56
394.91
Rank: 33/56
3707.02
Rank: 30/56
4.229
Rank: 29/56
0.477
Rank: 20/56
0.65870
(±0.00169)
Rank: 14/56
0.59978
Rank: 11/56
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
L2-Net-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 547.25
Rank: 8/56
0.484
Rank: 9/56
0.823
Rank: 32/56
0.52988
(±0.00032)
Rank: 14/56
365.36
Rank: 45/56
3328.26
Rank: 43/56
4.270
Rank: 20/56
0.494
Rank: 35/56
0.63462
(±0.00358)
Rank: 31/56
0.58225
Rank: 19/56
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
LogPolar w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 358.43
Rank: 35/56
0.469
Rank: 32/56
0.825
Rank: 30/56
0.49506
(±0.00051)
Rank: 38/56
372.55
Rank: 39/56
3753.28
Rank: 28/56
4.222
Rank: 33/56
0.483
Rank: 23/56
0.63906
(±0.00170)
Rank: 29/56
0.56706
Rank: 35/56
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
SOSNet-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 477.73
Rank: 15/56
0.484
Rank: 9/56
0.862
Rank: 1/56
0.56349
(±0.00028)
Rank: 1/56
554.52
Rank: 7/56
4425.02
Rank: 4/56
4.452
Rank: 3/56
0.459
Rank: 3/56
0.67871
(±0.00369)
Rank: 1/56
0.62110
Rank: 1/56
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-03
Upright Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7846.57 336.38
Rank: 40/56
0.485
Rank: 5/56
0.830
Rank: 25/56
0.50131
(±0.00017)
Rank: 34/56
516.33
Rank: 9/56
4113.38
Rank: 11/56
4.260
Rank: 24/56
0.490
Rank: 32/56
0.63342
(±0.00110)
Rank: 33/56
0.56737
Rank: 34/56
Challenge organizers (contact) sift-lowth rootsift-upright (128 float32: 512 bytes) Upright Root-SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
SOSNet-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 640.85
Rank: 3/56
0.484
Rank: 9/56
0.840
Rank: 12/56
0.55628
(±0.00021)
Rank: 3/56
554.52
Rank: 7/56
4425.02
Rank: 4/56
4.452
Rank: 3/56
0.459
Rank: 4/56
0.67871
(±0.00369)
Rank: 1/56
0.61750
Rank: 3/56
Challenge organizers (contact) sift8k sosnet-upright (128 float32: 512 bytes) Upright SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-03
HardNet w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 408.72
Rank: 28/56
0.469
Rank: 32/56
0.852
Rank: 5/56
0.54505
(±0.00019)
Rank: 6/56
394.91
Rank: 33/56
3707.02
Rank: 30/56
4.229
Rank: 29/56
0.475
Rank: 17/56
0.65870
(±0.00169)
Rank: 14/56
0.60188
Rank: 7/56
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
GeoDesc-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 386.44
Rank: 31/56
0.484
Rank: 9/56
0.854
Rank: 4/56
0.51777
(±0.00026)
Rank: 19/56
425.30
Rank: 26/56
3845.12
Rank: 23/56
4.284
Rank: 18/56
0.486
Rank: 28/56
0.65020
(±0.00172)
Rank: 19/56
0.58399
Rank: 17/56
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
D2-Net (multi-scale), DEGENSAC
Size: 2048 bytes. Matches: built-in
6882.73 329.08
Rank: 42/56
0.319
Rank: 55/56
0.374
Rank: 55/56
0.19670
(±0.00066)
Rank: 54/56
712.75
Rank: 6/56
5309.21
Rank: 3/56
3.302
Rank: 55/56
0.689
Rank: 52/56
0.38916
(±0.00459)
Rank: 52/56
0.29293
Rank: 54/56
Challenge organizers (contact) d2net-multiscale d2net-multiscale (512 float32: 2048 bytes) D2-Net, multi-scale model, up to 8000 features. Trained on the MegaDepth dataset, removing scenes which overlap with the Phototourism test set. Stereo with DEGENSAC and optimal parameters http://openaccess.thecvf.com/content_CVPR_2019/papers/Dusmanu_D2-Net_A_Trainable_CNN_for_Joint_Description_and_Detection_of_CVPR_2019_paper.pdf https://github.com/mihaidusmanu/d2-net 20-01-28
LogPolar w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 474.57
Rank: 16/56
0.469
Rank: 32/56
0.803
Rank: 46/56
0.48483
(±0.00018)
Rank: 40/56
372.55
Rank: 39/56
3753.28
Rank: 28/56
4.222
Rank: 33/56
0.484
Rank: 24/56
0.63906
(±0.00170)
Rank: 29/56
0.56194
Rank: 39/56
Challenge organizers (contact) sift8k logpolar96-fixed (128 float32: 512 bytes) LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
LogPolar-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 692.22
Rank: 1/56
0.484
Rank: 9/56
0.830
Rank: 26/56
0.53179
(±0.00040)
Rank: 13/56
466.74
Rank: 20/56
4092.23
Rank: 12/56
4.390
Rank: 12/56
0.475
Rank: 18/56
0.65929
(±0.00187)
Rank: 12/56
0.59554
Rank: 14/56
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-17
ContextDesc (upright)
Size: 512 bytes. Matches: built-in
7531.14 209.61
Rank: 54/56
0.444
Rank: 53/56
0.838
Rank: 19/56
0.49787
(±0.00045)
Rank: 35/56
265.47
Rank: 56/56
2766.49
Rank: 54/56
4.035
Rank: 49/56
0.486
Rank: 27/56
0.64606
(±0.00351)
Rank: 24/56
0.57196
Rank: 30/56
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-02-27
ContextDesc-Upright w/ DEGENSAC (no FLAN...
Size: 512 bytes. Matches: built-in
7879.06 250.61
Rank: 50/56
0.469
Rank: 52/56
0.841
Rank: 11/56
0.50326
(±0.00044)
Rank: 33/56
294.00
Rank: 53/56
2804.01
Rank: 53/56
4.047
Rank: 48/56
0.472
Rank: 16/56
0.64922
(±0.00054)
Rank: 23/56
0.57624
Rank: 29/56
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. FLANN disabled. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-03-18
LogPolar-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 435.12
Rank: 21/56
0.484
Rank: 9/56
0.839
Rank: 17/56
0.51495
(±0.00018)
Rank: 23/56
448.36
Rank: 22/56
4089.03
Rank: 14/56
4.417
Rank: 10/56
0.471
Rank: 14/56
0.65489
(±0.00359)
Rank: 17/56
0.58492
Rank: 16/56
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
Upright SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7846.57 302.54
Rank: 45/56
0.485
Rank: 5/56
0.815
Rank: 41/56
0.47840
(±0.00047)
Rank: 45/56
499.07
Rank: 10/56
3865.68
Rank: 20/56
4.139
Rank: 39/56
0.524
Rank: 48/56
0.60037
(±0.00279)
Rank: 49/56
0.53938
Rank: 45/56
Challenge organizers (contact) sift-lowth sift-upright (128 float32: 512 bytes) Upright SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
GeoDesc w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 431.07
Rank: 23/56
0.469
Rank: 32/56
0.821
Rank: 34/56
0.49759
(±0.00098)
Rank: 36/56
367.86
Rank: 43/56
3571.73
Rank: 36/56
4.147
Rank: 37/56
0.502
Rank: 46/56
0.62849
(±0.00034)
Rank: 38/56
0.56304
Rank: 38/56
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
SOSNet w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 322.90
Rank: 43/56
0.469
Rank: 32/56
0.840
Rank: 13/56
0.51198
(±0.00047)
Rank: 26/56
410.74
Rank: 29/56
3897.05
Rank: 18/56
4.259
Rank: 25/56
0.470
Rank: 12/56
0.64969
(±0.00287)
Rank: 21/56
0.58084
Rank: 21/56
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
HardNet-Upright w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7846.83 415.31
Rank: 26/56
0.484
Rank: 9/56
0.850
Rank: 7/56
0.53560
(±0.00010)
Rank: 11/56
443.64
Rank: 24/56
3862.00
Rank: 21/56
4.441
Rank: 6/56
0.468
Rank: 11/56
0.66509
(±0.00391)
Rank: 9/56
0.60034
Rank: 10/56
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
GeoDesc w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 267.86
Rank: 48/56
0.469
Rank: 32/56
0.824
Rank: 31/56
0.46659
(±0.00046)
Rank: 47/56
328.16
Rank: 49/56
3352.38
Rank: 41/56
4.115
Rank: 41/56
0.500
Rank: 41/56
0.60465
(±0.00332)
Rank: 47/56
0.53562
Rank: 48/56
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-28
HardNet w/ DEGENSAC
Size: 512 bytes. Matches: built-in
7875.19 345.21
Rank: 38/56
0.469
Rank: 32/56
0.840
Rank: 14/56
0.51617
(±0.00067)
Rank: 21/56
373.32
Rank: 37/56
3600.02
Rank: 32/56
4.227
Rank: 31/56
0.477
Rank: 21/56
0.64191
(±0.00236)
Rank: 25/56
0.57904
Rank: 24/56
Challenge organizers (contact) sift8k hardnet (128 float32: 512 bytes) HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-02-29
SOSNet w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 423.65
Rank: 24/56
0.469
Rank: 32/56
0.817
Rank: 37/56
0.50694
(±0.00028)
Rank: 28/56
410.74
Rank: 29/56
3897.05
Rank: 18/56
4.259
Rank: 25/56
0.470
Rank: 13/56
0.64969
(±0.00287)
Rank: 21/56
0.57832
Rank: 25/56
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
ContextDesc-Upright w/ DEGENSAC (no FLAN...
Size: 512 bytes. Matches: built-in
7875.59 315.85
Rank: 44/56
0.469
Rank: 31/56
0.818
Rank: 35/56
0.50504
(±0.00039)
Rank: 31/56
405.83
Rank: 31/56
3469.37
Rank: 40/56
4.086
Rank: 47/56
0.485
Rank: 26/56
0.65609
(±0.00269)
Rank: 16/56
0.58057
Rank: 22/56
Zixin Luo, Jiahui Zhang (contact) sift-def contextdesc-upright (128 float32: 512 bytes) ContextDesc with 8000 SIFT features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC, and setting keypoint orientation to a constant value to increase performance. FLANN disabled. https://arxiv.org/abs/1904.04084 https://github.com/lzx551402/contextdesc 20-03-25
Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
7874.85 260.65
Rank: 49/56
0.470
Rank: 29/56
0.830
Rank: 24/56
0.48001
(±0.00027)
Rank: 44/56
414.38
Rank: 28/56
3552.72
Rank: 39/56
4.032
Rank: 50/56
0.515
Rank: 47/56
0.59585
(±0.00212)
Rank: 50/56
0.53793
Rank: 47/56
Challenge organizers (contact) sift-lowth rootsift (128 float32: 512 bytes) Root-SIFT with (up to) 8000 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net w/ MAGSAC
Size: 512 bytes. Matches: built-in
7875.19 370.49
Rank: 33/56
0.469
Rank: 32/56
0.800
Rank: 48/56
0.48439
(±0.00050)
Rank: 41/56
292.99
Rank: 54/56
3064.01
Rank: 51/56
4.091
Rank: 45/56
0.529
Rank: 50/56
0.60477
(±0.00237)
Rank: 45/56
0.54458
Rank: 44/56
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
GeoDesc-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 390.50
Rank: 30/56
0.484
Rank: 9/56
0.812
Rank: 43/56
0.47532
(±0.00065)
Rank: 46/56
368.18
Rank: 41/56
3594.18
Rank: 34/56
4.252
Rank: 27/56
0.490
Rank: 31/56
0.62500
(±0.00188)
Rank: 40/56
0.55016
Rank: 42/56
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-02-29
GeoDesc w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 330.17
Rank: 41/56
0.469
Rank: 32/56
0.843
Rank: 10/56
0.50338
(±0.00091)
Rank: 32/56
367.86
Rank: 43/56
3571.73
Rank: 36/56
4.147
Rank: 37/56
0.502
Rank: 44/56
0.62849
(±0.00034)
Rank: 38/56
0.56593
Rank: 37/56
Challenge organizers (contact) sift8k geodesc (128 float32: 512 bytes) GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
HardNet-Upright w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 496.25
Rank: 14/56
0.484
Rank: 9/56
0.861
Rank: 2/56
0.56285
(±0.00093)
Rank: 2/56
469.07
Rank: 18/56
3935.20
Rank: 16/56
4.423
Rank: 8/56
0.463
Rank: 6/56
0.67278
(±0.00078)
Rank: 3/56
0.61781
Rank: 2/56
Challenge organizers (contact) sift8k hardnet-upright (128 float32: 512 bytes) Upright HardNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-03-01
Guided matching with Upright root SIFT (...
Size: 512 bytes. Matches: custom
7846.32 465.77
Rank: 17/56
0.485
Rank: 7/56
0.815
Rank: 42/56
0.49635
(±0.01585)
Rank: 37/56
762.72
Rank: 4/56
5611.16
Rank: 2/56
4.356
Rank: 15/56
0.471
Rank: 15/56
0.65943
(±0.00374)
Rank: 11/56
0.57789
Rank: 26/56
Anonymous (released after deadline) sift upright-root-sift (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-03
L2-Net-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 449.71
Rank: 20/56
0.484
Rank: 9/56
0.809
Rank: 45/56
0.50655
(±0.00046)
Rank: 29/56
342.55
Rank: 47/56
3269.23
Rank: 45/56
4.289
Rank: 16/56
0.494
Rank: 36/56
0.62936
(±0.00110)
Rank: 36/56
0.56795
Rank: 33/56
Challenge organizers (contact) sift8k l2net-upright (128 float32: 512 bytes) Upright L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-01
ASLFeat-MS
Size: 512 bytes. Matches: built-in
7361.55 433.00
Rank: 22/56
0.574
Rank: 1/56
0.736
Rank: 51/56
0.41102
(±0.00057)
Rank: 51/56
498.39
Rank: 11/56
3759.66
Rank: 27/56
4.388
Rank: 14/56
0.501
Rank: 43/56
0.61558
(±0.00296)
Rank: 44/56
0.51330
Rank: 50/56
Zixin Luo, Jiahui Zhang (contact) aslfeat-ms aslfeat-ms (128 float32: 512 bytes) ASLFeat (joint predition of detectors and descriptors with multi-scale input) with 8000 features, using the built-in matcher (bidirectional filter with the both strategy, optimal inlier and ratio test thresholds) with DEGENSAC. Under preparation N/A 20-02-27
LogPolar-Upright w/ MAGSAC
Size: 512 bytes. Matches: built-in
7846.83 580.50
Rank: 4/56
0.484
Rank: 9/56
0.816
Rank: 39/56
0.50539
(±0.00026)
Rank: 30/56
448.36
Rank: 22/56
4089.03
Rank: 14/56
4.417
Rank: 10/56
0.467
Rank: 10/56
0.65489
(±0.00359)
Rank: 17/56
0.58014
Rank: 23/56
Challenge organizers (contact) sift8k logpolar96-fixed-upright (128 float32: 512 bytes) Upright LogPolar descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-03-12
L2-Net w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 347.07
Rank: 36/56
0.469
Rank: 32/56
0.839
Rank: 16/56
0.52128
(±0.00050)
Rank: 18/56
314.34
Rank: 51/56
3167.35
Rank: 49/56
4.099
Rank: 43/56
0.499
Rank: 40/56
0.61574
(±0.00135)
Rank: 42/56
0.56851
Rank: 32/56
Challenge organizers (contact) sift8k l2net (128 float32: 512 bytes) L2-Net descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. http://openaccess.thecvf.com/content_cvpr_2017/papers/Tian_L2-Net_Deep_Learning_CVPR_2017_paper.pdf https://github.com/yuruntian/L2-Net 20-03-04
SOSNet w/ DEGENSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7875.19 401.01
Rank: 29/56
0.469
Rank: 32/56
0.854
Rank: 3/56
0.54926
(±0.00054)
Rank: 5/56
472.07
Rank: 15/56
4179.96
Rank: 7/56
4.261
Rank: 22/56
0.452
Rank: 1/56
0.66617
(±0.00260)
Rank: 7/56
0.60772
Rank: 5/56
Challenge organizers (contact) sift8k sosnet (128 float32: 512 bytes) SOSNet descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. DEGENSAC for stereo. FLANN disabled. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-03-02
GeoDesc-Upright w/ MAGSAC (no FLANN)
Size: 512 bytes. Matches: built-in
7846.83 505.26
Rank: 13/56
0.484
Rank: 9/56
0.833
Rank: 21/56
0.51206
(±0.00051)
Rank: 24/56
425.30
Rank: 26/56
3845.12
Rank: 23/56
4.284
Rank: 18/56
0.484
Rank: 25/56
0.65020
(±0.00172)
Rank: 19/56
0.58113
Rank: 20/56
Challenge organizers (contact) sift8k geodesc-upright (128 float32: 512 bytes) Upright GeoDesc descriptors on DoG features (OpenCV), extracted with a low detection threshold to generate up to 8000 points. Using the built-in matcher: bidirectional filter with the both strategy. MAGSAC for stereo. FLANN disabled. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-03-03
Guided matching with Upright root SIFT (...
Size: 512 bytes. Matches: custom
7846.32 579.76
Rank: 5/56
0.485
Rank: 7/56
0.773
Rank: 50/56
0.48095
(±0.00000)
Rank: 42/56
1300.74
Rank: 1/56
7378.75
Rank: 1/56
4.136
Rank: 40/56
0.501
Rank: 42/56
0.63020
(±0.00490)
Rank: 34/56
0.55558
Rank: 40/56
Anonymous (released after deadline) sift upright-root-sift (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-02-28

Phototourism: restricted keypoints, large descriptors (2048 bytes)

Note: entries with the same multi-view configuration may seem duplicated. This is normal: performance is averaged across tasks.
Stereo Multiview Avg.
Method NF NI Rep.
(3 pix.)
MS
(3 pix.)
mAA
(at 10o)
NM NL TL ATE mAA
(at 100)
mAA
(at 100)
Authors Keypoint Descriptor Summary Paper Website Processing date
D2-Net (multi-scale), DEGENSAC
Size: 2048 bytes. Matches: built-in
2045.80 117.10
Rank: 14/40
0.167
Rank: 34/40
0.287
Rank: 34/40
0.11872
(±0.00058)
Rank: 33/40
277.73
Rank: 9/40
1879.74
Rank: 5/40
3.020
Rank: 33/40
0.798
Rank: 32/40
0.25757
(±0.00178)
Rank: 32/40
0.18815
Rank: 33/40
Challenge organizers (contact) d2net-multiscale d2net-multiscale (512 float32: 2048 bytes) D2-Net, multi-scale model, up to 2048 features. Trained on the MegaDepth dataset, removing scenes which overlap with the Phototourism test set. Stereo with DEGENSAC and optimal parameters. Parameters tuned separately from the 8k submission. http://openaccess.thecvf.com/content_CVPR_2019/papers/Dusmanu_D2-Net_A_Trainable_CNN_for_Joint_Description_and_Detection_of_CVPR_2019_paper.pdf https://github.com/mihaidusmanu/d2-net 20-01-28
HardNet (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 136.15
Rank: 9/40
0.327
Rank: 10/40
0.789
Rank: 1/40
0.43694
(±0.00116)
Rank: 1/40
182.78
Rank: 16/40
1345.73
Rank: 10/40
4.201
Rank: 7/40
0.529
Rank: 5/40
0.57391
(±0.00317)
Rank: 3/40
0.50543
Rank: 2/40
Challenge organizers (contact) sift-def hardnet-upright (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
Guided matching hardnet
Size: 512 bytes. Matches: custom
1892.98 143.70
Rank: 7/40
0.327
Rank: 18/40
0.780
Rank: 4/40
0.41721
(±0.00000)
Rank: 5/40
241.66
Rank: 11/40
1656.72
Rank: 9/40
4.202
Rank: 5/40
0.511
Rank: 1/40
0.59433
(±0.00185)
Rank: 1/40
0.50577
Rank: 1/40
Anonymous (released after deadline) sift upright-hardnet (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-03
DELF-GLD (128D), PyRANSAC
Size: 512 bytes. Matches: built-in
2037.95 94.38
Rank: 31/40
0.110
Rank: 35/40
0.152
Rank: 37/40
0.06771
(±0.00064)
Rank: 38/40
422.01
Rank: 5/40
2016.18
Rank: 3/40
2.524
Rank: 36/40
0.908
Rank: 38/40
0.12029
(±0.00117)
Rank: 36/40
0.09400
Rank: 37/40
Challenge organizers (contact) delf-gld-2k-128d delf-gld-2k-128d (128 float32: 512 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 128 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
SOSNet (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 170.17
Rank: 3/40
0.327
Rank: 10/40
0.769
Rank: 7/40
0.43289
(±0.00101)
Rank: 2/40
173.88
Rank: 18/40
1312.03
Rank: 12/40
4.208
Rank: 3/40
0.531
Rank: 6/40
0.57242
(±0.00097)
Rank: 5/40
0.50266
Rank: 4/40
Challenge organizers (contact) sift-def sosnet-upright (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
SOSNet (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 149.80
Rank: 4/40
0.327
Rank: 10/40
0.781
Rank: 3/40
0.42502
(±0.00011)
Rank: 4/40
173.88
Rank: 18/40
1312.03
Rank: 12/40
4.208
Rank: 3/40
0.529
Rank: 4/40
0.57242
(±0.00097)
Rank: 5/40
0.49872
Rank: 5/40
Challenge organizers (contact) sift-def sosnet-upright (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
R2D2 (r2d2-wasf-n16), DEGENSAC
Size: 512 bytes. Matches: built-in
2048.00 170.97
Rank: 2/40
0.418
Rank: 1/40
0.716
Rank: 25/40
0.35290
(±0.00069)
Rank: 21/40
253.03
Rank: 10/40
1134.39
Rank: 27/40
4.201
Rank: 6/40
0.546
Rank: 7/40
0.55946
(±0.00119)
Rank: 7/40
0.45618
Rank: 10/40
Challenge organizers (contact) r2d2-wasf-n16 r2d2-wasf-n16 (128 float32: 512 bytes) R2D2 (model r2d2-wasf-n16) with 2k features, using the built-in matcher (bidirectional filter with the both strategy) and no ratio test, and DEGENSAC with optimal parameters for stereo. N/A https://opencv.org 20-01-28
GeoDesc (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 139.91
Rank: 8/40
0.327
Rank: 10/40
0.751
Rank: 15/40
0.37669
(±0.00080)
Rank: 15/40
141.85
Rank: 30/40
1155.98
Rank: 25/40
4.111
Rank: 12/40
0.591
Rank: 17/40
0.51746
(±0.00146)
Rank: 12/40
0.44708
Rank: 15/40
Challenge organizers (contact) sift-def geodesc-upright (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
HardNet, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 105.71
Rank: 22/40
0.317
Rank: 22/40
0.765
Rank: 11/40
0.38298
(±0.00073)
Rank: 12/40
146.17
Rank: 28/40
1223.02
Rank: 20/40
3.934
Rank: 21/40
0.587
Rank: 16/40
0.50998
(±0.00237)
Rank: 17/40
0.44648
Rank: 16/40
Challenge organizers (contact) sift-def hardnet (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
SuperPoint (2k features, NMS=2), DEGENSA...
Size: 1024 bytes. Matches: built-in
2048.00 101.75
Rank: 24/40
0.371
Rank: 3/40
0.615
Rank: 30/40
0.27040
(±0.00072)
Rank: 28/40
124.15
Rank: 37/40
928.73
Rank: 38/40
4.094
Rank: 14/40
0.643
Rank: 27/40
0.46511
(±0.00392)
Rank: 24/40
0.36776
Rank: 27/40
Challenge organizers (contact) superpoint-nms2-r1200 superpoint-nms2-r1200 (256 float32: 1024 bytes) SuperPoint (initial release based on Pytorch). Lowered detection threshold to obtain up to 2k features per image. Using the built-in Non-Maxima Suppression filter at 2 pixels. Images are resized to 1200 pixels on the largest side. https://arxiv.org/abs/1712.07629 https://github.com/MagicLeapResearch/SuperPointPretrainedNetwork 20-01-28
SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1939.53 74.14
Rank: 37/40
0.317
Rank: 20/40
0.721
Rank: 24/40
0.30329
(±0.00076)
Rank: 25/40
167.10
Rank: 20/40
986.36
Rank: 36/40
3.596
Rank: 29/40
0.671
Rank: 29/40
0.38429
(±0.00130)
Rank: 29/40
0.34379
Rank: 28/40
Challenge organizers (contact) sift-def sift (128 float32: 512 bytes) SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 133.44
Rank: 11/40
0.327
Rank: 10/40
0.772
Rank: 5/40
0.39481
(±0.00042)
Rank: 7/40
163.19
Rank: 21/40
1245.79
Rank: 18/40
4.115
Rank: 10/40
0.554
Rank: 8/40
0.53872
(±0.00257)
Rank: 8/40
0.46676
Rank: 8/40
Challenge organizers (contact) sift-def l2net-upright (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
DELF-GLD (32D), PyRANSAC
Size: 128 bytes. Matches: built-in
2037.95 91.34
Rank: 33/40
0.110
Rank: 35/40
0.120
Rank: 39/40
0.05664
(±0.00023)
Rank: 40/40
444.19
Rank: 1/40
1680.65
Rank: 7/40
2.420
Rank: 38/40
0.942
Rank: 39/40
0.08292
(±0.00119)
Rank: 38/40
0.06978
Rank: 39/40
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
ORB (OpenCV), DEGENSAC
Size: 32 bytes. Matches: built-in
2033.08 60.68
Rank: 40/40
0.356
Rank: 6/40
0.509
Rank: 32/40
0.08003
(±0.00082)
Rank: 35/40
119.41
Rank: 38/40
252.10
Rank: 40/40
1.974
Rank: 40/40
0.870
Rank: 34/40
0.02068
(±0.00199)
Rank: 40/40
0.05035
Rank: 40/40
Challenge organizers (contact) orb orb (32 uint8: 32 bytes) ORB with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
LogPolarDesc, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 144.16
Rank: 5/40
0.317
Rank: 22/40
0.740
Rank: 21/40
0.38507
(±0.00039)
Rank: 10/40
155.56
Rank: 25/40
1300.54
Rank: 14/40
3.954
Rank: 17/40
0.570
Rank: 10/40
0.52445
(±0.00315)
Rank: 10/40
0.45476
Rank: 11/40
Challenge organizers (contact) sift-def logpolar (128 float32: 512 bytes) LogPolarDesc descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-01-28
L2-Net, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 84.00
Rank: 35/40
0.317
Rank: 28/40
0.767
Rank: 10/40
0.36004
(±0.00079)
Rank: 19/40
132.80
Rank: 35/40
1129.03
Rank: 29/40
3.854
Rank: 26/40
0.591
Rank: 18/40
0.47583
(±0.00180)
Rank: 22/40
0.41793
Rank: 20/40
Challenge organizers (contact) sift-def l2net (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
L2-Net, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 104.04
Rank: 23/40
0.317
Rank: 28/40
0.754
Rank: 14/40
0.35397
(±0.00088)
Rank: 20/40
132.80
Rank: 35/40
1129.03
Rank: 29/40
3.854
Rank: 26/40
0.592
Rank: 19/40
0.47583
(±0.00180)
Rank: 22/40
0.41490
Rank: 21/40
Challenge organizers (contact) sift-def l2net (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
HardNet, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 134.14
Rank: 10/40
0.317
Rank: 22/40
0.746
Rank: 19/40
0.38203
(±0.00091)
Rank: 14/40
146.17
Rank: 28/40
1223.02
Rank: 20/40
3.934
Rank: 21/40
0.585
Rank: 15/40
0.50998
(±0.00237)
Rank: 17/40
0.44601
Rank: 17/40
Challenge organizers (contact) sift-def hardnet (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
Upright SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1893.01 100.40
Rank: 28/40
0.327
Rank: 8/40
0.750
Rank: 16/40
0.36487
(±0.00048)
Rank: 18/40
198.66
Rank: 13/40
1221.16
Rank: 22/40
3.908
Rank: 23/40
0.623
Rank: 25/40
0.47743
(±0.00204)
Rank: 21/40
0.42115
Rank: 19/40
Challenge organizers (contact) sift-def sift-upright (128 float32: 512 bytes) Upright SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
SURF (OpenCV), DEGENSAC
Size: 256 bytes. Matches: built-in
2013.95 69.86
Rank: 38/40
0.319
Rank: 19/40
0.626
Rank: 26/40
0.20564
(±0.00049)
Rank: 30/40
294.61
Rank: 8/40
1130.23
Rank: 28/40
3.466
Rank: 30/40
0.738
Rank: 30/40
0.34357
(±0.00354)
Rank: 30/40
0.27460
Rank: 30/40
Challenge organizers (contact) surf-def surf (64 float32: 256 bytes) SURF with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
D2-Net (single-scale), DEGENSAC
Size: 2048 bytes. Matches: built-in
2039.21 144.14
Rank: 6/40
0.199
Rank: 33/40
0.332
Rank: 33/40
0.15679
(±0.00080)
Rank: 32/40
355.63
Rank: 7/40
1859.99
Rank: 6/40
3.382
Rank: 31/40
0.756
Rank: 31/40
0.33547
(±0.00111)
Rank: 31/40
0.24613
Rank: 31/40
Challenge organizers (contact) d2net-singlescale d2net-singlescale (512 float32: 2048 bytes) D2-Net, single-scale model, up to 2048 features. Trained on the MegaDepth dataset, removing scenes which overlap with the Phototourism test set. Stereo with DEGENSAC and optimal parameters. Parameters tuned separately from the 8k submission. http://openaccess.thecvf.com/content_CVPR_2019/papers/Dusmanu_D2-Net_A_Trainable_CNN_for_Joint_Description_and_Detection_of_CVPR_2019_paper.pdf https://github.com/mihaidusmanu/d2-net 20-01-28
LFNet w/ DEGENSAC
Size: 1024 bytes. Matches: built-in
2023.07 101.32
Rank: 25/40
0.287
Rank: 32/40
0.574
Rank: 31/40
0.22369
(±0.00038)
Rank: 29/40
186.99
Rank: 15/40
1278.42
Rank: 16/40
4.010
Rank: 15/40
0.644
Rank: 28/40
0.46293
(±0.00122)
Rank: 25/40
0.34331
Rank: 29/40
Challenge organizers (contact) lfnet lfnet (256 float32: 1024 bytes) LFNet. Using upright model https://arxiv.org/abs/1805.09662 https://github.com/vcg-uvic/lf-net-release 20-03-17
Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1939.53 80.40
Rank: 36/40
0.317
Rank: 20/40
0.743
Rank: 20/40
0.33160
(±0.00070)
Rank: 24/40
162.54
Rank: 23/40
1064.73
Rank: 32/40
3.693
Rank: 28/40
0.633
Rank: 26/40
0.42461
(±0.00081)
Rank: 28/40
0.37811
Rank: 26/40
Challenge organizers (contact) sift-def rootsift (128 float32: 512 bytes) Root-SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
L2-Net (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 106.35
Rank: 21/40
0.327
Rank: 10/40
0.787
Rank: 2/40
0.40199
(±0.00065)
Rank: 6/40
163.19
Rank: 21/40
1245.79
Rank: 18/40
4.115
Rank: 10/40
0.556
Rank: 9/40
0.53872
(±0.00257)
Rank: 8/40
0.47035
Rank: 7/40
Challenge organizers (contact) sift-def l2net-upright (128 float32: 512 bytes) L2-Net descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. http://www.nlpr.ia.ac.cn/fanbin/pub/L2-Net_CVPR17.pdf https://github.com/vcg-uvic/image-matching-benchmark-baselines 20-01-28
SOSNet, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 115.88
Rank: 15/40
0.317
Rank: 22/40
0.757
Rank: 13/40
0.37316
(±0.00044)
Rank: 17/40
138.50
Rank: 33/40
1186.36
Rank: 23/40
3.953
Rank: 19/40
0.572
Rank: 12/40
0.51487
(±0.00216)
Rank: 14/40
0.44402
Rank: 18/40
Challenge organizers (contact) sift-def sosnet (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
DELF-GLD (128D), DEGENSAC
Size: 512 bytes. Matches: built-in
2037.95 100.52
Rank: 27/40
0.110
Rank: 35/40
0.148
Rank: 38/40
0.07695
(±0.00044)
Rank: 36/40
422.01
Rank: 5/40
2016.18
Rank: 3/40
2.524
Rank: 36/40
0.902
Rank: 36/40
0.12029
(±0.00117)
Rank: 36/40
0.09862
Rank: 36/40
Challenge organizers (contact) delf-gld-2k-128d delf-gld-2k-128d (128 float32: 512 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 128 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
DELF-GLD (32D), DEGENSAC
Size: 128 bytes. Matches: built-in
2037.95 96.84
Rank: 30/40
0.110
Rank: 35/40
0.117
Rank: 40/40
0.05987
(±0.00031)
Rank: 39/40
444.19
Rank: 1/40
1680.65
Rank: 7/40
2.420
Rank: 38/40
0.947
Rank: 40/40
0.08292
(±0.00119)
Rank: 38/40
0.07139
Rank: 38/40
Challenge organizers (contact) delf-gld-2k-32d delf-gld-2k-32d (32 float32: 128 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 32 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
GeoDesc, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 111.61
Rank: 19/40
0.317
Rank: 28/40
0.731
Rank: 23/40
0.33818
(±0.00032)
Rank: 23/40
114.97
Rank: 39/40
1018.30
Rank: 34/40
3.889
Rank: 24/40
0.609
Rank: 22/40
0.45972
(±0.00065)
Rank: 26/40
0.39895
Rank: 23/40
Challenge organizers (contact) sift-def geodesc (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
SuperPoint (2k features, NMS=3), DEGENSA...
Size: 1024 bytes. Matches: built-in
2048.00 112.71
Rank: 17/40
0.364
Rank: 4/40
0.619
Rank: 29/40
0.27741
(±0.00074)
Rank: 27/40
148.24
Rank: 27/40
1037.77
Rank: 33/40
4.195
Rank: 9/40
0.621
Rank: 24/40
0.49001
(±0.00124)
Rank: 20/40
0.38371
Rank: 25/40
Challenge organizers (contact) superpoint-nms3-r1200 superpoint-nms3-r1200 (256 float32: 1024 bytes) SuperPoint (initial release based on Pytorch). Lowered detection threshold to obtain up to 2k features per image. Using the built-in Non-Maxima Suppression filter at 3 pixels. Images are resized to 1200 pixels on the largest side. https://arxiv.org/abs/1712.07629 https://github.com/MagicLeapResearch/SuperPointPretrainedNetwork 20-01-28
SuperPoint (2k features, NMS=4), DEGENSA...
Size: 1024 bytes. Matches: built-in
2048.00 117.93
Rank: 13/40
0.359
Rank: 5/40
0.621
Rank: 28/40
0.28007
(±0.00041)
Rank: 26/40
161.96
Rank: 24/40
1097.54
Rank: 31/40
4.211
Rank: 2/40
0.611
Rank: 23/40
0.49880
(±0.00310)
Rank: 19/40
0.38943
Rank: 24/40
Challenge organizers (contact) superpoint-nms4-r1200 superpoint-nms4-r1200 (256 float32: 1024 bytes) SuperPoint (initial release based on Pytorch). Lowered detection threshold to obtain up to 2k features per image. Using the built-in Non-Maxima Suppression filter at 2 pixels. Images are resized to 1200 pixels on the largest side. https://arxiv.org/abs/1712.07629 https://github.com/MagicLeapResearch/SuperPointPretrainedNetwork 20-01-28
AKAZE (OpenCV), DEGENSAC
Size: 61 bytes. Matches: built-in
1640.91 67.54
Rank: 39/40
0.352
Rank: 7/40
0.621
Rank: 27/40
0.17767
(±0.00068)
Rank: 31/40
219.35
Rank: 12/40
745.29
Rank: 39/40
3.279
Rank: 32/40
0.850
Rank: 33/40
0.21136
(±0.00413)
Rank: 33/40
0.19452
Rank: 32/40
Challenge organizers (contact) akaze-def akaze (61 uint8: 61 bytes) AKAZE with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC. N/A https://opencv.org 20-01-28
GeoDesc, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 90.21
Rank: 34/40
0.317
Rank: 28/40
0.747
Rank: 18/40
0.34028
(±0.00040)
Rank: 22/40
114.97
Rank: 39/40
1018.30
Rank: 34/40
3.889
Rank: 24/40
0.608
Rank: 21/40
0.45972
(±0.00065)
Rank: 26/40
0.40000
Rank: 22/40
Challenge organizers (contact) sift-def geodesc (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28
HardNet (upright), MAGSAC
Size: 512 bytes. Matches: built-in
1892.99 175.29
Rank: 1/40
0.327
Rank: 10/40
0.768
Rank: 8/40
0.43287
(±0.00055)
Rank: 3/40
182.78
Rank: 16/40
1345.73
Rank: 10/40
4.201
Rank: 7/40
0.527
Rank: 2/40
0.57391
(±0.00317)
Rank: 3/40
0.50339
Rank: 3/40
Challenge organizers (contact) sift-def hardnet-upright (128 float32: 512 bytes) HardNet descriptors extracted on SIFT keypoints with a fixed orientation, and MAGSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1705.10872 https://github.com/DagnyT/hardnet 20-01-28
DELF-GLD (512D), DEGENSAC
Size: 2048 bytes. Matches: built-in
2037.95 98.59
Rank: 29/40
0.110
Rank: 35/40
0.166
Rank: 36/40
0.08477
(±0.00027)
Rank: 34/40
429.05
Rank: 3/40
2136.19
Rank: 1/40
2.554
Rank: 34/40
0.899
Rank: 35/40
0.13580
(±0.00450)
Rank: 34/40
0.11028
Rank: 34/40
Challenge organizers (contact) delf-gld-2k-512d delf-gld-2k-512d (512 float32: 2048 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 512 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with DEGENSAC. https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
Upright Root-SIFT (OpenCV), DEGENSAC
Size: 512 bytes. Matches: built-in
1893.01 107.42
Rank: 20/40
0.327
Rank: 8/40
0.768
Rank: 9/40
0.38929
(±0.00031)
Rank: 9/40
193.67
Rank: 14/40
1263.61
Rank: 17/40
3.995
Rank: 16/40
0.574
Rank: 13/40
0.51247
(±0.00292)
Rank: 16/40
0.45088
Rank: 12/40
Challenge organizers (contact) sift-def rootsift-upright (128 float32: 512 bytes) Upright Root-SIFT with (up to) 2048 features, using the built-in matcher (bidirectional filter with the both strategy) and DEGENSAC, and setting keypoint orientation to a constant value. N/A https://opencv.org 20-01-28
DELF-GLD (512D), PyRANSAC
Size: 2048 bytes. Matches: built-in
2037.95 92.64
Rank: 32/40
0.110
Rank: 35/40
0.171
Rank: 35/40
0.07179
(±0.00016)
Rank: 37/40
429.05
Rank: 3/40
2136.19
Rank: 1/40
2.554
Rank: 34/40
0.906
Rank: 37/40
0.13580
(±0.00450)
Rank: 34/40
0.10379
Rank: 35/40
Challenge organizers (contact) delf-gld-2k-512d delf-gld-2k-512d (512 float32: 2048 bytes) DELF-GLD, with up to 2k features. Descriptors are cropped to 512 dimensions with PCA. Re-using optimal parameters for the (default) 40D models. Stereo with PyRANSAC (DEGENSAC with the degeneracy check turned off). https://arxiv.org/abs/1812.01584 https://github.com/tensorflow/models/tree/master/research/delf 20-01-28
SOSNet, MAGSAC
Size: 512 bytes. Matches: built-in
1939.51 130.42
Rank: 12/40
0.317
Rank: 22/40
0.748
Rank: 17/40
0.38360
(±0.00045)
Rank: 11/40
138.50
Rank: 33/40
1186.36
Rank: 23/40
3.953
Rank: 19/40
0.576
Rank: 14/40
0.51487
(±0.00216)
Rank: 14/40
0.44923
Rank: 14/40
Challenge organizers (contact) sift-def sosnet (128 float32: 512 bytes) SOSNet descriptors extracted on SIFT keypoints and MAGSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1904.05019 https://github.com/yuruntian/SOSNet 20-01-28
LogPolarDesc, DEGENSAC
Size: 512 bytes. Matches: built-in
1939.51 112.92
Rank: 16/40
0.317
Rank: 22/40
0.759
Rank: 12/40
0.38939
(±0.00082)
Rank: 8/40
155.56
Rank: 25/40
1300.54
Rank: 14/40
3.954
Rank: 17/40
0.571
Rank: 11/40
0.52445
(±0.00315)
Rank: 10/40
0.45692
Rank: 9/40
Challenge organizers (contact) sift-def logpolar (128 float32: 512 bytes) LogPolarDesc descriptors extracted on SIFT keypoints and DEGENSAC for stereo. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1908.05547 https://github.com/cvlab-epfl/log-polar-descriptors 20-01-28
SEKD
Size: 512 bytes. Matches: built-in
1789.04 101.22
Rank: 26/40
0.378
Rank: 2/40
0.738
Rank: 22/40
0.37554
(±0.00082)
Rank: 16/40
140.28
Rank: 32/40
984.90
Rank: 37/40
4.397
Rank: 1/40
0.527
Rank: 3/40
0.58125
(±0.00346)
Rank: 2/40
0.47840
Rank: 6/40
Anonymous (released after deadline) sekd sekd (128 float32: 512 bytes) Anonymous (released after deadline) N/A N/A 20-03-17
GeoDesc (upright), DEGENSAC
Size: 512 bytes. Matches: built-in
1892.99 112.15
Rank: 18/40
0.327
Rank: 10/40
0.770
Rank: 6/40
0.38207
(±0.00065)
Rank: 13/40
141.85
Rank: 30/40
1155.98
Rank: 25/40
4.111
Rank: 12/40
0.592
Rank: 20/40
0.51746
(±0.00146)
Rank: 12/40
0.44977
Rank: 13/40
Challenge organizers (contact) sift-def geodesc-upright (128 float32: 512 bytes) GeoDesc descriptors extracted on SIFT keypoints with a fixed orientation, and DEGENSAC for stereo. Re-using parameters found for the orientation-sensitive variant. Please refer to the baselines repository (linked) for details. https://arxiv.org/abs/1807.06294 https://github.com/lzx551402/geodesc 20-01-28