A Scalable Solution To The Nearest Neighbor Search Problem Through Local-search Methods On Neighbor Graphs
2017 Β· Eric S. Tellez, Guillermo Ruiz, Edgar Chavez, et al.
Abstract
Near neighbor search (NNS) is a powerful abstraction for data access; however, data indexing is troublesome even for approximate indexes. For intrinsically high-dimensional data, high-quality fast searches demand either indexes with impractically large memory usage or preprocessing time. In this paper, we introduce an algorithm to solve a nearest-neighbor query \(q\) by minimizing a kernel function defined by the distance from \(q\) to each object in the database. The minimization is performed using metaheuristics to solve the problem rapidly; even when some methods in the literature use this strategy behind the scenes, our approach is the first one using it explicitly. We also provide two approaches to select edges in the graph's construction stage that limit memory footprint and reduce the number of free parameters simultaneously. We carry out a thorough experimental comparison with state-of-the-art indexes through synthetic and real-world datasets; we found out that our contribu
Authors
(none)
Tags
Stats
Related papers
- Learning To Index For Nearest Neighbor Search (2018)10.35
- Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graph (2017)18.20
- Associative Memories To Accelerate Approximate Nearest Neighbor Search (2016)6.34
- Worst-case Performance Of Popular Approximate Nearest Neighbor Search Implementations: Guarantees And Limitations (2023)5.84
- Graph-based Nearest Neighbor Search: From Practice To Theory (2019)0.00
- Similarity Search On Neighbor's Graphs With Automatic Pareto Optimal Performance And Minimum Expected Quality Setups Based On Hyperparameter Optimization (2022)0.00
- Symphonyqg: Towards Symphonious Integration Of Quantization And Graph For Approximate Nearest Neighbor Search (2024)7.50
- Hd-index: Pushing The Scalability-accuracy Boundary For Approximate Knn Search In High-dimensional Spaces (2018)14.02