BM-index: Balanced Metric Space Index based on Weighted Voronoi Partitioning
Authors | |
---|---|
Year of publication | 2019 |
Type | Article in Proceedings |
Conference | Advances in Databases and Information Systems, 23th East European Conference, ADBIS 2019 |
MU Faculty or unit | |
Citation | |
Web | https://link.springer.com/chapter/10.1007/978-3-030-28730-6_21 |
Doi | http://dx.doi.org/10.1007/978-3-030-28730-6_21 |
Keywords | Indexing structure;k-nearest neighbor query;Approximate search;Metric space;Voronoi partitioning |
Description | Processing large volumes of various data needs index structures that can efficiently organize them on secondary memory. Methods based on so-called pivot permutations have become popular in addressing these requirements because of their tremendous querying performance. They localize data objects by ordering preselected anchor objects by their distances to the data objects, and so no coordinate system is exploited to partition the data. This represents a generic solution for unstructured and high-dimensional data. In principle, pivot permutations implement recursive Voronoi tessellation. Also, due to the fixed preselected anchors, such partitioning cannot adapt to the data distribution and leads to very unbalanced cells. In this paper, we address this issue and propose a novel schema called BM-index. It exploits weighted Voronoi partitioning to create pivot permutations that adapt to data distribution. Secondary memory is then accessed efficiently with respect to the existing disk-oriented structures, such as M-index. We present an algorithm to balance the data partitions, and we show its correctness. In experiments on a real-life image collection CoPhIR, we show superior performance in I/O costs when evaluating k-nearest neighbors queries. |
Related projects: |