We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Distributed high dimensional indexing for k-NN search.
- Authors
Choi, Hyun-Hwa; Lee, Mi-Young; Lee, Kyu-Chul
- Abstract
Although conventional index structures provide various nearest-neighbor search algorithms for high-dimensional data, there are additional requirements to increase search performances, as well as to support index scalability for large-scale datasets. To support these requirements, we propose a distributed high-dimensional index structure based on cluster systems, called a Distributed Vector Approximation-tree (DVA-tree), which is a two-level structure consisting of a hybrid spill-tree and Vector Approximation files (VA-files). We also describe the algorithms used for constructing the DVA-tree over multiple machines and performing distributed k-nearest neighbors (NN) searches. To evaluate performances of the DVA-tree, we conduct an experimental study using both real and synthetic datasets. The results show that our proposed method has significant performance advantages over existing index structures on different kinds of dataset.
- Subjects
INFORMATION organization; DATABASES; DOCUMENTATION; INDEXES; BUILDINGS
- Publication
Journal of Supercomputing, 2012, Vol 62, Issue 3, p1362
- ISSN
0920-8542
- Publication type
Article
- DOI
10.1007/s11227-012-0800-z