We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Adapting ADtrees for improved performance on large datasets with high-arity features.
- Authors
Van Dam, Robert; Langkilde-Geary, Irene; Ventura, Dan
- Abstract
The ADtree, a data structure useful for caching sufficient statistics, has been successfully adapted to grow lazily when memory is limited and to update sequentially with an incrementally updated dataset. However, even these modified forms of the ADtree still exhibit inefficiencies in terms of both space usage and query time, particularly on datasets with very high dimensionality and with high-arity features. We propose four modifications to the ADtree, each of which can be used to improve size and query time under specific types of datasets and features. These modifications also provide an increased ability to precisely control how an ADtree is built and to tune its size given external memory or speed requirements.
- Subjects
DATA structures; DATA mining; BIG data; INFORMATION retrieval; PERTURBATION theory
- Publication
Knowledge & Information Systems, 2013, Vol 35, Issue 3, p525
- ISSN
0219-1377
- Publication type
Article
- DOI
10.1007/s10115-012-0510-0