We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Random indexing of multidimensional data.
- Authors
Sandin, Fredrik; Emruli, Blerim; Sahlgren, Magnus
- Abstract
Random indexing (RI) is a lightweight dimension reduction method, which is used, for example, to approximate vector semantic relationships in online natural language processing systems. Here we generalise RI to multidimensional arrays and therefore enable approximation of higher-order statistical relationships in data. The generalised method is a sparse implementation of random projections, which is the theoretical basis also for ordinary RI and other randomisation approaches to dimensionality reduction and data representation. We present numerical experiments which demonstrate that a multidimensional generalisation of RI is feasible, including comparisons with ordinary RI and principal component analysis. The RI method is well suited for online processing of data streams because relationship weights can be updated incrementally in a fixed-size distributed representation, and inner products can be approximated on the fly at low computational cost. An open source implementation of generalised RI is provided.
- Subjects
NATURAL language processing; INDEXING; APPROXIMATION theory; RANDOM projection method; QUANTITATIVE research
- Publication
Knowledge & Information Systems, 2017, Vol 52, Issue 1, p267
- ISSN
0219-1377
- Publication type
Article
- DOI
10.1007/s10115-016-1012-2