We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Sigma-Delta and distributed noise-shaping quantization methods for random Fourier features.
- Authors
Zhang, Jinjie; Kannan, Harish; Cloninger, Alexander; Saab, Rayan
- Abstract
We propose the use of low bit-depth Sigma-Delta and distributed noise-shaping methods for quantizing the random Fourier features (RFFs) associated with shift-invariant kernels. We prove that our quantized RFFs—even in the case of |$1$| -bit quantization—allow a high-accuracy approximation of the underlying kernels, and the approximation error decays at least polynomially fast as the dimension of the RFFs increases. We also show that the quantized RFFs can be further compressed, yielding an excellent trade-off between memory use and accuracy. Namely, the approximation error now decays exponentially as a function of the bits used. The quantization algorithms we propose are intended for digitizing RFFs without explicit knowledge of the application for which they will be used. Nevertheless, as we empirically show by testing the performance of our methods on several machine learning tasks, our method compares favourably with other state-of-the-art quantization methods.
- Subjects
SEPARATION of variables; APPROXIMATION error; MACHINE learning; TACIT knowledge
- Publication
Information & Inference: A Journal of the IMA, 2024, Vol 13, Issue 1, p1
- ISSN
2049-8764
- Publication type
Article
- DOI
10.1093/imaiai/iaad052