We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Latent Timbre Synthesis: Audio-based variational auto-encoders for music composition and sound design applications.
- Authors
Tatar, Kıvanç; Bisig, Daniel; Pasquier, Philippe
- Abstract
We present the Latent Timbre Synthesis, a new audio synthesis method using deep learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent space of audio frames. We provide the details of two Variational Autoencoder architectures for the Latent Timbre Synthesis and compare their advantages and drawbacks. The implementation includes a fully working application with a graphical user interface, called interpolate_two, which enables practitioners to generate timbres between two audio excerpts of their selection using interpolation and extrapolation in the latent space of audio frames. Our implementation is open source, and we aim to improve the accessibility of this technology by providing a guide for users with any technical background. Our study includes a qualitative analysis where nine composers evaluated the Latent Timbre Synthesis and the interpolate_two application within their practices.
- Subjects
MUSICAL composition; SOUND design; SOUND designers; GRAPHICAL user interfaces
- Publication
Neural Computing & Applications, 2021, Vol 33, Issue 1, p67
- ISSN
0941-0643
- Publication type
Article
- DOI
10.1007/s00521-020-05424-2