CITATION — REFERENCE ENTRY

system · donahue2023-singsong

Revision 92ab86da-b848-4004-b6b9-d15e06d57acb · 11/1/2026, 5:07:07 PM UTC
Claim ID
system
Assertion
SingSong generates instrumental music audio to accompany input vocals. It was trained on vocal and instrumental pairs obtained by applying source separation to a large corpus of music, using an adaptation of the AudioLM audio generation model; listeners significantly preferred its instrumentals to those from a retrieval baseline.
Quote
We present SingSong, a system that generates instrumental music to accompany input vocals [...]. Specifically, we apply a state-of-the-art source separation algorithm to a large corpus of music audio to produce aligned pairs of vocals and instrumental sources. Then, we adapt AudioLM [...] to be suitable for conditional "audio-to-audio" generation tasks, and train it on the source-separated (vocal, instrumental) pairs. In a pairwise comparison with the same vocal inputs, listeners expressed a significant preference for instrumentals generated by SingSong compared to those from a strong retrieval baseline.
Quote language
en
Locator
section: Abstract
Available in