CITATION — REFERENCE ENTRY

teacher-models · li2023-mert

Revision de1271be-74e7-40af-9b83-61ded34ab10c · 11/1/2026, 9:02:00 AM UTC
Citation
li2023-mert
Claim ID
teacher-models
Assertion
MERT uses masked-language-modelling-style acoustic pretraining with pseudo-labels from an RVQ-VAE acoustic teacher and a CQT-based musical teacher, and was evaluated on 14 music understanding tasks.
Quote
This combination includes an acoustic teacher based on Residual Vector Quantisation - Variational AutoEncoder (RVQ-VAE) and a musical teacher based on the Constant-Q Transform (CQT). [...] Experimental results indicate that our model can generalise and perform well on 14 music understanding tasks and attain state-of-the-art (SOTA) overall scores.
Quote language
en
Locator
section: Abstract
Available in