CITATION — REFERENCE ENTRY
architecture-latency · raphael2010-music-plus-one
- Citation
- raphael2010-music-plus-one
- Claim ID
- architecture-latency
- Assertion
- Music Plus One (also called the Informatics Philharmonic, named after Music Minus One play-along records) has three modules: Listen, an HMM score follower; Predict, a Kalman-filter-like Gaussian model of timing; and Play, which phase-vocodes an orchestra-only recording. Because detection latency is usually 30–90 ms, a purely responsive system cannot work, so the system continually predicts and revises the timing of accompaniment notes. The score follower waits until confident a note has begun, since reporting early can make the accompanist arrive before the soloist.
- Quote
Our system is known interchangeably as the "Informatics Philharmonic," or "Music Plus One" (MPO), due to its alleged improvement on the play-along accompaniment records from Music Minus One that inspired our work. [...] Our system is composed of three sub-tasks called "Listen," "Predict," and "Play." [...] our detection latency is usually in the 30-90 ms. range, enough to prove fatal if the accompaniment is consistently behind by this much. For this reason we model the timing of our accompaniment on the human musician, continually predicting future evolution, while modifying these predictions as more information becomes available. [...] Predict, is a Gaussian graphical model quite close to a Kalman Filter [...]. The Play module uses phase-vocoding [...] to construct the orchestral audio output using audio from an accompaniment-only recording. [...] One of the worst things a score follower can do is report events before they have occurred. [...] the musical result often involves the accompanist arriving at a point of coincidence before the soloist does.
- Quote language
- en
- Locator
- section: 1–3.2
Available in