components · dannenberg2006-score-alignment-accompaniment

Most computer accompaniment systems are organized roughly along the lines of Figure 3, which shows four fairly independent components: audio feature extraction, score following, accompaniment control, and music synthesis. [...] The fourth, music synthesis, generates the actual accompaniment sound, either by means of a note-based sound synthesizer or by resynthesizing prerecorded audio on-the-fly. [...] An accompaniment system, (or person), that tries to achieve synchrony by waiting to hear a note, and then responding, will always be late, since all musical events are detected with latency. A better approach coordinates parts by extrapolating the future evolution based on the detected note onsets, as well as other information. [...] Early accompaniment systems used hand-coded rules to guide this extrapolation. [...] More recently, belief networks address the challenges of automatic learning and extrapolation from incomplete information.