sheet-images · dorfer2016-sheet-music-score-following

So far all approaches to this task depend on a symbolic, computer-readable representation of the sheet music, such as MusicXML or MIDI [...]. This representation is created either manually [...] or automatically via optical music recognition software. Unfortunately automatic methods are still highly unreliable and thus of limited use, especially for more complex music like orchestral scores. [...] It consists of an end-to-end multi-modal convolutional neural network that takes as input images of sheet music and spectrograms of the respective audio snippets. [...] the system is fed only a single staff line at a time (not a full page of score). We restrict ourselves to monophonic music, and to the piano.