CITATION — REFERENCE ENTRY
Towards score following in sheet music images — Proceedings of the 17th International Society for Music Information Retrieval Conference
- Key
- dorfer2016-sheet-music-score-following
- Authors
- Dorfer, Matthias; Arzt, Andreas; Widmer, Gerhard
- Issued
- 2016
- Type
- paper-conference
- Container
- Proceedings of the 17th International Society for Music Information Retrieval Conference
Raw CSL JSON
{
"URL": "https://arxiv.org/abs/1612.05050",
"type": "paper-conference",
"title": "Towards score following in sheet music images",
"author": [
{
"given": "Matthias",
"family": "Dorfer"
},
{
"given": "Andreas",
"family": "Arzt"
},
{
"given": "Gerhard",
"family": "Widmer"
}
],
"issued": {
"date-parts": [
[
2016
]
]
},
"event-place": "New York, NY",
"container-title": "Proceedings of the 17th International Society for Music Information Retrieval Conference"
}
Claims
-
Score following systems have depended on a symbolic, computer-readable score such as MusicXML or MIDI, created manually or by optical music recognition, which remains unreliable for complex music. Dorfer, Arzt, and Widmer proposed an end-to-end multi-modal convolutional network that takes images of sheet music and audio spectrograms and predicts where in a staff a short audio snippet occurs; their proof of concept was limited to monophonic piano music and single staff lines.
"So far all approaches to this task depend on a symbolic, computer-readable representation of the sheet music, such as MusicXML or MIDI [...]. This representation is created either manually [...] or automatically via optical music recognition software. Unfortunately automatic methods are still highly unreliable and thus of limited use, especially for more complex music like orchestral scores. [...] It consists of an end-to-end multi-modal convolutional neural network that takes as input images of sheet music and spectrograms of the respective audio snippets. [...] the system is fed only a single staff line at a time (not a full page of score). We restrict ourselves to monophonic music, and to the piano."
Available in