CITATION — REFERENCE ENTRY
mir_eval: A Transparent Implementation of Common MIR Metrics — Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR 2014)
- Key
- raffel2014-mir-eval
- Authors
- Raffel, Colin; McFee, Brian; Humphrey, Eric J.; Salamon, Justin; Nieto, Oriol; Liang, Dawen; Ellis, Daniel P. W.
- Issued
- 2014
- Type
- paper-conference
- Container
- Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR 2014)
- Pages
- 367-372
Raw CSL JSON
{
"DOI": "10.5281/zenodo.1416528",
"URL": "https://archives.ismir.net/ismir2014/paper/000320.pdf",
"page": "367-372",
"type": "paper-conference",
"title": "mir_eval: A Transparent Implementation of Common MIR Metrics",
"author": [
{
"given": "Colin",
"family": "Raffel"
},
{
"given": "Brian",
"family": "McFee"
},
{
"given": "Eric J.",
"family": "Humphrey"
},
{
"given": "Justin",
"family": "Salamon"
},
{
"given": "Oriol",
"family": "Nieto"
},
{
"given": "Dawen",
"family": "Liang"
},
{
"given": "Daniel P. W.",
"family": "Ellis"
}
],
"issued": {
"date-parts": [
[
2014
]
]
},
"event-place": "Taipei, Taiwan",
"container-title": "Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR 2014)"
}
Claims
-
mir_eval maps a chord label such as G:maj(6)/5 to a root, a set of active semitones, and a bass interval.
"the chord label G:maj(6)/5 is mapped to three pieces of information: the root ("G"), the root-invariant active semitones as determined by the quality shorthand ("maj") and scale degrees ("6"), and the bass interval ("5")."
-
Evaluation methodology for chord estimation remains under discussion because of issues with vocabularies, comparison semantics and other lexicographical challenges.
"Despite being one of the oldest MIREX tasks, evaluation methodology and metrics for automatic chord estimation is an ongoing topic of discussion, due to issues with vocabularies, comparison semantics, and other lexicographical challenges unique to the task"
-
Comparisons are weighted by interval duration within a track, and the cumulative duration-weighted score over a set of files is called weighted chord symbol recall.
"The cumulative score, referred to as weighted chord symbol recall, is tallied over a set audio files by discrete summation, where the importance of each score is weighted by the duration of each annotation"
Available in