CS Paper Radar

Computational Features for Symbolic Melody Analysis

David M. Whyatt, Peter M. C. Harrison

cs.SD ·submitted 2026-08-19 16:01 UTC · v1
code/data

Abstract

This paper addresses the general problem of extracting music-theoretic and psychological features from symbolically encoded melodies. We review existing melodic feature extraction toolboxes, enumerate their features, and organise them into a common taxonomy. We then describe a new software library that provides implementations of all of these features in a straightforward Python package. We then demonstrate the combined feature set on the Essen Folksong Collection, using the dataset to produce a series of style classification models. These models help us answer key questions about the interpretability and dimensionality of the feature set. Our results show excellent classification accuracy using the full feature set, and promising performance for an eight-dimensional factor-analytic solution that improves the interpretability of the classifier. We distribute our new toolbox as an open-source Python package, $\mathtt{melody-features}$, which can easily be used in various applications within music analysis, music psychology, and music information retrieval.

Closest papers

Nearest neighbours by meaning across the whole index.

The MPB Corpus: A Dataset of Melody, Rhythm, Harmony, and Melody-Harmony Relationships in Brazilian Popular Music

cs.SD cs.DLcs.IReess.AS ·2026-08-14 ·Carlos de L. Almada, Hugo T. de Carvalho, Felipe D. Martins
published similarity 0.71
Abstract · 22 pages, 13 figures

PLEASE CHECK AND REFER TO THE PUBLISHED VERSION OF THIS PAPER ON https://doi.org/10.5334/tismir.357 This paper presents the MPB Corpus, a dataset of Brazilian Popular Music (Musica Popular Brasileira, MPB) comprising derived symbolic annotations for 500 pieces across four musical parameters -- melodic contour, melodic rhythm, harmony, and the melody-harmony relationship -- making it the most comprehensive dataset to date for computational musicology of Brazilian music. It is released under a CC-BY-4.0 license in an open, machine-readable tabular format, with documentation and reproducible analysis code. Because the annotations were derived from copyrighted musical scores, the corpus contains no audio recordings or score-level representations such as MIDI or MusicXML; it nonetheless provides a reusable resource for MIR research on a culturally significant repertoire that remains underrepresented in existing datasets. To support the encoding process, we introduce analytical models for capturing rhythmic and melodic information, along with tailored visualizations and summary metrics. Finally, we present a brief exploratory analysis illustrating the dataset's potential for formulating and addressing musicological questions about the genre.

0.40

TASTE: Taxonomy-Aware Symbolic Piano Generation from Textual Description

cs.SD ·2026-10-11 ·Mingyang Yao, Jingyue Huang, Ke Chen, Taylor Berg-Kirkpatrick, Shlomo Dubnov
hot direction similarity 0.65
Abstract · Under Reivew

Text-conditioned symbolic music generation has attracted growing interest with the development of generative models. Yet two questions remain underexplored: what aspects of music the conditioning text should describe, and how the corresponding data should be collected and trained to improve controllability and text-music alignment. We address these challenges with TASTE, a taxonomy-aware framework for symbolic music generation with a main focus on piano pieces. First, we introduce a taxonomy of musical elements that specifies how a piece can be captured through textual description in a musically grounded way. The taxonomy comprises a set of metadata tags (genre, emotion, section plan, etc.) together with a free-form description of music imagery. This structure decomposes textual input to match the generation goal more coherently and precisely. Second, we build a data pipeline for collecting, annotating, and retrieving public symbolic piano resources, yielding a corpus of 432K MIDI files labeled at multiple levels of granularity. Finally, we design a staged training procedure that leverages this multi-granularity data across two model families: an autoregressive model and a non-autoregressive diffusion model. Both objective and subjective evaluations show that our models achieve superior musical-element control, text-description alignment, and overall music quality. We will release the full pipeline, all annotated datasets, and the model checkpoints.

0.20

Automatic Transcription of Microtonal Free-Rhythm Vocal Music: A Case Study in Iranian Classical Music

cs.SD ·2026-08-17 ·Sepideh Shafiei, Shapour Hakam, Harsh Dange, Joel Rodriguez Caraballo
similarity 0.65
Abstract

This paper introduces a computational workflow for automatically transcribing microtonal, free-rhythm vocal music, with Iranian classical music as a case study. Our approach is based on performances by the renowned vocalist Karimi and ground truth transcriptions by the prominent ethnomusicologist Masoudieh [14], which were subsequently incorporated into the IRMA Audio-MIDI dataset [20]. To accurately extract melodies, we employ pitch histograms in conjunction with Dynamic Time Warping (DTW). Additionally, we introduce specialized musical notations to capture the intricate ornamentations characteristic of the genre, with particular emphasis on the vocal technique tahrir. The transcription process is implemented in Python using the music21 library for symbolic music representation [5]. This study not only advances the field of computational ethnomusicology but also highlights the potential of computational methods in preserving and analyzing complex musical traditions. The transcription system also generates a combined visualization of the audio pitch contour and the DTW-aligned MIDI representation, enabling users to inspect the correspondence between the performance and the generated transcription. A companion visual editor supports expert-in-the-loop correction of the resulting notation.

0.18

MusPyExpress: Extending MusPy with Enhanced Expression Text Support

cs.SD cs.LGeess.AS ·2026-08-21 ·Phillip Long, Hao-Wen Dong, Julian McAuley, Zachary Novack
published similarity 0.65
Abstract · Accepted at NeurIPS 2025 Workshop on AI for Music: Where Creativity Meets Computation; 10 pages, 6 figures

Current work in modeling symbolic music primarily relies on representations extracted from MIDI-like data. While such formats allow for modeling symbolic music as sequences of notes, they omit the large space of symbolic annotations common in western sheet music broadly known as expression text, such as tempo or dynamics, which specify time- and velocity-dependent controls on the musical composition and performance. To alleviate this gap, we present MusPyExpress, an extension to the popular symbolic music processing library MusPy that enables the extraction of expression text along with symbolic music for downstream modeling. Utilizing this extension, we parse the PDMX dataset to illustrate the wealth of expression text available in MusicXML datasets. Additionally, we introduce multiple generative tasks, including joint expression-note generation, expression-conditioned music generation, and expression tagging, that take advantage of this additional notational information.

0.46

From Individual Songs to Music Corpora: Evaluating Explainable Harmonic Decision-Making on HookTheory

cs.SD cs.AIeess.AS ·2026-10-14 ·Josef Pavlíček, Martin Pelikán
similarity 0.62
Abstract · 10 pages, 3 Figures, 2 tables, source codes in git

Automatic melody harmonization is often evaluated through individual compositions or data-driven corpus models. This study examines whether an explainable harmonic decision model developed for individual songs can be applied to independently collected human annotations without changing its rules. We evaluate a frozen Explainable Melody Harmonizer (EMH) on selected HookTheory excerpts containing aligned melody and chord annotations. EMH generates chord sequences from melody alone using explicit criteria for melodic compatibility, harmonic function, persistence, cadence, meter-aware segmentation, and Viterbi-like optimization. Human chords are withheld during generation and used only for post-hoc comparison. Nineteen excerpts yielded 439 evaluable harmonic segments. Exact chord agreement reached 20.50%, chord-root agreement 31.66%, and harmonic-function agreement 47.62%, with functions assessed relative to the key inferred by EMH. Decision-level analysis identified 203 segments (46.24%) where the human chord lay outside the model's candidate vocabulary and 146 (33.26%) where it was available but not selected. These findings distinguish representational limitations from differences in chord selection without treating the human reference as the only musically valid solution. The study demonstrates a reproducible, interpretable approach to corpus-based evaluation of harmonic decision-making.

0.14

Learning Jazz Pianist Style with Cross-Attention Conditioning

cs.SD cs.LGeess.AS ·2026-10-02 ·Drew Edwards, Akira Maezawa, Simon Dixon
published similarity 0.62
Abstract · 8 pages, 6 figures. Accepted at ISMIR 2026. Audio demos, code and checkpoints: https://almostimplemented.github.io/jazz-pianist-style

Jazz pianists develop distinctive traits that experienced listeners can often identify within seconds, yet the features underlying this recognition resist formal description. We study jazz pianist style through the lens of a pretrained symbolic music transformer, showing that its learned representations already encode pianist identity well enough for highly accurate classification across two benchmarks. We then augment the transformer with cross-attention over learned pianist identity embeddings, enabling it to generate music conditioned on a specific artist's style. Two evaluation protocols confirm that the generator captures meaningful stylistic structure: a sliding-window classifier consistently attributes conditioned continuations to the correct artist, far above unconditioned baselines; and a classifier trained entirely on synthetic generations identifies real pianists across 12 classes with 87% chunk-level and 95% song-level accuracy. Finally, we repurpose the classifier to locate the most characteristic moments within a performance, surfacing the specific musical gestures that distinguish each pianist's voice.

0.39

ScorePrompts: Natural-Language Exploration of Symbolic Music Scores through Analysis

cs.SD cs.CLeess.AS ·2026-09-09 ·Emmanouil Karystinaios, Gerhard Widmer
published similarity 0.62
Abstract · Accepted as a Late Breaking Demo (LBD) at the International Society of Music Information Retrieval conference (ISMIR) 2026

We present ScorePrompts, an interactive system in which users upload a score, receive natural-language descriptions of its musical structure, ask questions about specific passages, and inspect the corresponding analysis results in staff notation. Specialist MIR components first estimate harmony, tonality, cadences, formal boundaries, texture, and note-level roles, organizing their outputs at note, beat, measure, and piece levels. A schema-constrained language model converts these results into descriptions rather than inferring musical structure directly from raw MusicXML. For questions such as "What changes in measures 14-18?", a deterministic router selects the relevant measures and analytical levels and returns a concise response together with the underlying results and caveats. Verovio renders the score and links the returned information to cited measures and note-level attributes. The interface also exposes intermediate tables and disagreements between analytical levels. ScorePrompts is intended for exploratory score analysis and explanation, not score editing. The demo shows how existing analysis models, constrained language generation, Q&A retrieval, and notation-based visualization can provide natural-language access to symbolic music analysis while keeping intermediate results inspectable.

0.27

FaiSonic MMD: A popular music dataset with temporally aligned multidimensional annotations for multitask music analysis

cs.SD ·2026-11-10 ·Tieyao Zhang, Yuke Liu, Jiaxing Yu, Xinda Wu, Genfang Chen
datasetcode/data similarity 0.62
Abstract · 8 pages, 3 figures, 2 tables. Dataset and code available at https://github.com/Kreuzter0421/FaiSonic-MMD

Temporal analysis in music information retrieval concerns the positions of musical events and structures within recordings. Joint modeling has demonstrated the value of combining musical descriptions, but existing resources differ in joint coverage and expert verification across dimensions, constraining detailed joint supervision and the analysis of relationships on the same recordings. To support multitask modeling and the study of relationships among musical dimensions in popular music, we introduce FaiSonic Multidimensional Music Dataset (FaiSonic MMD), containing 500 songs totaling approximately 32.86 hours, comprising 250 Chinese-language and 250 English-language songs. Professional musicians annotate phrases, sections, chords, and rhythm in real recordings, followed by independent review. Events and intervals across dimensions share a recording-based time reference while retaining their respective musical granularity and boundaries, allowing direct comparison across musical descriptions. We describe the annotations, collection procedure, and statistics, and establish a comprehensive multitask baseline for phrase boundaries, section boundaries, section functions, chords, beats, and downbeats. We report reference performance for all prediction targets. FaiSonic MMD provides shared expert annotations and accompanying benchmarks for temporal music analysis.

0.23