SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2212.00973 · 2022

A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling

arXiv · PDF · Open in the Atlas

Code that ran

4 of 4 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 2 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 2 failures of our instrument; 0 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2212.00973.json · badge: /api/ran/2212.00973.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
guozixunnicolas/fundamentalmusicembedding canonical (classifier label)
classifier basis: classifier_2025
4 ran · 0 no recorded run
FunctionStatusWhere it lives
l2_norm Ran
ran, honoured the contract we drafted
guozixunnicolas/fundamentalmusicembedding/model/FME_music_positional_encoding.py
pointer only (licence: NONE) · get_code("0fc5d9cde41807d8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, guozixunnicolas/fundamentalmusicembedding when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

rounding Ran
ran, honoured the contract we drafted
guozixunnicolas/fundamentalmusicembedding/model/FME_music_positional_encoding.py
pointer only (licence: NONE) · get_code("e561180dff3faff6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, guozixunnicolas/fundamentalmusicembedding when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

scaled_dot_product Ran
ran; our contract draft was wrong, not the code
guozixunnicolas/fundamentalmusicembedding/model/layers.py
pointer only (licence: NONE) · get_code("eabaf7cdb398a215")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, guozixunnicolas/fundamentalmusicembedding when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

sequence_mask Ran
ran; our contract draft was wrong, not the code
guozixunnicolas/fundamentalmusicembedding/model/layers.py
pointer only (licence: NONE) · get_code("88bf809d1bc9db4c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, guozixunnicolas/fundamentalmusicembedding when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

Also present in other papers' code

Of 4 samples lifted from this paper's linked repositories, 4 carry a function identity and 0 do not. Of the 4 distinct functions with an identity, 3 are also present in other papers whose code we hold (1 with at least one paper dated earlier, 0 the same month, 3 later) and 1 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
sequence_mask 7 other papers
5 dated earlier, 2 later
2006.04558 (2020-06)
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
2106.06103 (2021-06)
Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
2109.15166 (2021-09)
PortaSpeech: Portable and High-Quality Generative Text-to-Speech
and 4 more not named here
l2_norm 2 other papers
2 later
2311.08355 (2023-11)
Mustango: Toward Controllable Text-to-Music Generation
2024.naacl-long.459 (2024 (year only))
Mustango: Toward Controllable Text-to-Music Generation
rounding 2 other papers
2 later
2311.08355 (2023-11)
Mustango: Toward Controllable Text-to-Music Generation
2024.naacl-long.459 (2024 (year only))
Mustango: Toward Controllable Text-to-Music Generation

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Following the success of the transformer architecture in the natural language domain, transformer-like architectures have been widely applied to the domain of symbolic music recently. Symbolic music and text, however, are two different modalities. Symbolic music contains multiple attributes, both absolute attributes (e.g., pitch) and relative attributes (e.g., pitch interval). These relative attributes shape human perception of musical motifs. These important relative attributes, however, are mostly ignored in existing symbolic music modeling methods with the main reason being the lack of a musically-meaningful embedding space where both the absolute and relative embeddings of the symbolic music tokens can be efficiently represented. In this paper, we propose the Fundamental Music Embedding (FME) for symbolic music based on a bias-adjusted sinusoidal encoding within which both the absolute and the relative attributes can be embedded and the fundamental musical properties (e.g., translational invariance) are explicitly preserved. Taking advantage of the proposed FME, we further propose a novel attention mechanism based on the relative index, pitch and onset embeddings (RIPO attention) such that the musical domain knowledge can be fully utilized for symbolic music modeling. Experiment results show that our proposed model: RIPO transformer which utilizes FME and RIPO attention outperforms the state-of-the-art transformers (i.e., music transformer, linear transformer) in a melody completion task. Moreover, using the RIPO transformer in a downstream music generation task, we notice that the notorious degeneration phenomenon no longer exists and the music generated by the RIPO transformer outperforms the music generated by state-of-the-art transformer models in both subjective and objective evaluations.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2212.00973")
get_code_for_paper("2212.00973")
have("2212.00973")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2212.00973.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2212.00973.svg)](https://syntology.ai/paper/2212.00973)

Connect an agent — have() is free.