Skip to content

Fixed staff detection errors#122

Draft
liebharc wants to merge 5 commits into
mainfrom
feature/staff-detection
Draft

Fixed staff detection errors#122
liebharc wants to merge 5 commits into
mainfrom
feature/staff-detection

Conversation

@liebharc

@liebharc liebharc commented Jul 15, 2026

Copy link
Copy Markdown
Owner

Fixes some staff detection problems which came up in the smb benchmark.

Disclaimer: Claude code changes which mostly accumulated while I was running it in the background, still have to review this myself

Performance changes

# Start

System level: 5.5 diffs, SER: 4.1%
Polish scores 24.30%
SMB 23.4%

# Staff parsing

System level: 5.6 diffs, SER: 4.7%
Polish scores 21.40%, 42.63%
SMB 19.98%

# Fix NED scoring

Polish scores 19.98%
SMB 16.60%

# Realized that polish ground truth is missing articulations

Polish scores 17.24% 40.23%

It turns out that SMB is also unreliable. For some pieces it omits staccato information which penalizes any model which correctly detect them. I decided to just keep it like that as it's likely not meaningful to spend the time on that.

@liebharc
liebharc force-pushed the feature/staff-detection branch from f5f46d4 to f68f8a3 Compare July 15, 2026 16:13
@weixlu

weixlu commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Wow, this improvement looks significant!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants