Skip to content

feat(data): add near-duplicate gloss frame detector (Fixes #246) [FaaFyfxR9WAQrL7FcAgEHJvztd8cVMxvjHRS55rw1nwH] - #576

Open
waterWang wants to merge 1 commit into
mergeos-bounties:masterfrom
waterWang:fix/near-dup-detector-246
Open

feat(data): add near-duplicate gloss frame detector (Fixes #246) [FaaFyfxR9WAQrL7FcAgEHJvztd8cVMxvjHRS55rw1nwH]#576
waterWang wants to merge 1 commit into
mergeos-bounties:masterfrom
waterWang:fix/near-dup-detector-246

Conversation

@waterWang

Copy link
Copy Markdown

Implements the batch near-duplicate gloss frame detector requested in #246.

Strategy: bucket samples by (frame_count, feature_dim) for fast filtering, then exact time-aligned landmark distance per candidate pair, plus cross-bucket neighbour scan (frame count +/- 1) for offset clones.

Changes:

  • src/loru/data/near_dup.py: detector (find_near_duplicates, write_report)
  • src/loru/cli.py: 'loru data near-dup' CLI with table output + optional JSON report
  • tests/test_near_dup.py: 9 new tests

Verification: 15 passed (9 new + 6 pre-existing compare/samples tests) in 0.37s.

Fixes #246

…unties#246)

Add a batch detector for near-duplicate gloss frame sequences.
- Bucket samples by (frame_count, feature_dim) for fast filtering
- Exact time-aligned landmark distance per candidate pair
- New 'loru data near-dup' CLI with table output and --out JSON report
- Tests: core detector + CLI, 9 new passing tests

[FaaFyfxR9WAQrL7FcAgEHJvztd8cVMxvjHRS55rw1nwH]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[50 MRG] Tool: detect near-duplicate gloss frames (hash/offset report)

1 participant