Hierarchical evaluation improvements - Presidio Evaluator v-next - #172

Merged

omri374 merged 148 commits into

hirearchial_evaluation_improvements

Jun 30, 2026

Commits on Dec 16, 2025

added initial gliner notebook
omri374
committed
0ba26df

Commits on Jan 1, 2026

added approaches for entity mapping
omri374
committed
c88e799

Commits on Jan 6, 2026

updated design doc
omri374
committed
f14cd07

Commits on Feb 28, 2026

entity mapping
omri374
committed
5da5de1
Delete .github/agents/Research.agent.md
omri374
authored
b4b3e3c
Delete docs/entity_mapping_analysis.md
omri374
authored
b8add90
Modify ner group dependencies in pyproject.toml
omri374
authored
511fb0f
Update presidio_evaluator/models/base_model.py

omri374
and
Copilot
authored
1e01a9f
updates to PR
omri374
committed
7cd3aab
Merge branch 'omri/enhanced_mapping' of https://github.com/microsoft/presidio-research into omri/enhanced_mapping
omri374
committed
8b023f2
ruff
omri374
committed
8ef4dc7

Commits on Mar 1, 2026

updates to notebooks and PR comments
omri374
committed
bf47a51
Remove deprecated entity_mapping check from model
omri374
authored
fb989b9
added changelog
omri374
committed
f867938
changed iou_threshold
omri374
committed
d40a4fd
changed iou to 0.75
omri374
committed
f057b78
removed dead code on mapper.py
omri374
committed
27eb133
removed dead code from interactive.py
omri374
committed
1601dc1
updating flair test
omri374
committed
496d40c

Commits on Mar 2, 2026

deprecating old models and removing tests
omri374
committed
58043eb
forgotten comma
omri374
committed
b2b4d88
bugfix
omri374
committed
ea98c02
Update base_evaluator.py
omri374
authored
c085704

Commits on Mar 20, 2026

feat: [US-001] - CanonicalMapper core implementation

omri374
and
Copilot
committed
19fcfea
feat: [US-002,US-003,US-004,US-005,US-006] - Complete CanonicalMapper implementation

omri374
and
Copilot
committed
dfb146d
chore: mark all stories complete and add progress log

omri374
and
Copilot
committed
d58f0f7
chore: update progress log with full implementation details

omri374
and
Copilot
committed
9490eb3
chore: remove stale test_entity_mapping.py (tested old SemanticEntityMapper API)

omri374
and
Copilot
committed
4caccdf

Commits on Mar 21, 2026

Initial plan
Copilot
committed
fcfec9d
Add ADR-001: Simplified Evaluation Pipeline Using DataFrame as Clean Interface

Copilot
and
omri374
committed
95f230c
Simplify evaluation pipeline and update model prediction
omri374
authored
b59cded
docs: add ADR-002 for entity mapping via CanonicalMapper

Copilot
and
omri374
committed
1df517c
docs: revise ADR-002 per review feedback

Copilot
and
omri374
committed
3e900aa
Add hierarchical entity mapping dictionary
omri374
authored
6ca1cac
Update entity mapping details in ADR-002
omri374
authored
e1b5884
Refactor CanonicalMapper usage examples
omri374
authored
ec19dc7

Commits on Mar 22, 2026

Update docs/adr/ADR-001-simplified-evaluation-pipeline.md

omri374
and
Copilot
authored
87a9d8e
docs: move DOMAIN, WEB, URL, WEBSITE to NETWORK_IDENTIFIER

Copilot
and
omri374
committed
cddbdda
Update docs/adr/ADR-001-simplified-evaluation-pipeline.md

omri374
and
Copilot
authored
e0daa3c
docs: update CanonicalMapper API and map_entities interface per review feedback

Copilot
and
omri374
committed
d7d95e9
docs: remove HOSPITAL alias from ORGANIZATION.COMPANY

Copilot
and
omri374
committed
6d6866f
Apply suggestions from code review

omri374
and
Copilot
authored
151acad
docs: remove MRN alias from PHI.PATIENT_ID

Copilot
and
omri374
committed
44adbc0
Add example mappings for entity labels
omri374
authored
a56c6ac

Commits on Mar 24, 2026

updates to canonical mapper
omri374
committed
a34a441
Enhance ADR-001 with additional evaluation details
omri374
authored
c74e418
Enhance evaluation pipeline with hierarchy scoring
omri374
authored
5fdf500
Update ADR-001-simplified-evaluation-pipeline.md
omri374
authored
b400004
Modify prediction method to return DataFrame
omri374
authored
7c600b6
Merge remote-tracking branch 'origin/copilot/add-simplified-evaluation-pipeline' into ralph/canonical-mapper
omri374
committed
aac1880
Enhance ADR-002 with input format and usage updates
omri374
authored
191f330
Merge remote-tracking branch 'origin/copilot/add-simplified-evaluation-pipeline' into ralph/canonical-mapper
omri374
committed
6bb51f7
Enhance ADR-001 with multi-hierarchical evaluation example
omri374
authored
6725db7
Merge remote-tracking branch 'origin/copilot/add-simplified-evaluation-pipeline' into ralph/canonical-mapper
omri374
committed
f8d6f01
feat: [US-001] - Add predict_dataset() to BaseModel
omri374
committed
6012aff
chore: mark US-001 as passing, update progress log
omri374
committed
3ae9a1b
feat: [US-005] - Strip entity mapping from evaluation package
omri374
committed
3165f4a
chore: mark US-005 as passing, update progress log
omri374
committed
613aa46
feat: [US-002] - Add get_mapped_results_dataframe() to CanonicalMapper
omri374
committed
4392d3f
chore: mark US-002 as passing, update progress log
omri374
committed
34ce7b2
feat: [US-006] - Add calculate_score_on_df() to TokenEvaluator, integration test
omri374
committed
8aa9634
chore: mark US-006 as passing, update progress log
omri374
committed
a332a08
feat: [US-003] - Add get_mapping(mode=html/text) to CanonicalMapper
omri374
committed
0808679
chore: mark US-003 as passing, gitignore temp test file
omri374
committed
75a5f64
feat: [US-004] - Remove from_dataset() classmethod from CanonicalMapper
omri374
committed
33a1299
chore: mark US-003, US-004 as passing, update progress
omri374
committed
e50e5ce
feat: [US-007] - Deprecate evaluate_all() with hard stop
omri374
committed
601fc18
chore: remove temp files
omri374
committed
fd91fce
chore: US-007 passing - update prd and progress
omri374
committed
0bc911f
feat: [US-008] - Soft deprecate get_results_dataframe() with DeprecationWarning
omri374
committed
3cf7988
chore: US-008 passing - update prd and progress
omri374
committed
f3d8b07
feat: [US-010] - Remove non-Presidio model wrappers
omri374
committed
6dfe5a7
chore: US-010 passing - update prd and progress
omri374
committed
c37d88f
feat: [US-013] - Migrate to uv, update dependency versions
omri374
committed
2ad5fa0
chore: US-013 passing - update prd and progress
omri374
committed
8128ee0
feat: [US-015] - Add ruff linter and formatter configuration
omri374
committed
429d77c
chore: US-015 passing - update prd and progress
omri374
committed
90bd50b
feat: [US-016] - Add pre-commit hooks
omri374
committed
bcd4915
chore: US-016 passing - update prd and progress
omri374
committed
fdf9fdc
feat: [US-017] - Reorganize tests into topic-based directories
omri374
committed
a4fc0c7
chore: US-017 passing - update prd and progress
omri374
committed
589c0de
feat: [US-011] - Update evaluation notebooks to the new pipeline
omri374
committed
6f455fc
feat: [US-012] - Replace obsolete model notebooks with deprecation notice
omri374
committed
58db30f
feat: [US-018] - Write migration guide and changelog
omri374
committed
cee532b
chore: US-011, US-012, US-018 passing - update prd and progress
omri374
committed
e37e40c
chore: fix trailing commas in prd.json - all 16 stories complete
omri374
committed
69e5eab

Commits on Mar 25, 2026

Commits on Mar 26, 2026

Commits on Mar 28, 2026

pr updates
omri374
committed
8af177e

Commits on Apr 28, 2026

Commits on Apr 29, 2026

Commits on May 1, 2026

feat: [US-001] - Define MappedResults and level helpers
omri374
committed
771f033
feat: [US-002] - Update IssueType taxonomy
omri374
committed
0a078ce
feat: [US-003] - Remove projection phase, emit MappedResults
omri374
committed
a68d3e4
feat: [US-004] - Add min_severity to analyze()
omri374
committed
f39d49b
feat: [US-005] - Add get_mapping() method
omri374
committed
2393901
feat: [US-006] - Update HTML audit table for new issue taxonomy
omri374
committed
c6e0537
feat: [US-007] - Update calculate_hierarchical_scores() to accept MappedResults
omri374
committed
dadc8bc
feat: [US-008, US-009, US-010] - Update Notebooks 4, 5, 6 for single-phase CanonicalMapper
omri374
committed
d9945bf
docs: add AGENTS.md with codebase patterns
omri374
committed
5b1c2b0

Commits on May 3, 2026

Commits on May 8, 2026

fix: COLLISION_CROSS_BRANCH 3-case logic — suppress when pred has same-branch hits
omri374
committed
3f59bc5

Commits on May 12, 2026

refining the noteboks and html rendering
omri374
committed
3b13779

Commits on May 24, 2026

fix: correct wheel target configuration in pyproject.toml
RonShakutai
committed
53e08d1

Commits on Jun 29, 2026

Commits on Jun 30, 2026

Update README.md
omri374
authored
1366b5b
Add Python 3.10 to CI workflow matrix
omri374
authored
fb436e3