Skip to content

refactor(importer): revamp importer module#1092

Merged
adamtagscherer merged 5 commits intomainfrom
refactor/importer
Mar 25, 2026
Merged

refactor(importer): revamp importer module#1092
adamtagscherer merged 5 commits intomainfrom
refactor/importer

Conversation

@adamtagscherer
Copy link
Copy Markdown
Member

@adamtagscherer adamtagscherer commented Mar 23, 2026 •
edited
Loading

changes in this PR:

  • separated the MCP -> OASF Record translation step from enrichment step
  • config cleanup: added enricher config, config value validation logic moved to config package
  • component initialization moved to constructors
  • package layout cleanup, removed the pipeline step and moved the logic to the importer
  • the fetcher produce Anthropic Go struct instead of any immediately instead of passing any around
  • scanner-enabled flag usage

@github-actions github-actions bot added the size/L Denotes a PR that changes 1000-1999 lines label Mar 23, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 23, 2026 •
edited
Loading

The latest Buf updates on your PR. Results from workflow Buf CI / verify-proto (pull_request).

BuildFormatLintBreakingUpdated (UTC)
✅ passed⏩ skipped⏩ skipped✅ passedMar 25, 2026, 8:49 AM

@adamtagscherer adamtagscherer linked an issue Mar 23, 2026 that may be closed by this pull request
[Epic] Importer revamp #989
Open
@adamtagscherer adamtagscherer added this to the DIR v1.2 milestone Mar 23, 2026
@adamtagscherer adamtagscherer self-assigned this Mar 23, 2026
@github-actions github-actions bot added size/XL Denotes a PR that changes 2000+ lines and removed size/L Denotes a PR that changes 1000-1999 lines labels Mar 24, 2026
@adamtagscherer adamtagscherer changed the title refactor: importer refactor(importer): revamp importer module Mar 24, 2026
@adamtagscherer adamtagscherer marked this pull request as ready for review March 24, 2026 08:12
@adamtagscherer adamtagscherer requested a review from a team as a code owner March 24, 2026 08:12
@adamtagscherer adamtagscherer force-pushed the refactor/importer branch 4 times, most recently from a9ea0fb to c87afbd Compare March 24, 2026 17:07
@adamtagscherer
refactor: importer
207e0aa 
Signed-off-by: Tagscherer Ádám <adam.tagscherer@gmail.com>
@adamtagscherer
refactor: importer
70d22c6 
Signed-off-by: Tagscherer Ádám <adam.tagscherer@gmail.com>
@adamtagscherer
refactor: importer
daf4172 
Signed-off-by: Tagscherer Ádám <adam.tagscherer@gmail.com>
@adamtagscherer
refactor: importer
234a099 
Signed-off-by: Tagscherer Ádám <adam.tagscherer@gmail.com>
@adamtagscherer
refactor: importer
8b8f1a7 
Signed-off-by: Tagscherer Ádám <adam.tagscherer@gmail.com>
akijakya
akijakya approved these changes Mar 25, 2026
View reviewed changes
Copy link
Copy Markdown
Member

@akijakya akijakya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 🚀

@adamtagscherer adamtagscherer merged commit afff57e into main Mar 25, 2026
37 of 48 checks passed
@adamtagscherer adamtagscherer deleted the refactor/importer branch March 25, 2026 13:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@akijakya akijakya akijakya approved these changes

Assignees

@adamtagscherer adamtagscherer

Labels

size/XL Denotes a PR that changes 2000+ lines

Projects

None yet

Milestone

DIR v1.2

Development

Successfully merging this pull request may close these issues.

[Epic] Importer revamp

2 participants

@adamtagscherer @akijakya