Skip to content

Agent auto discovery conflicts with explicit task type mapping#6464

Merged
pingsutw merged 6 commits into
flyteorg:masterfrom
popojk:Agent-auto-discovery-conflicts-with-explicit-task-type-mapping
May 28, 2025
Merged

Agent auto discovery conflicts with explicit task type mapping#6464
pingsutw merged 6 commits into
flyteorg:masterfrom
popojk:Agent-auto-discovery-conflicts-with-explicit-task-type-mapping

Conversation

@popojk

@popojk popojk commented May 23, 2025

Copy link
Copy Markdown
Contributor

Tracking issue

Closes #6349

Why are the changes needed?

The current propeller agent/connector task_type auto-discovery in combination with ignoring the explicit mapping will cause problems while 2 agent/connector deployments has different config but has the same support task type. On the other hand, it also complicates agent development. Developers have to be mindful of which agents are installed on the image and cannot simply rely on the mapping in the configuration.

What changes were proposed in this pull request?

Respect the explicit task_type mapping over the implicit (auto-discovery) mapping. The agent/connector registry will always inline with the agentForTaskTypes settings in the config file.

How was this patch tested?

The unit test in this PR can test the expected behavior.

Labels

Please add one or more of the following labels to categorize your PR:

  • changed: For changes in existing functionality.

Check all the applicable boxes

  • All new and existing tests passed.
  • All commits are signed-off.

Summary by Bito

This pull request enhances the agent and connector task type auto-discovery by prioritizing explicit task type mappings in the configuration over implicit ones. It modifies the registry handling to ensure configuration settings are respected and includes unit tests to validate these changes.

popojk added 4 commits May 16, 2025 09:46
Signed-off-by: Alex Wu <c.alexwu@gmail.com>
Signed-off-by: Alex Wu <c.alexwu@gmail.com>
Signed-off-by: Alex Wu <c.alexwu@gmail.com>
Signed-off-by: Alex Wu <c.alexwu@gmail.com>
@codecov

codecov Bot commented May 23, 2025

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 58.51%. Comparing base (a36d755) to head (5ad5100).
Report is 11 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6464      +/-   ##
==========================================
+ Coverage   58.48%   58.51%   +0.02%     
==========================================
  Files         940      940              
  Lines       71583    71582       -1     
==========================================
+ Hits        41866    41885      +19     
+ Misses      26534    26518      -16     
+ Partials     3183     3179       -4     
Flag Coverage Δ
unittests-datacatalog 59.03% <ø> (ø)
unittests-flyteadmin 56.26% <ø> (ø)
unittests-flytecopilot 30.99% <ø> (ø)
unittests-flytectl 64.72% <ø> (ø)
unittests-flyteidl 76.12% <ø> (ø)
unittests-flyteplugins 61.08% <100.00%> (+0.13%) ⬆️
unittests-flytepropeller 54.78% <ø> (+<0.01%) ⬆️
unittests-flytestdlib 64.04% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

popojk added 2 commits May 23, 2025 22:17
Signed-off-by: Alex Wu <c.alexwu@gmail.com>
Signed-off-by: Alex Wu <c.alexwu@gmail.com>

@pingsutw pingsutw left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thank you

@pingsutw pingsutw merged commit aaf6fec into flyteorg:master May 28, 2025
49 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Agent auto discovery conflicts with explicit task type mapping

3 participants