-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add batch training experimental feature to allow batching of multiple tasks when training with ML backend #5108
base: develop
Are you sure you want to change the base?
Conversation
✅ Deploy Preview for label-studio-docs-new-theme ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
✅ Deploy Preview for heartex-docs ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## develop #5108 +/- ##
===========================================
- Coverage 76.03% 75.96% -0.07%
===========================================
Files 154 154
Lines 12792 12809 +17
===========================================
+ Hits 9726 9730 +4
- Misses 3066 3079 +13 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
This PR is stale because it has been open 45 days with no activity. Remove |
This PR is stale because it has been open 45 days with no activity. Remove |
This PR is stale because it has been open 45 days with no activity. Remove |
This PR is stale because it has been open 45 days with no activity. Remove |
This PR is stale because it has been open 45 days with no activity. Remove |
PR fulfills these requirements
[fix|feat|ci|chore|doc]: TICKET-ID: Short description of change made
ex.fix: DEV-XXXX: Removed inconsistent code usage causing intermittent errors
Change has impacts in these area(s)
(check all that apply)
Describe the reason for change
(link to issue, supportive screenshots etc.)
Wanted to batch multiple tasks together from database view before training model. This feature allows the user to, after turning on the experimental feature, to select multiple tasks and send it to the backend for training. Before, it was only possible to do one at a time. For most machine learning / deep learning domains, task batching is preferred to train models used for inference.
What does this fix?
(if this is a bug fix)
N/A
What is the new behavior?
(if this is a breaking or feature change)
After turning on experimental features, the user can select multiple tasks from the task view and send a batch of tasks to train their ML backend.
What is the current behavior?
(if this is a breaking or feature change)
What libraries were added/updated?
(list all with version changes)
Does this change affect performance?
(if so describe the impacts positive or negative)
No
Does this change affect security?
(if so describe the impacts positive or negative)
No
What alternative approaches were there?
(briefly list any if applicable)
This feature could be added to main software, but for testing I am currently keeping the batch training option as an experimental feature.
What feature flags were used to cover this change?
(briefly list any if applicable)
Does this PR introduce a breaking change?
(check only one)
What level of testing was included in the change?
(check all that apply)
Which logical domain(s) does this change affect?
(for bug fixes/features, be as precise as possible. ex. Authentication, Annotation History, Review Stream etc.)
Task Manager training