-
Notifications
You must be signed in to change notification settings - Fork 10
Add is best model to training servicer #229
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add is best model to training servicer #229
Conversation
b60fb5f to
90b4a5e
Compare
90b4a5e to
811ddd3
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #229 +/- ##
==========================================
- Coverage 64.60% 62.83% -1.78%
==========================================
Files 40 47 +7
Lines 2195 2876 +681
==========================================
+ Hits 1418 1807 +389
- Misses 777 1069 +292 ☔ View full report in Codecov by Sentry. |
b10d4f9 to
14f81af
Compare
14f81af to
3d62b13
Compare
Whenever we have a new model, a stream will yield a response. The client can utilize this to perform certain actions e.g. ilastik to propagateDirty any predictions performed on previous models.
3d62b13 to
c5b8bf6
Compare
The response of the best model stream will return an id. The id is
increased by one, each time we have a new model. A client can identify
if an action has been performed by an outdated model based on the id. If
the current is greater, then a new best model exists.
c5b8bf6 to
44bc634
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hello @thodkatz,
this is great I don't think it needs any changes 👍
Edit: test failure on mac is a bit surprising (but then maybe not) and needs investigation.
It builds upon #228 .
Whenever we have a new best model, the
IsBestModelstream will yield a response. The client can utilize this to perform certain actions e.g. ilastik topropagateDirtyany predictions performed on previous models.