Commit 63728c0
* feat: initial version of experiments and runs API
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: experiments and runs initial implementation (wip)
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fixed failing unit tests for experiments and runs
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: added experiment and experimentrun tests
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: added DataSet, Metric, and Parameter types
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: added implementatio of DataSet, Metric, and Param, including service tests
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: replace int properties for timestamps with string because mlmd type properties only support int32, not int64
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: add support for artifactType query param to filter artifact types in artifact queries
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add metrics history endpoint and metric history storage for experiment run metrics
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix artifactType query param type in generated service
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix go lint error in unit test
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: filter out metric history from artifacts endpoints
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix metric history name to use last update time to avoid name conflicts
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: add filterQuery param on all context types to search by properties and custom properties
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: initial version of experiment tracking implemented on embedmd, rebased on main
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: add support for filterQuery parameter for all ListResponse endpoints for embedmd datastore
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add support for stepIds query parameter in embedmd datastore
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: refactor embedmd db service to use generic repository implementation to reduce code duplication
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add support for artifactType query parameter for embedmd datastore
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: use mysql 8.3 in unit tests
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: refactor name mapping and default name handling in embedmd datastore
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: support updating metrics and parameters by name, fix ignoring metric history when retrieving all artifacts for runs and versions
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add missing generated openapi python client files for PR github action check
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix failing shared db tests
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add support for metric and parameter description, add missing type property migraiton
Signed-off-by: Dhiraj Bokde <[email protected]>
* chore: update files from main
Signed-off-by: Alessio Pragliola <[email protected]>
* fix: added missing godoc comments in pkg/api/api.go
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: replace ambiguous ArtifactListReponse return type from GetExperimentRunMetricHistory with MetricListResponse
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fixed incorrect artifactType in dataset response, added tests to verify all artifact types
Signed-off-by: Dhiraj Bokde <[email protected]>
* feat: add validation for endTimeSinceEpoch property on experiment run updates
Signed-off-by: Dhiraj Bokde <[email protected]>
* Replace value type validation map with a switch in query_translator.go
Co-authored-by: Paul Boyd <[email protected]>
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add service e2e tests for filterQuery, fix name query param handling, fix DB tests that didn't use parent id prefix
Signed-off-by: Dhiraj Bokde <[email protected]>
* chore: code cleanup, replace interface{} with any, added vetting for internal/db/filter
Signed-off-by: Dhiraj Bokde <[email protected]>
* chore: added flag vF for fixed string grep exclude
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: copied orderby and parameters back to registry and catalog to have different values
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fixed mlmd query translator handling of escaped backslashes
Signed-off-by: Dhiraj Bokde <[email protected]>
* chore: add test to verify parseCustomPropertyField won't panic with a property name ending in dot
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: sync generated python client code
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: readiness probe tests and new types
Signed-off-by: Alessio Pragliola <[email protected]>
* chore: refactor readiness_test
Signed-off-by: Alessio Pragliola <[email protected]>
* fix: ensure parentResourceId is used to filter resource lookup by params, add unit tests for duplicate child resource lookups
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: throw an error if a metric value is missing, add test to validate
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix http status error code for invalid ids
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: more id validation, fixed filterQuery passing to DB layer
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix failing unit test
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: validate experiment id when listing runs
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: fix failing validation test after fixing http status codes
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: avoid duplicate key errors if externalid is set in metric when creating metric history entries
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: add fuzzer tests for experiment runs and new artifact types
Signed-off-by: Dhiraj Bokde <[email protected]>
* chore: code cleanup and format fuzzer tests
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: log error in fuzzer test
Signed-off-by: Dhiraj Bokde <[email protected]>
* fix: handle null artifact names correctly on create
Signed-off-by: Dhiraj Bokde <[email protected]>
---------
Signed-off-by: Dhiraj Bokde <[email protected]>
Signed-off-by: Alessio Pragliola <[email protected]>
Signed-off-by: Alessio Pragliola <[email protected]>
Co-authored-by: Alessio Pragliola <[email protected]>
Co-authored-by: Alessio Pragliola <[email protected]>
Co-authored-by: Paul Boyd <[email protected]>
Signed-off-by: syntaxsdev <[email protected]>
1 parent 60ab78a commit 63728c0
File tree
226 files changed
+49784
-5813
lines changed- api/openapi
- src
- lib
- catalog
- internal/server/openapi
- .openapi-generator
- pkg/openapi
- .openapi-generator
- clients
- python
- src
- .openapi-generator
- mr_openapi
- api
- models
- tests
- ui/bff
- internal
- apiutils
- converter
- generated
- core
- datastore/embedmd
- mysql
- migrations
- postgres
- migrations
- db
- filter
- models
- service
- types
- defaults
- mapper
- mlmdtypes
- proxy
- server/openapi
- .openapi-generator
- testutils
- testdata
- pkg
- api
- core
- openapi
- .openapi-generator
- scripts
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
226 files changed
+49784
-5813
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
176 | 176 | | |
177 | 177 | | |
178 | 178 | | |
179 | | - | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
180 | 183 | | |
181 | 184 | | |
182 | 185 | | |
| |||
397 | 400 | | |
398 | 401 | | |
399 | 402 | | |
400 | | - | |
| 403 | + | |
401 | 404 | | |
402 | 405 | | |
403 | 406 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
137 | 137 | | |
138 | 138 | | |
139 | 139 | | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
140 | 149 | | |
141 | 150 | | |
142 | 151 | | |
| |||
569 | 578 | | |
570 | 579 | | |
571 | 580 | | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
| 591 | + | |
| 592 | + | |
| 593 | + | |
| 594 | + | |
| 595 | + | |
| 596 | + | |
| 597 | + | |
| 598 | + | |
| 599 | + | |
| 600 | + | |
| 601 | + | |
| 602 | + | |
| 603 | + | |
| 604 | + | |
| 605 | + | |
| 606 | + | |
| 607 | + | |
| 608 | + | |
| 609 | + | |
| 610 | + | |
| 611 | + | |
| 612 | + | |
| 613 | + | |
| 614 | + | |
| 615 | + | |
| 616 | + | |
| 617 | + | |
572 | 618 | | |
573 | 619 | | |
574 | 620 | | |
| |||
598 | 644 | | |
599 | 645 | | |
600 | 646 | | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
| 650 | + | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
601 | 671 | | |
602 | 672 | | |
603 | 673 | | |
| |||
0 commit comments