For proper monitoring of deployed ML models, a considerate data scientist/ML engineer want to check new data looks like training data.
This plugin offers a set of different DSS components to monitor input data:
- Custom metric: compute compliance metrics given a reference dataset or a saved model.
- Custom check: validate new data given a reference dataset or a saved model.
Please see our official plugin page for installation.
Version 1.0.0 (2020-08)
- Initial release
- Custom metric to compute compliance metrics
- Custom check to validate new data based on compliance metrics
You can log feature requests or issues on our dedicated Github repository.
The Model drift monitoring plugin is:
Copyright (c) 2020 Dataiku SAS Licensed under the MIT License.