feat(skore-hub-project): Change the behavior of some CrossValidationReportPayload properties

[thomass-dev]

Change the behavior of some CrossValidationReportPayload properties to reduce the memory footprint:

• splits, to sent the train/test distribution on 200 buckets maximum,
• classes, to sent the classes distribution on 200 buckets maximum,
• dataset_size, to sent the size of the whole dataset.

[github-actions]

Documentation preview @ e4a6a08

[github-actions]

Coverage Report for skore/

File	Stmts	Miss	Cover	Missing
skore/src/skore
__init__.py	23	0	100%
_config.py	31	0	100%
exceptions.py	4	4	0%	4, 15, 19, 23
skore/src/skore/_sklearn
__init__.py	6	0	100%
_base.py	198	14	92%	45, 58, 127, 130, 183, 186–187, 189–192, 225, 228–229
find_ml_task.py	61	0	100%
types.py	27	1	96%	28
skore/src/skore/_sklearn/_comparison
__init__.py	7	0	100%
feature_importance_accessor.py	39	2	94%	92, 111
metrics_accessor.py	178	3	98%	173, 253, 1215
report.py	106	0	100%
utils.py	54	0	100%
skore/src/skore/_sklearn/_cross_validation
__init__.py	7	0	100%
feature_importance_accessor.py	24	0	100%
metrics_accessor.py	182	1	99%	244
report.py	135	1	99%	487
skore/src/skore/_sklearn/_estimator
__init__.py	9	0	100%
data_accessor.py	58	0	100%
feature_importance_accessor.py	144	2	98%	223–224
metrics_accessor.py	356	8	97%	200, 202, 209, 300, 369, 373, 388, 423
report.py	167	2	98%	448–449
skore/src/skore/_sklearn/_plot
__init__.py	3	0	100%
base.py	7	0	100%
style.py	29	0	100%
utils.py	141	7	95%	59, 83–85, 89, 344–345
skore/src/skore/_sklearn/_plot/data
__init__.py	2	0	100%
table_report.py	183	1	99%	682
skore/src/skore/_sklearn/_plot/metrics
__init__.py	6	0	100%
confusion_matrix.py	70	4	94%	91, 99, 121, 229
feature_importance_display.py	67	21	68%	92, 115–116, 118, 136–140, 142–149, 152–154, 156
metrics_summary_display.py	9	0	100%
precision_recall_curve.py	278	5	98%	459, 559, 563, 623, 743
prediction_error.py	225	5	97%	181, 188, 424, 507, 687
roc_curve.py	290	8	97%	389, 512, 517, 618, 623, 627, 696, 818
skore/src/skore/_sklearn/train_test_split
__init__.py	0	0	100%
train_test_split.py	58	0	100%
skore/src/skore/_sklearn/train_test_split/warning
__init__.py	8	0	100%
high_class_imbalance_too_few_examples_warning.py	19	1	94%	83
high_class_imbalance_warning.py	20	0	100%
random_state_unset_warning.py	10	0	100%
shuffle_true_warning.py	9	0	100%
stratify_is_set_warning.py	10	0	100%
time_based_column_warning.py	21	0	100%
train_test_split_warning.py	3	0	100%
skore/src/skore/_utils
__init__.py	6	2	66%	8, 13
_accessor.py	90	3	96%	34, 146, 190
_environment.py	27	0	100%
_fixes.py	8	0	100%
_index.py	5	0	100%
_logger.py	22	4	81%	15–17, 19
_measure_time.py	10	0	100%
_parallel.py	38	3	92%	23, 33, 124
_patch.py	13	5	61%	21, 23–24, 35, 37
_progress_bar.py	46	0	100%
_repr_html.py	8	0	100%
_show_versions.py	38	0	100%
_testing.py	55	0	100%
skore/src/skore/project
__init__.py	2	0	100%
project.py	48	0	100%
summary.py	74	0	100%
widget.py	165	6	96%	436, 439–441, 525–526
TOTAL	3939	113	97%

Tests	Skipped	Failures	Errors	Time
1039	5 💤	0 ❌	0 🔥	4m 0s ⏱️

[github-actions]

Coverage Report for skore-hub-project/

File	Stmts	Miss	Cover	Missing
skore-hub-project/src/skore_hub_project
__init__.py	19	1	94%	35
protocol.py	26	0	100%
skore-hub-project/src/skore_hub_project/artefact
__init__.py	2	0	100%
artefact.py	36	0	100%
serializer.py	28	0	100%
upload.py	36	4	88%	169, 171–172, 174
skore-hub-project/src/skore_hub_project/authentication
__init__.py	0	0	100%
login.py	19	1	94%	26
logout.py	5	0	100%
token.py	18	0	100%
skore-hub-project/src/skore_hub_project/client
__init__.py	0	0	100%
api.py	47	0	100%
client.py	60	0	100%
skore-hub-project/src/skore_hub_project/media
__init__.py	6	0	100%
data.py	42	2	95%	26, 28
feature_importance.py	46	0	100%
media.py	18	0	100%
model.py	15	0	100%
performance.py	55	0	100%
skore-hub-project/src/skore_hub_project/metric
__init__.py	10	0	100%
accuracy.py	32	0	100%
brier_score.py	32	0	100%
log_loss.py	34	0	100%
metric.py	49	1	97%	23
precision.py	60	0	100%
r2.py	32	0	100%
recall.py	60	0	100%
rmse.py	34	0	100%
roc_auc.py	34	0	100%
timing.py	87	4	95%	51–52, 113–114
skore-hub-project/src/skore_hub_project/project
__init__.py	0	0	100%
project.py	82	2	97%	247, 275
skore-hub-project/src/skore_hub_project/report
__init__.py	3	0	100%
cross_validation_report.py	72	2	97%	210, 251
estimator_report.py	20	0	100%
report.py	48	0	100%
TOTAL	1167	17	98%

Tests	Skipped	Failures	Errors	Time
134	0 💤	0 ❌	0 🔥	1m 8s ⏱️

[glemaitre]

adding a groups kwarg to CrossValidationReport constructor

Adding groups as a kwarg in the constructor should be given some thoughts. We are deprecating this behaviour in scikit-learn: (cf. https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.cross_validate.html and the groups) parameter and moving having a params that is a dict taking whatever metadata that should be routed.

In short, it would mean that we can have something like:

CrossValidationReport(
    estimator=model,
    X=X,
    y=y,
    cv=MyCVSplitter().set_split_request(metadata=True),
    params={"metadata": np.random.randn(y.shape[0])}
)

[thomass-dev]

I'm taking back control of this PR and will split the work in several.