As mentioned in #918, it would be good to update here to only include params that are in the model's init signature.
This would ensure that model_params can be passed but will use defaults for incompatible models rather than raise exception.
We might want to revisit whether to make model_tuning a bool flag for clearer control too.
Originally posted by @radka-j in #918 (comment)