We should integrate a configuration management library, such as Hydra or OmegaConf, to:
-
Load configuration files and environment variables consistently.
-
Validate configuration values to prevent invalid or mistyped settings.
-
Make it easier to manage different training setups and experiments.
This improvement will enhance maintainability and reduce potential errors in experiment configuration.
Originally posted by @hanaol in #26 (comment)