Skip to content

Conversation

@spencerkclark
Copy link
Member

@spencerkclark spencerkclark commented Sep 26, 2025

This PR allows toggling whether the wandb directory will be stored in the experiment_dir or in /tmp. By default it retains the existing behavior, where it is stored in local /tmp. Storing it in the experiment_dir is useful when running bare-metal, since it ensures that the directory is unique and can be accessed from nodes that have internet connectivity.

Changes:

  • Adds a wandb_dir_in_experiment_dir option (default False) to the LoggingConfig to toggle whether the wandb directory will be stored in the experiment directory or not.

Copy link
Contributor

@brianhenn brianhenn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@spencerkclark spencerkclark merged commit a1036b4 into main Sep 26, 2025
5 checks passed
@spencerkclark spencerkclark deleted the port-wandb_in_experiment_dir-option branch September 26, 2025 16:43
@spencerkclark spencerkclark changed the title Port wandb_in_experiment_dir option to public code Port wandb_dir_in_experiment_dir option to public code Sep 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants