Validation Metrics Don't Save to WandB Via MMSegWandbHook

[AndrewTKent]

Motivation
I am able to see the training loss metrics logged into my WandB account using MMSegWandbHook, but I'd much prefer to see validation metrics like mIoU or mAcc across iterations - even if I am only able to see them during iterations where I am preforming an evaluation.

To my knowledge MMSegWandbHook doesn't allow for this, and I've tried looking -

[MeowZheng]

Might try to modify the evaluation configuration and shorten the interval between evaluations, as wandb will record the evaluation results every evaluation iter.

mmsegmentation/configs/_base_/schedules/schedule_40k.py

Line 9 in 8dbbdd8

evaluation = dict(interval=4000, metric='mIoU', pre_eval=True)

mmsegmentation/mmseg/core/hook/wandblogger_hook.py

Line 143 in 8dbbdd8

self.eval_interval = self.eval_hook.interval

[AndrewTKent]

@MeowZheng I have my evaluation set to 100, and I'm able to see the validation metrics in the log from TextLoggerHook but nothing is showing up in my WandB. Should I paste my config? Thank-you for helping me with this

[MeowZheng]

hi @ayulockin please take a look, thank you.