We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
lr=0.0001*(samples_per_gpu/2)*num_nodes 请问这个不考虑单机多卡吗?我看num_nodes是”for multi-machine parallel training“ 多机的数量?