MoE Top-K Training #1364
Description
According to the nexo_argument, the TopK router is not supported for training. However, after applying the TopK for training, it does not report errors. Do I have anything wrong?
{{ message }}
According to the nexo_argument, the TopK router is not supported for training. However, after applying the TopK for training, it does not report errors. Do I have anything wrong?