Pytorchnn support multi-gpus

[yzmyyff]

Pytorchnn only uses one gpu. It's very inefficient when training a large amount of text.

[kkm000]

This is a Kaldi repository. Whet do you mean? K2 is here, btw: https://github.com/k2-fsa/k2.

[yzmyyff]

Please see codes in wsj local/pytorchnn. It's another nnlm rescore backend.

[kkm000]

My best guess is that it's not implemented. A PR is welcome.

@keli78, do you have something to add?

[keli78]

@kkm000 Right, we don't have a multi-gpu implementation. I'm afraid I'm not available to add it currently. It will be great if you would like to take it.

[kkm000]

@keli78, I'm not up to the task. There is too much work undone on Kaldi that my plate is full, and I have a dayjob (although they do intersect a lot).

@yzmyyff, if you want to develop it, that would be very welcome!

[yzmyyff]

I'm sorry that I am not in this direction now.

The conclusion of the previous attempt is that it will obviously reduce server throughput.

So keeping the existing status is enough for me.