batch normalization

[krajsek]

Implementation of a parallel version of Batch Normalisation for Model and Data parallization

[ClaudiaComito]

@krajsek can we break this in smaller tasks?

[krajsek]

we could divide it into model and data parallel BN. Ich have already started some code with data parallelism, have to check how far it is.

[mrfh92]

@krajsek are there news within this issue?

(Review within #1109)

[krajsek]

@mrfh92 The data-parallel version works, but still needs some more testing: https://github.com/helmholtz-analytics/heat/blob/features/589-batch-normalization-3/heat/nn/batch_norm.py

[mrfh92]

ok sounds cool ... then we leave this definitely open 👍
(Reviewed within #1109)