Feature Request : Gaussian GLN

[pclucas14]

Cool work! and clean implementation

I saw the authors recently released a newer version called Gaussian Gated Linear Networks https://arxiv.org/pdf/2006.05964.pdf

I'd be curious to know how hard it would be to implement from your codebase!

[AlexKuhnle]

Hi @pclucas14,

First, thanks for the feedback! Yes, we're also interested in extending the codebase to include Gaussian GLNs, which will happen probably quite soon, but we haven't started on this yet. I would expect that it's not too difficult to implement this variant based on the Bernoulli version implemented here, probably just a few lines of code which need changing, judging from the paper -- but the devil is in the detail, so remains to be seen. If you give it a go, let us know how it goes... ;-)

[pclucas14]

Thanks for the fast reply! I'll let you know if I attempt it

100%, the devil is in the details aha.