🐛[BUG]: HEALPixLayer does not apply padding for non-Conv layers

[pzharrington]

Version

1.3.0

On which installation method(s) does this occur?

Pip

Describe the issue

Items wrapped by HEALPixLayer only get healpix padding applied if they are a convolutional layer. This bug was propagated into PhysicsNeMo from the original source code but should probably be addressed at some point. Either HEALPixLayer should be more flexible, or the pooling layers should be removed.

Minimum reproducible example

Relevant log output

Environment details