Currently, some multichip workloads fail with
Shardy automatic parallelization currently does not support non-splat constant tensors.
in UpdateGlobalToLocalShapes, when we try to shard constant tensor that has different values across elements.

Tensors for which this happens are small and possible fix is to just keep all constant tensor replicated.
This issue happened after this fix