For the DP-GMM model, we should be able to avoid singularities by choosing an Inverse Gamma prior on the sigma parameter, I think.