SGD +momentum + noise "=" SGHMC

[emiled16]

Hello,
I was going through your paper and through the paper of SGHMC and I understand that :

• SGD + noise equates to SGLD
• SGD + momentum + noise equates to SGHMC
  However, I don't understand what Adam + noise which is what you used in your code equates to? in the paper you said that you were going to use SGHMC. Is it reasonable to assume that Adam + noise is also equivalent to SGHMC? if so, can you please say why?

Thanks