Momentum formulation

[sai-sai-sai]

Say in iteration t : Vdw = Beta*Vdw + (1-Beta)*dw ---> The first term in this should actually be Vdw exponentially averaged till t-1 iterations. Since we are cacluating Vdw we can not use Vdw but need to use Vdw averaged till t-1th iteration.

[mbadry1]

Do you mean we need to write it like this:
Vdw_t = Beta*Vdw_t-1 + (1-Beta)*dw

[sai-sai-sai]

Yes, that's what i think. What do you say? And i think Andrew Ng also states it as you had written in his video but it may be a typo or a quick mistake overlooked.