Question about Assignment 3: part 2

[ChenchengLiang]

Hey,
I am confused about the difference between the dot Sigma and Sigma in Eq. (14) when we implement them. The instruction says we can use the procedure in part 1 to compute the dot Sigma. Does it mean dot Sigma == hat Sigma in part 1?
Thanks, in advance.

[antonior92]

Does it mean dot Sigma == hat Sigma in part 1?

No. They are not the same.

The comment just means that you should use the same procedure for approximating the expectation... In the case of Sigma you have the dependency on the activation function, while for \dot Sigma you need to consider the derivative of the activation function...

[ChenchengLiang]

Thank you very much!
Problem solved!

[antonior92]

Nice!