Error in class RNNNode():'s def backward() function. Chain rule suggest, gradient from the $t+1$ must be added as well.
- Current version:
dh = np.dot(X_out_grad, params_dict['W_v']['value'].T)
- Correct version:
dh = np.dot(X_out_grad, params_dict['W_v']['value'].T) + H_out_grad
Error in$t+1$ must be added as well.
class RNNNode():'sdef backward()function. Chain rule suggest, gradient from thedh = np.dot(X_out_grad, params_dict['W_v']['value'].T)dh = np.dot(X_out_grad, params_dict['W_v']['value'].T) + H_out_grad