Return and value funtions definitions for RL (pages 680-683)

[labdmitriy]

Hi Sebastian,

There is a definition of the return on the page 680, where we have multiplier gamma^k in the sum for R(t+k+1).
But for value and action-value functions we have gamma^(k+1) multiplier for the same R(t+k+1) on the pages 682-683.

Why do we replace the term with gamma^(k+1) multiplier instead of gamma^k in the latter definitions?

Thank you.