update retry mechanisms

[anilaltuner]

Problem:

Since task fetching uses task IDs from rpc, diversified retry will be problematic.

Solution

Make all retries to inside of fetch function