Out of memory error during training

[aadeshnpn]

I started training the algorithm for SuperMarioBros. I tried it on Desktop and Laptop with Nvidia GPU and 16 GB of RAM. On both machines, the training scripts exits after the RAM is full.

[Kautenja]

Ah, this is to be expected as the default DeepQAgent initializes a replay queue of 750,000 states. This requires ~39GB of RAM to execute. Changing the 40th line of train.py from

agent = DeepQAgent(env, replay_memory_size=int(7.5e5))

to

agent = DeepQAgent(env, replay_memory_size=int(2.5e5))

should fix your problem. Otherwise I'd suggest finding a powerful server with 64GB+ RAM and at least a GTX1070 to run training sessions on.

In the near future I'll update:

1. the CLI to support passing training parameters in without editing code files
2. init of DeepQAgent to raise an error if the replay queue will exceed the amount of memory on the machine

[aadeshnpn]

Thanks @Kautenja.