Predictions written in batches when save_dir is set instead of buffer in memory

Predictions written in batches when save_dir is set instead of buffer in memory #1233