We are not currently able to handle non-standard robot id order. e.g 1. having just one robot on friendly that is id 1 and not 0. 2. having robots 0, 2 but not 1. `replay` is also not currently able to support this