config.py file changes not persistent in evaluation
I have run a few evaluations and have found that the processing time on my local machine (30tk/s) is much faster than that on the cluster (5tk/s). I have also noticed that although I changed the camera resolution in my local development through modifying config.py, this didn't persist in the evaluation. I tested the default obs_delay of 0.1 and found that the processing time in my local development is around 5-6tk/s.
My belief is that the major bottleneck slowing down the processing time on the cluster is actually the obs_delay. In the learn-to-race documentation is states we should be able to change this and config.py isn't marked as a file that gets overwritten at evaluation time.
Is this a bug in evaluation? If this is the intentional behavior is it possible to change the default obs_delay to allow for a higher throughput?