Commit d7b8c597 authored by Eric Hambro's avatar Eric Hambro
Browse files

Fix big resulting in double resets.

parent 9fbdfecb
......@@ -46,8 +46,6 @@ def run_batched_rollout(batched_env, agent):
returns[i] += r
for done_idx in np.where(dones)[0]:
observations[done_idx] = batched_env.single_env_reset(done_idx)
if active_envs[done_idx]:
# We were 'counting' this episode
all_returns.append(returns[done_idx])
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment