Right now both agents use the same sample_before_step_idx. It would be nice if we could make them different.
Right now both agents use the same sample_before_step_idx. It would be nice if we could make them different.