• I have marked all applicable categories:
  • exception-raising bug
  • RL algorithm bug
  • documentation request (i.e. "X is missing from the documentation.")
  • new feature request
• I have visited the source website
• I have searched through the issue tracker for duplicates
• I have mentioned version numbers, operating system and environment, where applicable:

I want to compute one feature per environment only at reset time and persist it. I can not do it inside preprocess_fn because although I know when environments are reset, I don't know which one it is and I can not save that value as an attribute. The other solution is to implement this on the environment itself or in the agent. Is this the idea?