SAC policy produces nan action #44
Description
- I have marked all applicable categories:
- exception-raising bug
- RL algorithm bug
- documentation request (i.e. "X is missing from the documentation.")
- new feature request
- I have visited the source website, and in particular read the known issues
- I have searched through the issue categories for duplicates
- I have mentioned version numbers, operating system and environment, where applicable:
import tianshou, torch, sys print(tianshou.__version__, torch.__version__, sys.version, sys.platform)
- version numbers: 0.2.2 1.4.0
- problem: sac policy generating nan actions
runningpython3 examples/halfcheetahBullet_v0_sac.py --task BipedalWalkerHardcore-v3,
cannot pass nan assertion, and causing env exception.