I believe i found the issue. Installing tensorforce installs h5py 3.1.0. That installs numpy 1.9.3 and doesn't work with python 3.11. h5py 3.10.0 worked, but tensorflow wont let me use that.