Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

我问了chatGLM，但是他的回答颠三倒四，一会谁可以一会说不行，想求证一下到底行不行

Expected Behavior

No response

Steps To Reproduce

.

Environment

- OS:windows10
- Python:3.10
- Transformers:
- PyTorch:2.0.0
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :ture

Anything else?

No response