Replies: 1 comment
-
mark |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I would like to add a new token on Qwen, using the reserved unused token ID. I have tried both LoRA fine-tuning and full fine-tuning of the embeddings, but it seems that the loss for the new token converges poorly and the accuracy remains at 0. Are there any specific techniques required for fine-tuning newly added tokens?
Beta Was this translation helpful? Give feedback.
All reactions