-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Closed
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databasebugSomething isn't workingSomething isn't working
Description
The Azure OpenAI has the GPT-4 turbo model, which has 128,000 tokens. I am able to select that from the dropdown list, but cannot save the settings.
Here is the option:
Here is the error message:
This is a screenshot from my Azure OpenAI Chat playground. As you can see, I do have the deployment with 128,000 tokens.
I believe this line is wrong.
| if (![4_096, 16_384, 8_192, 32_768].includes(tokenLimit)) |
I'm not sure if this is the root cause.
Metadata
Metadata
Assignees
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databasebugSomething isn't workingSomething isn't working