-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Closed
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databaseenhancementNew feature or requestNew feature or requestfeature request
Description
What would you like to see?
Refer to #2464 (comment) to end for more details or scope.
- Enable streaming on Apipie providers
- File chat model providers with the query param for
chatxso we can reduce model selection for LLM Options.
- Keep the full .cache of models, apply the post-filter after that request on the resulting file contents. We can reuse this cache for Embedding and Voice Support
- Investigate Voice and Embedder model support (filter appropriate models for each). If Embedding, TTS, or STT are viable break them into separate issues from this issue.
shatfield4 and Toocky
Metadata
Metadata
Assignees
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databaseenhancementNew feature or requestNew feature or requestfeature request