这是indexloc提供的服务,不要输入任何密码
Skip to content

[FEAT]: APIPie provider improvements #2592

@timothycarambat

Description

@timothycarambat

What would you like to see?

Refer to #2464 (comment) to end for more details or scope.

  1. Enable streaming on Apipie providers
  2. File chat model providers with the query param for chatx so we can reduce model selection for LLM Options.
  • Keep the full .cache of models, apply the post-filter after that request on the resulting file contents. We can reuse this cache for Embedding and Voice Support
  1. Investigate Voice and Embedder model support (filter appropriate models for each). If Embedding, TTS, or STT are viable break them into separate issues from this issue.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions