You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
is there a way to tell anythingllm that my generic openai provider does not support streaming?
We should have a way to specify or override if a provider is allowed to stream or not. All LLM providers support both chat and stream, so disabling this should be done via a flag.
We can apply this to the Generic OpenAI provider at this time only, since the others are pinned to a service and there is no reason to disable streaming, since that is a better experience.