这是indexloc提供的服务,不要输入任何密码
Skip to content

Conversation

@shatfield4
Copy link
Collaborator

Pull Request Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style

Relevant Issues

resolves #xxx

What is in this change?

  • Add docs for disabling streaming for generic OpenAI provider via env

Additional Information

Validations

  • Ensured updated documentation pass spell check
  • Updated or added relevant links as needed
  • Reviewed the changes for clarity and accuracy
  • Successfully ran the code locally without encountering errors

@vercel
Copy link

vercel bot commented Jul 1, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
anythingllm-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 1, 2025 6:09pm

@timothycarambat timothycarambat merged commit ec98d39 into main Jul 1, 2025
2 checks passed
@timothycarambat timothycarambat deleted the disable-generic-openai-streaming-env branch July 1, 2025 19:47
@StevenK-vz
Copy link

Is this option available for the Desktop app? If so, how do you set it? The documentation doesn't explain how to change this for the Desktop version.

@timothycarambat
Copy link
Member

@StevenK-vz it is an edge case, so we dont expose it in the desktop GUI.

Open the desktop storage folder https://docs.anythingllm.com/installation-desktop/storage#where-is-my-data-located and edit the .env in that file.

Add the configuration
https://docs.anythingllm.com/configuration#disable-streaming-for-generic-openai-provider

Restart the app, and it will be applied. Non-streaming is such a dramatically worse experience so we dont expose it via the UI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants