-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Open
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databasebugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request
Description
How are you running AnythingLLM?
All versions
What happened?
With the refactor of AWS Bedrock to move away from Langchain in #3537
This needs to be expanded to the agent execution provider, as the use of Langchain to use reasoning models for agent execution is not possible with the current implementation.
Current workaround
Do not use reasoning models for AWS Bedrock agent execution as the content response is an array as opposed to a string - like all other models.
Are there known steps to reproduce?
Use a reasoning model for AWS bedrock and send a single agent chat. This error will manifest as a jsonString?.startsWith error - which is a red herring as the real error is the output formats from the response being mishandled by Langchain.
Metadata
Metadata
Assignees
Labels
Integration RequestRequest for support of a new LLM, Embedder, or Vector databaseRequest for support of a new LLM, Embedder, or Vector databasebugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request