-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Description
How are you running AnythingLLM?
Docker (local)
What happened?
I am trying to understand how Agent Flow works in AnythingLLM. I created a sample AgentFlow named "CheckWeather" and gave a description.
Once the agent is invoked, AnythingLLM sends a query to LLM to pick a tool among all the available tools with the query starting with "You are a program which picks the most optimal function and parameters to call".
In this, function names, description, variables are also sent. For the default tools, the description is set properly. But for the tools created using AgentFlow Builder, the description is going as "Execute agent flow: ${flow.name}" instead of "flow.description".
For example , for the weather agent I created,
Function name: flow_403c960e-6397-4129-86d5-034b90932f22\n
Function Description: Execute agent flow: CheckWeather\n
...
This is happening even though in the agent flow the user has provided a valid description. This description is very important for the LLM to select the right tool.
"name": "CheckWeather",
"description": "This tool is used to find the location of a given place. This tool can help to provide the current weather conditions. ",
"active": true,
Are there known steps to reproduce?
- Create a new Agent Flow using AnythingLLM Agent Flow Builder.
- Take a packet capture at Ollama (if you are using Ollama as your LLM provider) to check the LLM Query.
- The Function description should ideally contain whatever the user has provided not the default "Execute agent flow: ${flow.name}".