这是indexloc提供的服务,不要输入任何密码
Skip to content

User customizable context window for ollama models. Compact mode for more direct answers. Other minor fixes. #632

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 123 commits into
base: master
Choose a base branch
from

Conversation

boarder2
Copy link
Contributor

@boarder2 boarder2 commented Feb 15, 2025

This PR adds:

  1. User customizable setting in the UI that lets you set context windows for ollama models.
  2. Persistence for the optimization mode, and lets you change it in the middle of a chat.
  3. Fixes a bug with rewrite where assistant history wouldn't be removed for the rewritten message.

@boarder2 boarder2 changed the title User customizable context window for ollama models User customizable context window for ollama models. Compact mode for more direct answers. Other minor fixes. Feb 16, 2025
@boarder2
Copy link
Contributor Author

Here are some screenshots of the changed areas:
image
image

boarder2 added 18 commits June 16, 2025 23:59
…his is a checkpoint to come back to. Going to start trying to make it faster.
…nd improve prompt clarity in task breakdown and summarization
…nd file search capabilities

- Introduced ContentRouterAgent to determine the next step in information gathering (file search, web search, or analysis) based on task relevance and focus mode.
- Added FileSearchAgent to handle searching through attached files, processing file content into searchable documents.
- Updated SynthesizerAgent to utilize a prompt template for generating comprehensive responses based on context and user queries.
- Enhanced TaskManagerAgent to consider file context when creating tasks.
- Improved AnalyzerAgent to assess the sufficiency of context, including file and web documents.
- Implemented utility functions for processing files and ranking documents based on similarity to queries.
- Updated prompts to include new instructions for handling file context and routing decisions.
- Adjusted agent search workflow to integrate new agents and support file handling.
- Updated FileSearchAgent to improve code readability and formatting.
- Refactored SynthesizerAgent for better prompt handling and document processing.
- Enhanced TaskManagerAgent with clearer file context handling.
- Modified AgentSearch to maintain consistent parameter formatting.
- Introduced SpeedSearchAgent for optimized search functionality.
- Updated metaSearchAgent to support new SpeedSearchAgent.
- Improved file processing utilities for better document handling.
- Added test attachments for sporting events queries.
@parthpat12
Copy link

Hey, thanks for the PR! I will be reviewing this over the weekend and merge it ASAP

@boarder2 tremendous work!

@ItzCrazyKns do you plan on merging these changes to main? If so, any timeline on when you can review the changes.

boarder2 and others added 11 commits July 3, 2025 00:27
- Introduced `withStructuredOutput` function to configure structured output for LLMs.
- Added support for Groq models using 'jsonMode' method.
- Enhanced flexibility with optional parameters for naming and raw output inclusion.
feat(providers): added openrouter support
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants