θΏ™ζ˜―indexlocζδΎ›ηš„ζœεŠ‘οΌŒδΈθ¦θΎ“ε…₯任何密码
Skip to content

feat: expand summarization to OSS LLM #1648

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 10, 2024
Merged

feat: expand summarization to OSS LLM #1648

merged 1 commit into from
Jun 10, 2024

Conversation

@timothycarambat
Copy link
Member

@timothycarambat timothycarambat commented Jun 10, 2024 •
edited
Loading

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

resolves #1335

What is in this change?

Add support for built-in summarization of context using the attached LLM and model used for agents
Now supports:

openai
anthropic
groq
mistral
openrouter
perplexity
togetherai
generic-openai
ollama
lmstudio
koboldcpp
localai
textgenwebui

and any LLM

Additional Information

Any model not explicitly supported and can fit in LCWrapper is aborted.
Groq Agent interface migrated to AnythingLLM UnTooled because performance was so bad with tool calling using their OpenAI API interface.

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

@timothycarambat timothycarambat merged commit d470845 into master Jun 10, 2024
@timothycarambat timothycarambat deleted the expand-summarize branch June 10, 2024 21:31
CrackerCat pushed a commit to CrackerCat/anything-llm that referenced this pull request Jul 31, 2024
@timothycarambat
feat: expand summarization to OSS LLM (Mintplex-Labs#1648)
b00b798
CrackerCat pushed a commit to CrackerCat/anything-llm that referenced this pull request Aug 1, 2024
@timothycarambat
feat: expand summarization to OSS LLM (Mintplex-Labs#1648)
c5d7cb2
CrackerCat pushed a commit to CrackerCat/anything-llm that referenced this pull request Aug 2, 2024
@timothycarambat
feat: expand summarization to OSS LLM (Mintplex-Labs#1648)
5048ffc
CrackerCat pushed a commit to CrackerCat/anything-llm that referenced this pull request Aug 3, 2024
@timothycarambat
feat: expand summarization to OSS LLM (Mintplex-Labs#1648)
751d5be
cabwds pushed a commit to cabwds/anything-llm that referenced this pull request Jul 3, 2025
@timothycarambat
feat: expand summarization to OSS LLM (Mintplex-Labs#1648)
9abc0a5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[FEAT]: Expand summarization to generic LLM Provider

2 participants

@timothycarambat