这是indexloc提供的服务,不要输入任何密码
Skip to content

[FEAT]: Expand summarization to generic LLM Provider #1335

@FBTCAD

Description

@FBTCAD

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

using LM Studio Community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf in LM Studio when trying to summarize a pdf file asked for API key.
[2024-05-10 19:57:37.216] [INFO] [LM Studio Community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf] Accumulated 108 tokens: I apologize for the inconvenience, but I was unable to summarize the document MBThesis.pdf due to an error.\n\nError:\nAn error occurred while attempting to process the file. The necessary API keys (OpenAI or Azure OpenAI) were not found, which prevented me from accessing and analyzing the document.\n\nIf you would like to provide me with a valid API key or an alternative method to summarize the document, I'll be happy to assist you further. Alternatively, please let me know if there's anything else I can help you

Here is the output from AnythingLLM:
@agent summary of MBThesis.pdf

Agent @agent invoked.
Swapping over to agent chat. Type /exit to exit agent execution loop early.
[debug]: @agent is attempting to call document-summarizer tool
@agent: Looking at the available documents.
@agent: Found 1 documents
@agent: Grabbing all content for MBThesis.pdf
@agent: Summarizing MBThesis.pdf...
I apologize for the inconvenience, but I was unable to summarize the document MBThesis.pdf due to an error.

Error: An error occurred while attempting to process the file. The necessary API keys (OpenAI or Azure OpenAI) were not found, which prevented me from accessing and analyzing the document.

If you would like to provide me with a valid API key or an alternative method to summarize the document, I’ll be happy to assist you further. Alternatively, please let me know if there’s anything else I can help you with.

Are there known steps to reproduce?

No response

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions