-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Add support for someone to be able to use a Locally hosted LLM.
- The LocalLLM must have an API wrapper like GPT4ALL
- This will not allow an arbitrary LLM running inferences to just interact with the system, we will not be building API wrappers for LLMs.
References for easier integration:
https://docs.gpt4all.io/
LocalAI
Replicant
OLLama
LLMStudio
HuggingFace
joofio, sammcj, jaschadub and Amejonah1200Amejonah1200
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
Type
Projects
Status
Done