+
Skip to content

diogo-p-nunes/local-chatbot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

local-chatbot

Implementation of a chatbot with CLI interface.
Follow the instructions below to run this app locally (clone this repo and cd into it).

Create conda environment and install dependencies

conda create -n "chatbot" python=3.12
conda activate chatbot
pip install -r requirements.txt

(Optional) Launch local OpenAi-compatible server

vllm serve [Qwen/Qwen3-0.6B]

On a new terminal window, run the main script

python main.py
usage: main.py [-h] [--model MODEL] [--openai_api_key OPENAI_API_KEY] [--openai_api_base OPENAI_API_BASE]
               [--max_tokens MAX_TOKENS] [--temperature TEMPERATURE]

Chatbot parameters

options:
  -h, --help            show this help message and exit
  --model MODEL
  --openai_api_key OPENAI_API_KEY
  --openai_api_base OPENAI_API_BASE
  --max_tokens MAX_TOKENS
  --temperature TEMPERATURE

About

Implementation of a local chatbot with CLI interface

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载