Implementation of a chatbot with CLI interface.
Follow the instructions below to run this app locally (clone this repo and cd into it).
conda create -n "chatbot" python=3.12
conda activate chatbot
pip install -r requirements.txt
vllm serve [Qwen/Qwen3-0.6B]
python main.py
usage: main.py [-h] [--model MODEL] [--openai_api_key OPENAI_API_KEY] [--openai_api_base OPENAI_API_BASE]
[--max_tokens MAX_TOKENS] [--temperature TEMPERATURE]
Chatbot parameters
options:
-h, --help show this help message and exit
--model MODEL
--openai_api_key OPENAI_API_KEY
--openai_api_base OPENAI_API_BASE
--max_tokens MAX_TOKENS
--temperature TEMPERATURE