LLM inference in C/C++

An MCP-based chatbot | 一个基于MCP的聊天机器人

🚀 The best real-time interactive AI avatar(digital human) with on-premise deployment and <1.5 s latency.

esp32 based device, mainly used for voice chat with large language models