Pinned Loading

1. gpustack gpustack Public

   Simple, scalable AI model deployment on GPU clusters

   Python 3k 309

2. gguf-parser-go gguf-parser-go Public

   Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

   Go 181 19

3. llama-box llama-box Public

   LM inference server implementation based on *.cpp.

   C++ 233 22

4. vox-box vox-box Public

   A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

   Python 132 19