Setup and run a local LLM and Chatbot using consumer grade hardware.

📑 npm pacakge to Craft files into Markdown with ease

LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB

Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment

Proxy for vLLM to expose token usage metrics.