Stars
A container init that is so simple it's effectively brain-dead.
Next generation distributed, event-driven, parallel config management!
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
Mount remote repositories, models and datasets managed by Git LFS instantly.
A Rust based DNS client, server, and resolver
Gateway API Inference Extension
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
A flexible distributed key-value database that is optimized for caching and other realtime workloads.
Open-source Pricing and Billing Infrastructure 🚀 Subscription management, Invoicing, Pricing, Usage-based billing, Cost limiting, Grandfathering, Experiments, Revenue analytics & Actionable insights
A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, etc.
A Datacenter Scale Distributed Inference Serving Framework
The YAML org maintained fork of https://github.com/go-yaml/yaml
Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)
A TTS model capable of generating ultra-realistic dialogue in one pass.
📄 Configuration files that enhance Cursor AI editor experience with custom rules and behaviors
Assert your Go code is inlined and bounds-check eliminated
Geo-scale, next-generation peer-to-peer sharing platform built on top of OpenZiti.
HTTP middleware for Go that facilitates some quick security wins.