🖥 Windows Bootable USB creator for macOS. 🛠 Patches Windows 11 to bypass TPM and Secure Boot requirements. 👾 UEFI & Legacy Support

A self-hosted dashboard that puts all your feeds in one place

NVIDIA Inference Xfer Library (NIXL)

A Datacenter Scale Distributed Inference Serving Framework

Rust bindings for the C++ api of PyTorch.

Analyze computation-communication overlap in V3/R1.

Expert Parallelism Load Balancer

A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

DeepEP: an efficient expert-parallel communication library

FlashMLA: Efficient Multi-head Latent Attention Kernels

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

You like pytorch? You like micrograd? You love tinygrad! ❤️

An Extensible Deep Learning Library

A Zsh theme

Simple, safe way to store and distribute tensors

Some examples of uses for Xray-core

High performance self-hosted photo and video management solution.

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

SGLang is a fast serving framework for large language models and vision language models.

NAS媒体库管理工具

The official Meta Llama 3 GitHub site

Distributed LLM and StableDiffusion inference for mobile, desktop and server.

NAS媒体库管理工具

A command-line tool to download photos from iCloud

An Alpine Linux container for the iCloud Photos Downloader command line utility

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）