Stars
Multi-stream video inference with Ultralytics YOLO - Display multiple video streams in a grid layout with real-time object detection.
🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
A high-performance tool for video upscaling, interpolation, depth estimation, and more. Available as a CLI and Adobe Extension.
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Open-source high-performance RISC-V processor
Easy-to-use, high-performance, multi-platform inference deployment framework
real time face swap and one-click video deepfake with only a single image
YOLOv10: Real-Time End-to-End Object Detection [NeurIPS 2024]
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
FlagGems is an operator library for large language models implemented in the Triton Language.
[ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…
An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information
llm deploy project based mnn. This project has merged into MNN.
A high-throughput and memory-efficient inference and serving engine for LLMs