TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

Easily build, customize and control your own LLMs

🏅State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes

sources for daal4py - a convenient Python API to DAAL

Benchmark for optimizations to scikit-learn in the Intel Distribution for Python*