FriendliAI
Supercharge Generative AI Inference
- 63 followers
- United States of America
- https://friendli.ai
- https://friendli.ai
- company/friendliai
- @friendliai
- @friendliai
Popular repositories Loading
-
friendli-client
friendli-client Public archive[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
-
-
-
Repositories
Showing 10 of 32 repositories
- homebrew-client Public
friendliai/homebrew-client’s past year of commit activity - friendli-client Public archive
[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
friendliai/friendli-client’s past year of commit activity - TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
friendliai/TensorRT-LLM’s past year of commit activity - design-token-transformer Public
friendliai/design-token-transformer’s past year of commit activity - sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
friendliai/sglang’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…