+
Skip to content

@LLMNexus LLMNexus

Change the repository type filter

All

    Repositories list

    42 repositories

    • LLMs-from-scratch

      Public
      Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
      Jupyter Notebook
      •
      Other
      •11k•0•0•0•Updated Sep 17, 2025Sep 17, 2025

    • GOT-OCR2.0

      Public
      Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
      Python
      •694•0•0•0•Updated Jan 23, 2025Jan 23, 2025

    • llm-awq

      Public
      [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
      Python
      •
      MIT License
      •274•0•0•0•Updated Jan 8, 2025Jan 8, 2025

    • Awesome-LLM-Strawberry

      Public
      A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.
      Apache License 2.0
      •376•0•0•0•Updated Jan 4, 2025Jan 4, 2025

    • CAG

      Public
      Cache-Augmented Generation
      Python
      •
      MIT License
      •208•0•0•0•Updated Jan 3, 2025Jan 3, 2025

    • mlc-llm

      Public
      Universal LLM Deployment Engine with ML Compilation
      Python
      •
      Apache License 2.0
      •1.8k•0•0•0•Updated Dec 28, 2024Dec 28, 2024

    • awesome-llm-apps

      Public
      Collection of awesome LLM apps with RAG using OpenAI, Anthropic, Gemini and opensource models.
      Python
      •
      Apache License 2.0
      •9.3k•0•0•0•Updated Dec 23, 2024Dec 23, 2024

    • SPaR

      Public
      Python
      •
      Apache License 2.0
      •3•0•0•0•Updated Dec 17, 2024Dec 17, 2024

    • kvpress

      Public
      LLM KV cache compression made easy
      Python
      •
      Apache License 2.0
      •71•0•0•0•Updated Dec 9, 2024Dec 9, 2024

    • nano-sparse-attention

      Public
      The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
      Jupyter Notebook
      •6•0•0•0•Updated Nov 19, 2024Nov 19, 2024

    • LLMSuperWeight

      Public
      Code for studying the super weight in LLM
      Jupyter Notebook
      •13•0•0•0•Updated Nov 11, 2024Nov 11, 2024

    • spiritlm

      Public
      Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
      Python
      •
      Other
      •63•0•0•0•Updated Oct 24, 2024Oct 24, 2024

    • MMLU-Pro

      Public
      The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]
      Python
      •
      Apache License 2.0
      •47•0•0•0•Updated Oct 22, 2024Oct 22, 2024

    • Aria

      Public
      Codebase for Aria - an Open Multimodal Native MoE
      Jupyter Notebook
      •
      Apache License 2.0
      •86•0•0•0•Updated Oct 16, 2024Oct 16, 2024

    • tensorrtllm_backend

      Public
      The Triton TensorRT-LLM Backend
      Python
      •
      Apache License 2.0
      •132•0•0•0•Updated Oct 15, 2024Oct 15, 2024

    • TensorRT-LLM

      Public
      TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
      C++
      •
      Apache License 2.0
      •1.8k•0•0•0•Updated Oct 15, 2024Oct 15, 2024

    • Awesome-LLM

      Public
      Awesome-LLM: a curated list of Large Language Model
      Creative Commons Zero v1.0 Universal
      •2.1k•0•0•0•Updated Oct 14, 2024Oct 14, 2024

    • llm.c

      Public
      LLM training in simple, raw C/CUDA
      Cuda
      •
      MIT License
      •3.2k•0•0•0•Updated Oct 11, 2024Oct 11, 2024

    • Open-O1

      Public
      Apache License 2.0
      •54•0•0•0•Updated Oct 6, 2024Oct 6, 2024

    • embeddedllm

      Public
      EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
      Python
      •1•0•0•0•Updated Oct 6, 2024Oct 6, 2024

    • OpenStrawberry

      Public
      An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
      Python
      •
      MIT License
      •6•0•0•0•Updated Sep 30, 2024Sep 30, 2024

    • Awesome-LLM-Compression

      Public
      Awesome LLM compression research papers and tools.
      MIT License
      •107•0•0•0•Updated Sep 30, 2024Sep 30, 2024

    • MRAG

      Public
      Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
      Python
      •
      Other
      •23•0•0•0•Updated Sep 30, 2024Sep 30, 2024

    • CheckEmbed

      Public
      Official Implementation of "CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks"
      Python
      •
      Other
      •3•0•0•0•Updated Sep 27, 2024Sep 27, 2024

    • LongWriter

      Public
      LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
      Python
      •
      Apache License 2.0
      •177•0•0•0•Updated Sep 27, 2024Sep 27, 2024

    • graph-of-thoughts

      Public
      Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
      Python
      •
      Other
      •185•0•0•0•Updated Sep 25, 2024Sep 25, 2024

    • Awesome-Efficient-LLM

      Public
      A curated list for Efficient Large Language Models
      Python
      •145•0•0•0•Updated Sep 21, 2024Sep 21, 2024

    • quivr

      Public
      Open-source RAG Framework for building GenAI Second Brains 🧠 Build productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Efficient retrieval augmented generation framework
      Python
      •
      Other
      •3.7k•0•0•0•Updated Sep 13, 2024Sep 13, 2024

    • OpenLLM

      Public
      Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
      Python
      •
      Apache License 2.0
      •781•0•0•0•Updated Sep 9, 2024Sep 9, 2024

    • Awesome-Code-LLM

      Public
      [TMLR] A curated list of language modeling researches for code and related datasets.
      193•0•0•0•Updated Sep 9, 2024Sep 9, 2024
    点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载