Repositories list

• lm-evaluation-harness

  Public
  A framework for few-shot evaluation of language models.

  Python

  •

  MIT License

  •2.6k•0•0•4•Updated Jul 21, 2025Jul 21, 2025

• fm-service

  Public
  newer llm service

  JavaScript

  •1•0•0•0•Updated Jul 19, 2025Jul 19, 2025

• mmore

  Public
  Massive Multimodal Open RAG & Extraction A scalable multimodal pipeline for processing, indexing, and querying multimodal documents Ever needed to take 8000 PDFs, 2000 videos, and 500 spreadsheets and feed them to an LLM as a knowledge base? Well, MMORE is here to help you!

  Python

  •

  Apache License 2.0

  •17•47•27•9•Updated Jul 19, 2025Jul 19, 2025

• Scratchpad

  Public
  LLM Serving Engine

  Python

  •3•0•0•0•Updated Jul 19, 2025Jul 19, 2025

• hfconverter

  Public
  Shell

  •0•1•0•0•Updated Jul 18, 2025Jul 18, 2025

• olmes

  Public
  Reproducible, flexible LLM evaluations

  Python

  •

  Apache License 2.0

  •37•0•0•0•Updated Jul 16, 2025Jul 16, 2025

• transformers

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •30k•0•0•1•Updated Jul 16, 2025Jul 16, 2025

• Megatron-LM

  Public
  Ongoing research training transformer models at scale

  Python

  •

  Other

  •2.9k•4•6•15•Updated Jul 15, 2025Jul 15, 2025

• nanotron-multilingual

  Public
  A copy of nanotron for multilingual training

  Python

  •

  Apache License 2.0

  •207•0•0•2•Updated Jul 14, 2025Jul 14, 2025

• mergekit

  Public
  Tools for merging pretrained large language models.

  Python

  •

  Other

  •581•0•0•0•Updated Jul 9, 2025Jul 9, 2025

• model-spinning

  Public
  Python

  •0•1•0•0•Updated Jul 9, 2025Jul 9, 2025

• reasoning_getting-started

  Public
  Shell

  •0•1•0•0•Updated Jun 26, 2025Jun 26, 2025

• vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •8.8k•0•0•0•Updated Jun 25, 2025Jun 25, 2025

• sglang

  Public
  SGLang is a fast serving framework for large language models and vision language models.

  Python

  •

  Apache License 2.0

  •2.4k•0•0•0•Updated Jun 25, 2025Jun 25, 2025

• modern_rnns

  Public
  Python

  •0•0•0•0•Updated Jun 16, 2025Jun 16, 2025

• sampler

  Public
  Sampling data distributions from various methods for LLM training

  Python

  •0•0•0•0•Updated Jun 14, 2025Jun 14, 2025

• patho-ssl-data-curation

  Public
  Python

  •0•1•0•0•Updated Jun 2, 2025Jun 2, 2025

• dsl25-7-center-bot

  Public
  Python

  •0•0•0•0•Updated May 30, 2025May 30, 2025

• dsl25-8-llm-programs

  Public
  DataSc Lab Spring 2025: LLM Programs Blueprints

  Jupyter Notebook

  •

  MIT License

  •0•0•15•2•Updated May 26, 2025May 26, 2025

• alps-job-visualisation-tool

  Public
  A tool designed to record and visualize hardware metrics of nodes used in a SLURM job. It provides various graphs to help detect anomalies and identify potential issues in node performance.

  performance-monitoringhpc-clustershardware-information

  Python

  •

  MIT License

  •0•0•0•0•Updated May 25, 2025May 25, 2025

• llm-proxy

  Public
  LLM Serving and User Control

  HTML

  •2•0•0•0•Updated May 4, 2025May 4, 2025

• nanotron-ml

  Public
  Minimalistic large language model 3D-parallelism training

  Python

  •

  Apache License 2.0

  •207•0•0•0•Updated Apr 22, 2025Apr 22, 2025

• data-PDF-pipeline

  Public
  PDF pipeline for creating training corpora (mainly for llm, multimodal and alignment horizontals)

  Python

  •

  Apache License 2.0

  •0•4•0•0•Updated Apr 3, 2025Apr 3, 2025

• lighteval

  Public
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

  Python

  •

  MIT License

  •312•0•0•0•Updated Jan 13, 2025Jan 13, 2025

• ethel-tutor-eval

  Public
  Jupyter Notebook

  •

  Apache License 2.0

  •0•0•0•0•Updated Dec 19, 2024Dec 19, 2024

• nanotron

  Public
  Minimalistic large language model 3D-parallelism training

  Python

  •

  Apache License 2.0

  •207•6•1•9•Updated Dec 2, 2024Dec 2, 2024

• containers

  Public
  Containers for multimodal initiative (and maybe more across Swiss AI?)

  Dockerfile

  •0•0•0•0•Updated Nov 29, 2024Nov 29, 2024

• ml-4m

  Public
  4M: Massively Multimodal Masked Modeling (NeurIPS 2023 Spotlight)

  Python

  •

  Apache License 2.0

  •108•0•13•4•Updated Nov 29, 2024Nov 29, 2024

• data-tooling

  Public
  Tool set for data preparation and selection in the context of Swiss-AI (forked from DataTrove)

  Python

  •

  Apache License 2.0

  •194•0•0•1•Updated Nov 21, 2024Nov 21, 2024

• llm-pretrain-data-toxicity-removal

  Public
  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Nov 6, 2024Nov 6, 2024