🤗 Benchmark Large Language Models Reliably On Your Data

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

All-in-one text de-duplication

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

Inference code for Mistral and Mixtral hacked up into original Llama implementation

Unoffical Dalle3 API using selenium.

Fast and memory-efficient exact attention

Tools for merging pretrained large language models.

Go ahead and axolotl questions

Scrape and export data from the Open LLM Leaderboard.

Biz Lingua takımı olarak doğal dil işleme alanında çalışıyoruz. Amacımız, Türkçe dil kaynaklarını geliştirmek ve Teknofest gibi yarışmalarda başarılı olmak.