In this lab, you will fine-tune a multi-billion parameter language model to generate specific style responses. You'll work with tokenization strategies, prompt templates, and a complete fine-tuning workflow to enhance LLM outputs. 🐙✨
Prompt Optimizer enhances your prompts for better results in AI applications. Join the community on GitHub and contribute to improving prompt efficiency! 🌟🌐
大语言模型评估平台，支持多种评估基准、自定义数据集和性能测试。
PrometheusLLM is a unique transformer architecture inspired by dignity and recursion. This project aims to explore new frontiers in AI research and welcomes contributions from the community. 🐙🌟
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
The open LLM Ops platform - Traces, Analytics, Evaluations, Datasets and Prompt Optimization ✨
Mitosis: A Unified Transport Evaluation Framework
Open-source framework for defining Page Language Models (PLMs) for intelligent app understanding and AI-assisted testing.
This repository contains automated tests using Karate Test Automation. The tests include scenarios for validating different pages and actions on the NASA Hubble Mission website and image download functionality.
xVerify: Efficient Answer Verifier for Large Language Model Evaluations
Automated testing tool designed for developers to quickly and efficiently test their own code. Simplifies the process of checking for bugs and errors in software projects.
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
Explore the SE-TESTING repository for comprehensive labs and activities in software testing. Collaborate and enhance your skills with practical examples. 🛠️🌟
Building blocks for rapid development of GenAI applications
Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
A Lévy-optimal lambda calculus reducer with a backdoor to C
A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
Add a description, image, and links to the evaluation topic page so that developers can more easily learn about it.
To associate your repository with the evaluation topic, visit your repo's landing page and select "manage topics."