AG-UI: the Agent-User Interaction Protocol. Bring Agents into Frontend Applications.

React UI + elegant infrastructure for AI Copilots, AI chatbots, and in-app AI agents. The Agentic last-mile 🪁

Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message…

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

🧪 Experimental features for Haystack

Embeddable Postgres with real-time, reactive bindings.

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

A language for constraint-guided and efficient LLM programming.

👩🏻‍🍳 A collection of example notebooks using Haystack

Automatically generate comprehensive Pull Request descriptions with LLMs

Easily deploy Haystack pipelines as REST APIs and MCP Tools.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Enforce the output format (JSON Schema, Regex etc) of a language model

Go ahead and axolotl questions

Efficient Retrieval Augmentation and Generation Framework

🚀 A list of Haystack Integrations, maintained by the community or deepset.

[EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

🚀 This repo is a showcase of how you can use models deployed on AWS SageMaker in your Haystack Retrieval Augmented Generative AI pipelines

Build Conversational AI in minutes ⚡️

Forward-Looking Active REtrieval-augmented generation (FLARE)

Unofficial python bindings for the rust llm library. 🐍❤️🦀

Using Llama2 with Haystack, the NLP/LLM framework.

A bot to post our AWS bill to Slack and start conversations about our cloud costs 💸

Send a daily AWS cost report to a Slack channel of your choice.

A Python SDK to interact with deepset Cloud

PostgreSQL database adapter for the Python programming language

Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat customer documentation assets.