Semantic-Fleet 🚀

Overview

Semantic-Fleet is a repository designed to extend the capabilities of Semantic Kernel. It focuses on providing connectors to small large language models (e.g. Llamas), and to provide tools for distributing work to a fleet of models, with ChatGPT serving as the captain of the fleet. This repository is more than just a collection of existing connectors; it's a platform for future innovations in the .NET ecosystem for AI.

What's On Deck?

🤖 Oobabooga Connector

A robust connector that currently covers the main Oobabooga's specific blocking and streaming completion and chat APIs.

📖 Learn More:

• Installing Oobabooga and Configuring Multi-Start Scripts
• Oobabooga Connector Guide
• Don't forget to check-out notebooks. They provide a great overview of what's possible with our published connectors.

Installation

Install the package via NuGet:

dotnet add package MyIA.SemanticKernel.Connectors.AI.Oobabooga

In .Net interactive :

#r "nuget: MyIA.SemanticKernel.Connectors.AI.Oobabooga"

Quick Start

Different settings are used for text and chat completion, both in blocking and streaming modes. Here's a quick example for text completion:

var settings = new OobaboogaTextCompletionSettings(endpoint: new Uri("http://localhost/"),  blockingPort: 5000, streamingPort: 5005);
var oobabooga = new OobaboogaTextCompletion(settings);

// Get text completions
var completions = await oobabooga.GetCompletionsAsync("Hello, world!", new CompleteRequestSettings());

🌐 MultiConnector

Why stick to one when you can have many? MultiConnector lets you integrate multiple LLMs seamlessly.

📖 Learn More: MultiConnector Guide

📚 Notebooks

Want a overview of what's possible with our published connectors? Our .Net interactive notebooks are a great place to start.

📖 Learn More: Notebooks Guide

Future Directions

• Open AI API: Oobabooga offers a dedicated extension mimicking Open AI API. It extends support to embeddings and image generation models. This will be available as a separate package.
• Probabilistic MultiConnector: We will be adding some Infer.Net magic to make MultiConnector even smarter. More specifically, the following examples will be merged and integrated into the model vetting process.
  • Student Skills
  • Assessing People's Skills
  • Difficulty vs Ability
  • Calibrating reviews
• Spark.Net Integration: Get ready to host a cluster of mini local LLMs.

NuGet Packages

Here is the Nuget Package for Oobabooga connector

We'll be providing NuGet packages for both the Oobabooga Connector and MultiConnector for easier integration into your projects.

🤝 Contributing

Got something to add? We'd love to see it. Check out our contributing guidelines.

Got something you'd like to get added? Do you want those future features already? We'd love you to get in touch !