multimodal

Here are 1,422 public repositories matching this topic...

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

mcp web-scraping no-code ai-agents kimi multimodal rag moonshot vector-database llm localai local-llm ollama lmstudio deepseek llama3 custom-ai-agents mcp-servers qwen3

Updated Oct 10, 2025
JavaScript

haotian-liu / LLaVA

Star

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

chatbot llama multimodal multi-modality gpt-4 foundation-models visual-language-learning chatgpt instruction-tuning vision-language-model llava llama2 llama-2

Updated Aug 12, 2024
Python

microsoft / unilm

Star

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Updated Jul 3, 2025
Python

jina-ai / serve

Star

☁️ Build multimodal AI applications with cloud-native stack

Updated Mar 24, 2025
Python

bytedance / UI-TARS-desktop

Star

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

agent mcp vision vlm tars multimodal computer-use mcp-server gui-agent browser-use gui-operator ui-tars agent-tars

Updated Oct 11, 2025
TypeScript

deepseek-ai / Janus

Star

Janus-Series: Unified Multimodal Understanding and Generation Models

multimodal unified-model any-to-any foundation-models llm vision-language-pretraining

Updated Feb 1, 2025
Python

NVIDIA-NeMo / NeMo

Star

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

machine-translation tts speech-synthesis neural-networks deeplearning speaker-recognition asr multimodal speech-translation large-language-models speaker-diariazation generative-ai

Updated Oct 11, 2025
Python

mediar-ai / screenpipe

Star

AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording

machine-learning ai computer-vision ml agi vision agents multimodal llm

Updated Sep 1, 2025
TypeScript

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, Phi4, ...) (AAAI 2025).

Updated Oct 11, 2025
Python

rerun-io / rerun

Star

Visualize streams of multimodal data. Free, fast, easy to use, and simple to integrate. Built in Rust.

visualization python rust computer-vision cpp robotics multimodal

Updated Oct 12, 2025
Rust

apache / seatunnel

Star

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

streaming real-time offline high-performance apache embeddings batch data-integration elt cdc change-data-capture data-ingestion multimodal llm

Updated Oct 12, 2025
Java

bentoml / BentoML

Star

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai llmops llm-serving model-inference-service llm-inference inference-platform

Updated Oct 10, 2025
Python

SkalskiP / courses

Sponsor

Star

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

nlp machine-learning natural-language-processing tutorial deep-neural-networks computer-vision deep-learning transformers generative-model multimodal mlops stable-diffusion

Updated Apr 22, 2024
Python

swyxio / ai-notes

Star

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

ai openai gpt multimodal gpt-3 prompt-engineering stable-diffusion