Repositories list

• MinerU

  Public
  A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。

  pythonpdfparser+ 10ocrpdf-converterextract-datadocument-analysispdf-parserlayout-analysisai4science+ 3

  Python

  •

  GNU Affero General Public License v3.0

  •3.2k•39k•113•6•Updated Jul 8, 2025Jul 8, 2025

• Vis3

  Public
  OSS browser based on s3. 一个基于 S3 的数据（json / jsonl / html / md等）可视化工具。👇 Try online.

  s3interactive-data-visualizations3browser+ 7s3-file-browsers3-visulizationaliyun-oss-browserjson-data-viewerlarge-language-model-data-toolmachine-learning-data-visualizationvisualize-jsonl-files-in-cloud

  TypeScript

  •

  Apache License 2.0

  •4•36•0•1•Updated Jul 8, 2025Jul 8, 2025

• labelU

  Public
  Data annotation toolbox supports image, audio and video data.

  Python

  •

  Apache License 2.0

  •132•1.3k•23•1•Updated Jul 8, 2025Jul 8, 2025

• labelU-Kit

  Public
  Data annotation component library --provided as NPM packages

  TypeScript

  •

  Apache License 2.0

  •35•111•2•1•Updated Jul 8, 2025Jul 8, 2025

• OmniDocBench

  Public
  [CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation

  Python

  •

  Apache License 2.0

  •50•590•31•2•Updated Jul 4, 2025Jul 4, 2025

• awesome-markdown-ebooks

  Public
  2•4•0•0•Updated Jul 2, 2025Jul 2, 2025

• opendatalab-datasets

  Public
  datasets resource

  11•117•3•0•Updated Jul 1, 2025Jul 1, 2025

• .github

  Public
  2•1•0•0•Updated Jul 1, 2025Jul 1, 2025

• OHR-Bench

  Public
  (ICCV 2025) OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation

  Python

  •12•79•1•0•Updated Jul 1, 2025Jul 1, 2025

• skydiffusion

  Public
  [ICCV 2025] The official implementation of the paper “Street-to-Satellite Image Synthesis with Diffusion Models and BEV Paradigm”

  Python

  •

  Apache License 2.0

  •2•56•4•0•Updated Jun 27, 2025Jun 27, 2025

• UniMERNet

  Public
  UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition

  Python

  •

  Apache License 2.0

  •31•374•23•2•Updated Jun 16, 2025Jun 16, 2025

• Meta-rater

  Public
  [ACL 2025] This is the official implementation for the paper: "Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models"

  Python

  •0•4•0•0•Updated Jun 15, 2025Jun 15, 2025

• LEGION

  Public
  The official implementation of the paper "LEGION: Learning to Ground and Explain for Synthetic Image Detection"

  Python

  •4•42•4•0•Updated Jun 11, 2025Jun 11, 2025

• FakeVLM

  Public
  FakeVLM: Advancing Synthetic Image Detection through Explainable Multimodal Models and Fine-Grained Artifact Analysis

  Python

  •

  Apache License 2.0

  •2•54•6•0•Updated Jun 11, 2025Jun 11, 2025

• ProverGen

  Public
  [ICLR 2025] This is the official implementation for the paper: "Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation"

  Python

  •4•29•0•0•Updated Jun 11, 2025Jun 11, 2025

• opendatalab.github.io

  Public
  HTML

  •0•0•0•0•Updated May 16, 2025May 16, 2025

• PM4Bench

  Public
  Python

  •0•13•0•0•Updated May 16, 2025May 16, 2025

• GRAIT

  Public
  [NAACL25 findings] Gradient-Driven Refusal-Aware Instruction Tuning for Effective Hallucination Mitigation

  Python

  •0•1•0•0•Updated Apr 28, 2025Apr 28, 2025

• DocLayout-YOLO

  Public
  DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception

  Python

  •

  GNU Affero General Public License v3.0

  •113•1.4k•27•3•Updated Apr 14, 2025Apr 14, 2025

• UrBench

  Public
  [AAAI 2025]This repo contains evaluation code for the paper “UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios”

  benchmarkremote-sensingllama+ 4lmmsvlmurbanllava

  Python

  •

  Other

  •5•31•1•0•Updated Apr 10, 2025Apr 10, 2025

• OpenHuEval

  Public
  Python

  •

  Apache License 2.0

  •0•7•1•0•Updated Mar 31, 2025Mar 31, 2025

• LOKI

  Public
  [ICLR 2025 Spotlight] The official implementation of the paper “LOKI：A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models”

  Python

  •4•154•1•0•Updated Mar 31, 2025Mar 31, 2025

• magic-html

  Public
  Python

  •

  Apache License 2.0

  •40•476•9•0•Updated Mar 13, 2025Mar 13, 2025

• VHM

  Public
  VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis

  Python

  •

  Apache License 2.0

  •6•92•0•0•Updated Feb 19, 2025Feb 19, 2025

• LabelLLM

  Public
  The Open-Source Data Annotation Platform

  TypeScript

  •

  Apache License 2.0

  •91•865•14•1•Updated Feb 19, 2025Feb 19, 2025

• WanJuan3.0

  Public
  WanJuan3.0（“万卷·丝路”）一个作为综合性的纯文本语料库，采集了多个国家地区的网络公开信息、文献、专利等资料，数据总规模超1.2TB，Token总数超过300B，处于国际领先水平，首期开源的语料库主要由泰语、俄语、阿拉伯语、韩语和越南语5个子集构成，每个子集的数据规模均超过150GB

  MIT License

  •1•30•0•0•Updated Feb 13, 2025Feb 13, 2025

• PDF-Extract-Kit

  Public
  A Comprehensive Toolkit for High-Quality PDF Content Extraction

  Python

  •

  GNU Affero General Public License v3.0

  •593•8.1k•87•9•Updated Jan 3, 2025Jan 3, 2025

• CRaFT

  Public
  [AAAI25] Certainty Represented Knowledge Flow for Refusal-Aware Instruction Tuning

  Python

  •0•4•0•0•Updated Jan 1, 2025Jan 1, 2025

• Miner-PDF-Benchmark

  Public archive
  MPB (Miner-PDF-Benchmark) is an end-to-end PDF document comprehension evaluation suite designed for large-scale model data scenarios.

  Python

  •

  Apache License 2.0

  •5•23•0•0•Updated Dec 11, 2024Dec 11, 2024

• CLIP-Parrot-Bias

  Public
  ECCV2024_Parrot Captions Teach CLIP to Spot Text

  Python

  •

  Apache License 2.0

  •1•66•3•0•Updated Sep 6, 2024Sep 6, 2024