这是indexloc提供的服务，不要输入任何密码
Skip to content

Releases: NVIDIA-NeMo/Curator

NVIDIA NeMo Curator 0.8.0

09 May 01:11
@ryantwolf ryantwolf
v0.8.0
cf12d34
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.8.0 Latest
Latest
  • Llama Based PII Redaction
  • Trafilatura Text Extractor
  • Chinese & Japanese Stopwords for Text Extractors
  • Writing gzip compressed jsonl datasets
  • Training dataset curation for retriever customization using hard-negative mining
  • Implemented a memory efficient pairwise similarity in Semantic Deduplication
Assets 2
Loading

NVIDIA NeMo Curator 0.8.0rc3.dev0

15 Apr 19:44
@ryantwolf ryantwolf
v0.8.0rc3.dev0
cff3cb6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.8.0rc3.dev0 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.8.0rc3.dev0 (2025-04-15)

Loading

NVIDIA NeMo Curator 0.8.0rc2.dev0

07 Apr 20:15
@ryantwolf ryantwolf
v0.8.0rc2.dev0
8cbd68f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.8.0rc2.dev0 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.8.0rc2.dev0 (2025-04-07)

Loading

NVIDIA NeMo Curator 0.7.1

31 Mar 22:52
@ryantwolf ryantwolf
v0.7.1
d0cc62d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.7.1
  • Fix Transformers + Cuda Context bug
  • Fix rate limit in SDG Retriever Eval Tutorial
Loading

NVIDIA NeMo Curator 0.7.0

12 Mar 21:22
@ryantwolf ryantwolf
v0.7.0
f207c99
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.7.0
  • Python 3.12 Support
  • Curator on Blackwell
  • Nemotron-CC Dataset Recipe
  • Performant S3 for Fuzzy Deduplication
Loading

NVIDIA NeMo Curator 0.7.0rc2.dev0

25 Feb 13:12
@ryantwolf ryantwolf
v0.7.0rc2.dev0
6a05d29
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.7.0rc2.dev0 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.7.0rc2.dev0 (2025-02-25)

Loading

NVIDIA NeMo Curator 0.7.0rc1.dev1

19 Feb 18:21
@ryantwolf ryantwolf
v0.7.0rc1.dev1
c3ebcb5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.7.0rc1.dev1 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.7.0rc1.dev1 (2025-02-19)

Loading

NVIDIA NeMo Curator 0.7.0rc0.dev1

04 Feb 21:41
@ko3n1g ko3n1g
v0.7.0rc0.dev1
7ab04ce
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.7.0rc0.dev1 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.7.0rc0.dev1 (2025-02-04)

Loading

NVIDIA NeMo Curator 0.6.0

07 Jan 15:41
@ryantwolf ryantwolf
v0.6.0
4f25a91
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.6.0

What's changed

  • Synthetic Data Generation for Text Retrieval
    • LLM-based Filters
      • Easiness
      • Answerability
    • Q&A Retrieval Generation Pipeline
  • Parallel Dataset Curation for Machine Translation
    • Load/Write Bitext Files
    • Heuristic filtering (Histogram, Length Ratio)
    • Classifier filtering (Comet, Cometoid)
Loading

NVIDIA NeMo Curator 0.6.0rc2.dev1

03 Jan 21:38
@ryantwolf ryantwolf
v0.6.0rc2.dev1
5a3c047
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
NVIDIA NeMo Curator 0.6.0rc2.dev1 Pre-release
Pre-release

Prerelease: NVIDIA NeMo Curator 0.6.0rc2.dev1 (2025-01-03)

Loading