Skill detail

nemo-curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs wit...

Rank: #427
Trend: 1
Growth: 0
Updated week: 2026-06-17

Collected description

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs wit...

Source coverage

Total: 1
ClawHub: 0
Hermes: 1
GitHub: 0

Source details

hermes_hub

nemo-curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs wit...

Open source

Index metadata

Category: mlops

Static data

Detail JSON: Open detail JSON
Timeseries JSON: Open timeseries JSON

Related skills