🧹 ModelBrew Dataset Cleaner
90+ quality checks for fine-tuning datasets: PII with real checksum validation, exact/near duplicates, prompt-injection & jailbreak patterns, label errors, truncated responses, and more. Free and open source.
Clean your dataset in the browser → GitHubOr in your pipeline
pip install modelbrew-cleaner
from modelbrew_cleaner import clean_file, issue_summary, export_clean
rows = clean_file("train.jsonl") # .jsonl, .json, or .csv
print(issue_summary(rows)) # {summary}
cleaned = export_clean(rows) # critical rows dropped
Real output — the bundled dirty sample ({len(rows)} rows)
This report is generated by actually running the cleaner on sample.jsonl at build time — {summary['critical']} critical / {summary['warning']} warnings / {summary['suggestion']} suggestions; {n_critical_rows} rows dropped from the cleaned export.
| row | severity | check | message | auto-fix |
|---|
Why we built it
We work on fine-tuning without catastrophic forgetting (patent-pending CRMA adapters). Measuring forgetting honestly forced us to fix our data first — in our measurements, dataset confounds alone accounted for a 96.9-percentage-point swing in measured forgetting. Read: Your forgetting benchmark is lying to you · Browse the forgetting leaderboard.