File size: 632 Bytes
cb426b9
b485a88
 
 
 
cb426b9
b485a88
 
 
cb426b9
 
b485a88
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
title: ModelBrew Dataset Cleaner
emoji: 🧹
colorFrom: yellow
colorTo: red
sdk: static
app_file: index.html
license: apache-2.0
short_description: 90+ quality checks for fine-tuning datasets
---

# ModelBrew Dataset Cleaner

Upload a fine-tuning dataset (`.jsonl`, `.json`, `.csv`) and get a scored issue
report — PII with checksum validation, exact/near duplicates, prompt-injection
and jailbreak patterns, label errors, truncated responses, and more — plus a
cleaned export with critical rows dropped.

Run it locally on datasets of any size: `pip install modelbrew-cleaner`.

Built by [ModelBrew](https://modelbrew.ai).