dataset-cleaner / README.md
Model-Brew's picture
cleaner showcase v1: static build, real sample report; gradio app kept for PRO upgrade
b485a88 verified
|
Raw
History Blame Contribute Delete
632 Bytes
metadata
title: ModelBrew Dataset Cleaner
emoji: 🧹
colorFrom: yellow
colorTo: red
sdk: static
app_file: index.html
license: apache-2.0
short_description: 90+ quality checks for fine-tuning datasets

ModelBrew Dataset Cleaner

Upload a fine-tuning dataset (.jsonl, .json, .csv) and get a scored issue report — PII with checksum validation, exact/near duplicates, prompt-injection and jailbreak patterns, label errors, truncated responses, and more — plus a cleaned export with critical rows dropped.

Run it locally on datasets of any size: pip install modelbrew-cleaner.

Built by ModelBrew.