Text Classification
Transformers
ONNX
Safetensors
llama
safety
content-moderation
multi-label
multilingual
tiny-language-model
from-scratch
distilled
text-embeddings-inference
Instructions to use KucLab/Barist.3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KucLab/Barist.3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="KucLab/Barist.3")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("KucLab/Barist.3") model = AutoModelForSequenceClassification.from_pretrained("KucLab/Barist.3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download reports/external_eval.json from KucLab/Barist.3: direct link, hf CLI and curl.
- Browser
- Download file 1.41 kB
-
https://huggingface.co/KucLab/Barist.3/resolve/main/reports/external_eval.json
- Command line
-
hf download hf://KucLab/Barist.3/reports/external_eval.json
-
curl -L -o external_eval.json https://huggingface.co/KucLab/Barist.3/resolve/main/reports/external_eval.json
1.41 kB
| { | |
| "checkpoint": "checkpoints_b3e/best.pt", | |
| "device": "cuda", | |
| "results": { | |
| "toxigen_test": { | |
| "n": 940, | |
| "unsafe": 402, | |
| "at_0.5": { | |
| "threshold": 0.5, | |
| "accuracy": 0.6138297872340426, | |
| "precision": 0.5467625899280576, | |
| "recall": 0.5671641791044776, | |
| "f1": 0.5567765567765568, | |
| "tp": 228, | |
| "fp": 189, | |
| "tn": 349, | |
| "fn": 174, | |
| "total": 940 | |
| }, | |
| "best": { | |
| "threshold": 0.18, | |
| "accuracy": 0.5159574468085106, | |
| "precision": 0.4670807453416149, | |
| "recall": 0.9353233830845771, | |
| "f1": 0.6230323115161557, | |
| "tp": 376, | |
| "fp": 429, | |
| "tn": 109, | |
| "fn": 26, | |
| "total": 940 | |
| } | |
| }, | |
| "hatexplain_test": { | |
| "n": 1924, | |
| "unsafe": 1376, | |
| "at_0.5": { | |
| "threshold": 0.5, | |
| "accuracy": 0.5888773388773388, | |
| "precision": 0.6943521594684385, | |
| "recall": 0.7594476744186046, | |
| "f1": 0.7254425546685179, | |
| "tp": 1045, | |
| "fp": 460, | |
| "tn": 88, | |
| "fn": 331, | |
| "total": 1924 | |
| }, | |
| "best": { | |
| "threshold": 0.05, | |
| "accuracy": 0.7151767151767152, | |
| "precision": 0.7151767151767152, | |
| "recall": 1.0, | |
| "f1": 0.833939393939394, | |
| "tp": 1376, | |
| "fp": 548, | |
| "tn": 0, | |
| "fn": 0, | |
| "total": 1924 | |
| } | |
| } | |
| } | |
| } |