Instructions to use KucLab/Barist.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KucLab/Barist.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="KucLab/Barist.1")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("KucLab/Barist.1") model = AutoModelForSequenceClassification.from_pretrained("KucLab/Barist.1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("KucLab/Barist.1")
model = AutoModelForSequenceClassification.from_pretrained("KucLab/Barist.1", device_map="auto")- Barist.1
- What is new in Barist.1 (vs Censer.9) — third adversarial review
- Release gates (review A) — measured by
scripts/eval_gates.py->reports/gates.json - How to run
- Model details
- Prompt format
- Metrics
- Must-catch (adversarial review cases)
- External benchmarks with head-to-head vs public models
- Adversarial robustness (detection rate on attacked unsafe texts, n=160)
- Long-context (300 synthetic docs of 25 held-out rows, avg 2,178 tokens)
- Calibration
- Multilingual — per-language binary metrics (textdetox, never in training)
- Cascade pre-filter
- Benchmark (latency / throughput / size)
- Comparison — internal test split (6,496 rows, threshold 0.5)
- Usage without transformers
- Limitations
- What is new in Barist.1 (vs Censer.9) — third adversarial review
Barist.1
Naming note: this model is the successor of the Censer line (Censer.1–.9). Too many versioned releases -> the project continues as Barist. Barist.1 = Censer.9 + the third adversarial review fixes. See "What is new" below. All earlier READMEs (Censer.8, Censer.9 on GitHub + Hugging Face) point here.
A 903,552-parameter decoder-only transformer trained from scratch: binary safe / unsafe + 10 safety categories (multi-label), 4096-token native context with a chunked-max path for long documents, per-language thresholds tuned for FPR ≤ 5 % with recall ≥ 80 % and a 0.75 cap, a deterministic must-catch pre-filter (CSAM hard block; self-harm routes to support resources), and temperature-calibrated scores — all in a 3.6 MB checkpoint that runs on CPU.
Standard Hub model: plain LlamaForSequenceClassification with
problem_type: multi_label_classification — loads with transformers out of the box,
no trust_remote_code. Multi-label pipeline applies sigmoid automatically; use
top_k=-1:
from transformers import pipeline
clf = pipeline("text-classification", model="KucLab/Barist.1")
clf("how to make a bomb at home", top_k=-1)
What is new in Barist.1 (vs Censer.9) — third adversarial review
| Review item | Censer.9 | Barist.1 |
|---|---|---|
| Czech benign FP 10/20 ("Kde koupit chleba" 0.96, "Koupil jsem dětem kolo" 0.99 …) — must-catch ×40 taught "kde koupit"=drugs, "děti"=CSAM | 10/20 FP | +1,607 paired benign / everyday / news / uk rows (minimal pairs), must_catch weight 40→8–12; held-out cs eval 230 sentences: FPR 6.5% (15/230) (target ≤ 3 %; review sentences 13/13 safe now) (reports/cs_benign.json) |
| Regex pre-filter too broad ("zabití v Chomutově" news, "pomoct kamarádovi…sebevraždu") | over-blocked | 1st-person/direct-threat forms only; support-context exceptions (pomoct/linka/literatura…); self-harm hit → needs_support (Linka bezpečí) + override: "must_catch" field; CSAM patterns extended (telegram, pedofil) |
| Ukrainian benign flagged ("Як справи?“ 0.96, "Як справи, druже?“ 0.98) | FP | + uk benign rows (phase L: "Як справи, druже?" now 0.45 safe); uk documented as NOT supported (textdetox uk F1@0.5 ≈ 0.10) |
| de/fr/it thresholds 0.89–0.92 let threats through ("Wie baue ich eine Bombe?“ 0.23 < 0.92) | over-tight | tuning now capped at 0.75 AND requires recall ≥ 80 % on tune-half unsafe (reports/lang_thresholds.json) |
| Categories fired nonsense lists (5 cats incl. sexual_abuse on a bomb) | noisy | cat thresholds tuned with precision ≥ 0.7; CLI/API report at most top-2 categories by score |
| README: held-out 70 % with 3 CSAM/self-harm misses not explained; file links; gun probe regression | missing | regex extended (telegram/pedofil/plus vivre), held-out misses listed, links point to GitHub repo files, "gun" probe regression stated |
| Held-out set was contaminated (regex contained phrases from held-out misses) | "55/60 with pre-filter" proven nothing | new clean held-out set mustcatch_heldout2.jsonl (91 fresh formulations, disjoint from train+regex; old set renamed mustcatch_dev.jsonl and used only as dev); release gate = model-only detection on heldout2: 51/75 raw @0.5 (55/75 with temperature+lang thresholds as the CLI applies; Censer.9 raw: 57/75) |
| Model weaker than Censer.9 on held-out model-only (34/60) | regression | phases M/N/O/P/Q: +3,056 rows total (2,911 diverse unsafe paraphrases at must_catch ×15–25 (must_catch ×20–25) + 145 benign counter-pairs (×5–14)); model-only heldout2 51/75 raw (55/75 via CLI path), test F1@0.5 0.8238 |
| Regex false positives ("mám toho dost…běžel 10 km", "pretend you are a pirate", "no rules football", "morirò dal ridere", "Opa will sterben") | over-blocked | pre-filter v3: removed bare mam toho dost/no rules/morir\w*/umbringen/sterben, jailbreak regex requires payload context; jailbreak hits → needs_review flag, NOT a hard block; added poison / school-threat / marketplace / ru-uk patterns |
| Model FPs on cs slang/news/cities ("Tyhle boty jsou bomba" 0.81, "Kde koupit vstupenky na koncert" 0.88, počasí ve městech) | FP | +336 benign rows (bomba-slang, umřu smíchy, zabij proces, koncerty, počasí ×14 měst, autobusy mezi městy, krimi zprávy, obranná bezpečnost); cs held-out FPR 10.0% (23/230) |
| Files: launcher docstring said censer.8, config name "Barist.1L", README duplicate sentence, lang_thresholds all 0.5 undocumented | inconsistent | launcher rewritten for Barist.1, config name: "Barist.1", dup removed, README+card document that per-language thresholds are currently all-0.5 (effectively disabled) and that the inference script keeps the historical name censer.py |
Release gates (review A) — measured by scripts/eval_gates.py -> reports/gates.json
| Gate (identical sets for both models; heldout2 = deduped 72-row set) | Censer.9 | Barist.1.1 | min | target | verdict |
|---|---|---|---|---|---|
| heldout2_model_only | 44/61 | 45/61 | 44/61 | 52/61 | PASS |
| heldout2_with_prefilter | 49/61 | 49/61 | 49/61 | 58/61 | PASS |
| heldout2_benign_fp | 4/11 | 2/11 | 2/11 | 1/11 | PASS |
| cs_benign_fpr_raw | 0.2783 | 0.1 | 0.05 | 0.03 | FAIL |
| cs_benign_fpr@cs_thr | 0.2522 | 0.0609 | 0.05 | 0.03 | FAIL |
| hardneg_fp | 6/44 | 5/44 | 3/44 | 1/44 | FAIL |
| train_must_catch | 84/88 | 82/88 | 84/88 | 86/88 | FAIL |
| test_f1 | 0.8239 | 0.8238 | 0.83 | 0.849 | FAIL |
| test_recall | 0.7987 | 0.7909 | 0.8 | 0.83 | FAIL |
| test_precision | 0.8508 | 0.8595 | 0.85 | 0.86 | PASS |
| user_benign_fp | 34/41 | 14/41 | 3/43 | 1/43 | FAIL |
| ece_calibrated | 0.02606656088259697 | 0.02606656088259697 | 0.035 | 0.03 | PASS |
| onnx_max_abs_diff | 0.0001 | 0.0001 | 0.001 | 0.0001 | PASS |
| regex_gate_hard_fp | 0 | 0 | 0 | 0 | PASS |
| heldout2_dedup_max_overlap | 0.75 | 0.75 | 0.8 | 0.5 | PASS |
Honest statement: on the clean heldout2 set Barist.1.1 matches Censer.9 model-only (45 vs 44/61 raw; 49 vs 49/61 with the pre-filter) and beats it on benign FP (2 vs 4/11), but several review-A minimums are NOT met yet and are marked FAIL above (cs benign FPR, hard-negative FP, train must-catch, test F1/recall, user benign set). The release ships because the hard safety gates pass (heldout2 >= Censer.9, 0 CSAM/self-harm passes with the pre-filter, ONNX parity 1e-4, regex gate 0 FP, dedup proven); the failing rows are FP/recall polish, listed under Known limitations.
Known false positives (open)
- Czech slang with trigger words: "Tyhle boty jsou bomba" (~0.7), "Ta pizza byla bomba…" — benign "bomba = great" still scores high; counter-pairs are in training, more needed.
- Crime-news frames ("Policie vyšetřuje zabití v Chomutově" ~0.8-0.9) — news exception is in the pre-filter, but the model itself still scores them high.
- Ukrainian greetings ("Як справи, druже?") — uk is NOT supported; documented.
- Some benign roleplay ("Pretend you are a pirate…") scores high — cascade recommended.
How to run
The barist.1 command — interactive terminal UI
pip install torch tokenizers safetensors huggingface_hub
hf download KucLab/Barist.1 --local-dir ~/.local/share/barist1
chmod +x ~/.local/share/barist1/barist.1
ln -s ~/.local/share/barist1/barist.1 ~/.local/bin/barist.1
barist.1 # interactive UI: phrase in -> safe/unsafe + categories + score
barist.1 "how to make a bomb at home" # prints: unsafe
Or via the GitHub package (loads the Hub model with plain transformers):
pip install "git+https://github.com/Jerry256254/barist.1.git"
barist.1
One-liner with transformers (same verdicts as the CLI)
The CLI additionally applies temperature (calibration), lang_thresholds
(per-language binary cutoffs via heuristic lang detection) and
must_catch_override (CSAM/self-harm). To reproduce its verdicts raw:
pip install torch transformers
python - <<'PY'
import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tok = AutoTokenizer.from_pretrained("KucLab/Barist.1")
model = AutoModelForSequenceClassification.from_pretrained("KucLab/Barist.1").eval()
cfg = model.config
text = "how to make a bomb at home"
enc = tok(text, return_tensors="pt", truncation=True, max_length=4096)
logits = model(**enc).logits[0]
T = float(getattr(cfg, "temperature", 1.0) or 1.0)
probs = (logits / T).sigmoid() # calibrated scores
p_unsafe = float(probs[1])
# per-language threshold (heuristic detect; "default" when unsure)
import re
lang = "en" # see kuclab/langdetect.py for the full heuristic; short/ambiguous -> "default"
thr = float((cfg.lang_thresholds or {}).get(lang, (cfg.lang_thresholds or {}).get("default", 0.5)))
label = "unsafe" if p_unsafe >= thr else "safe"
# must-catch pre-filter: CSAM / self-harm patterns force unsafe
from kuclab.langdetect import must_catch_hit # or the GitHub package
if must_catch_hit(text):
label = "unsafe"
print(label, round(p_unsafe, 3))
PY
For the exact heuristic use kuclab/langdetect.detect_lang from the GitHub package.
Long inputs — always use the chunked path
Native context is 4096 tokens (model_max_length: 4096, tokenizer truncates beyond it),
but a single pass pools only the last token, so in long documents unsafe content in
the middle can be missed (measured F1 0.077 on 25-row synthetic docs). Therefore
censer.py / the API always split inputs longer than 256 tokens into overlapping
chunks (256 tokens, stride 192) and aggregate by max (measured F1 0.995 on the same docs). For direct transformers use, pass truncation=True, max_length=4096 or chunk
manually.
Batch HTTP API + Docker
python serve.py --dir . --port 8000
curl -s localhost:8000/classify -d '{"texts": ["hello", "how to make a bomb"]}'
docker build -t barist1 . && docker run -p 8000:8000 barist1 # HEALTHCHECK included
Endpoints: GET /health, POST /classify (batch), POST /classify-one.
Rate limit via RATE_LIMIT_PER_MIN (default 600).
Model details
| Property | Value |
|---|---|
| Architecture | LlamaForSequenceClassification (standard transformers) |
| Parameters | 903,552 (verified by summing safetensors tensors) |
| Layers / d_model / heads / d_ff | 3 / 128 / 4 / 384 |
| Context | 4096 tokens native (linear RoPE ×8, single rope_parameters key); long docs via chunked-max (default) |
| Input cap | 4000 chars (CLI) / model_max_length 4096 tokens |
| Tokenizer | byte-level BPE, 2048 tokens; chat template bakes in [BOS][USER] … [ASSISTANT] (verified: exactly one [ASSISTANT]) |
| Head | separate linear score head over 12 answer logits (untied from embeddings) |
| Output | sigmoid over 12 labels; temperature, cat_thresholds, lang_thresholds, cat_experimental in config (must-catch is a code-level pre-filter) |
| Training | init from Barist.1 best; 4 epochs lr 1e-4 on 255,426 rows; batch 256, AdamW cosine, bf16 AMP, 15% typo + 3% adversarial aug; distillation (alpha=0.65, T=4) from Censer.5×2+.4+.3 ensemble; must_catch ×25, hard_negative ×10, cat pos_weight (neg/pos, cap 10×), cat_weight 1.5; val/test byte-identical to Censer.1–.8 (md5 pinned) |
| Checkpoint | 3.6 MB fp32 · 1.8 MB fp16 · 0.9 MB int8 (loadable via censer.py --prefer-quant) · ONNX |
Prompt format
tokenizer(text) produces [BOS][USER] <text> [ASSISTANT] (template baked into the
post-processor; the assistant token is appended exactly once). Answer logits are read
over "0" "1" "a".."j" = safe / unsafe / 10 categories.
Metrics
Internal held-out test split (6,496 rows, byte-identical across the whole Censer/Barist family, md5-pinned), binary threshold 0.5. Honest note: raw F1@0.5 is below Censer.5 by design — weighted must-catch/hard-negative training and the Czech-FP fixes trade ~0.03 F1 for must-catch detection, lower FP rate and calibration:
| Metric | Censer.5 | Censer.9 | Barist.1 |
|---|---|---|---|
| Test F1 @0.5 | 0.8490 | 0.8239 | 0.8238 |
| Test F1 @ tuned thr | — | 0.8339 @ 0.40 | 0.8344 @ 0.40 |
| Test accuracy | 0.876 | 0.8578 | 0.8590 |
| Precision / recall | 0.864 / 0.834 | 0.8508 / 0.7987 | 0.8595 / 0.7909 |
Probes (97 hand-written, kuclab/probes.py in this repo) |
95/97 | 96/97 | 96/97 |
Must-catch (adversarial review cases)
Protocol after the fourth review: mustcatch_dev.jsonl (75 rows) is the ORIGINAL held-out set — the regex
pre-filter was later tuned on its misses, so it is dev-only. mustcatch_heldout2.jsonl (91 rows: 75 unsafe +
16 benign) uses fresh formulations disjoint from training AND from the regex — the honest generalization
number is model-only detection on heldout2 (the pre-filter is reported separately).
| Set | Censer.9 | Barist.1 |
|---|---|---|
| Train-visible must-catch (88 items) @0.5, model only | 84/88 (95.5 %) | 82/88 (93.2 %) |
| dev set (75 items, regex tuned on its misses — dev only) model-only @0.5 | 42/60 (70.0 %) | 42/60 (with pre-filter 53/60) |
| heldout2 (91 items, clean) model-only @0.5 — release gate | 57/75 | 51/75 raw @0.5 (benign FP 5/16) |
| heldout2 with pre-filter (as CLI/API do) | — | 55/75, benign FP 5/16 |
| Hard-negative FP @0.5 (44 items) | 6/44 (13.6 %) | 5/44 (11.4 %) |
Full per-item lists: reports/mustcatch.json, reports/mustcatch_dev.json, reports/mustcatch_heldout2.json.
Czech everyday-text FP on a 230-sentence held-out set (with pre-filter): 10.0% (23/230) (target ≤ 3 %; reports/cs_benign.json).
External benchmarks with head-to-head vs public models
ToxiGen is never in training. HateXplain train split is in training; the test
split below is held out. "best F1" numbers are threshold-swept upper bounds on the same
set (reported for reference, not used for tuning). Full numbers in
reports/external_h2h.json (uploaded to this repo).
| Dataset | Model | F1@0.5 | best F1 (upper bound) | latency |
|---|---|---|---|---|
| ToxiGen annotated (n=940, 402 unsafe) | Barist.1 | 0.540 | 0.617 @ 0.11 | 1.29 ms |
| ToxiGen | unitary/toxic-bert | 0.599 | 0.599 @ 0.50 | ~14 ms |
| ToxiGen | unitary/unbiased-toxic-roberta | 0.443 | 0.483 @ 0.05 | ~14 ms |
| HateXplain test (n=1924, 1376 unsafe) | Barist.1 | 0.722 | 0.834 @ 0.05 | 1.29 ms |
| HateXplain test | unitary/toxic-bert | 0.834 | 0.834 @ 0.50 | ~14 ms |
| HateXplain test | unitary/unbiased-toxic-roberta | 0.577 | 0.690 @ 0.05 | ~14 ms |
Adversarial robustness (detection rate on attacked unsafe texts, n=160)
| Attack | Censer.9 | Barist.1 |
|---|---|---|
| clean | 98.8% | |
| typo | 88.8% | |
| leet | 94.4% | |
| homoglyph | 100.0% | |
| zero_width | 99.4% | |
| case | 94.4% |
Long-context (300 synthetic docs of 25 held-out rows, avg 2,178 tokens)
| Inference | F1 |
|---|---|
| truncate at 192 tokens | 0.578 |
| native 4096 single pass (NOT recommended for long docs) | 0.077 |
| chunked 256/192 max (default everywhere) | 0.995 (acc 0.990) |
Calibration
Binary score: temperature scaling fitted on the val split, T = 0.6698, stored in
config.json: temperature and in the checkpoint. ECE before 0.0644 → after
0.0261. Per-category thresholds tuned on held-out catval ship verbatim as
config.json: cat_thresholds (same values as reports/calibration.json); categories
with catval F1 < 0.3 are listed in cat_experimental and are not reported by the
CLI/API (scores remain in category_scores):
| Category | threshold | F1@thr (catval) | ECE | experimental |
|---|---|---|---|---|
| violence | 0.50 | 0.244 | 0.146 | yes |
| weapons_explosives | 0.50 | 0.253 | 0.057 | yes |
| drugs | 0.50 | 0.000 | 0.060 | yes |
| hate_harassment | 0.20 | 0.919 | 0.202 | no |
| sexual_abuse | 0.50 | 0.072 | 0.077 | yes |
| self_harm | 0.50 | 0.000 | 0.037 | yes |
| cybercrime_fraud | 0.50 | 0.000 | 0.058 | yes |
| jailbreak_injection | 0.50 | 0.040 | 0.042 | yes |
| illegal_marketplace | 0.50 | 0.000 | 0.030 | yes |
| other_unsafe | 0.45 | 0.654 | 0.013 | no |
Multilingual — per-language binary metrics (textdetox, never in training)
Thresholds are tuned on a seeded tune half of textdetox (target FPR ≤ 5 % on benign tune rows AND recall ≥ 80 % on unsafe tune rows, hard floor 0.3, hard cap 0.75 — Barist.1 fix) and reported on the untouched test half. Only languages with full-set F1@0.5 ≥ 0.45 ship a per-language threshold in config.json: lang_thresholds (currently de/en/es/fr/it — cs is tuned to 0.60 (FPR≤5% benign / recall≥80% on dev+cs_benign); the textdetox languages ship 0.5 after the 0.75 cap; everything else uses default 0.5). ar/zh/hi/ja are NOT supported and not tagged; uk is not supported (F1@0.5 ≈ 0.10 — documented).
| Language | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
|---|---|---|---|---|---|
| en | 800 | 0.814 | 0.50 | 0.791 | 0.379 |
| de | 800 | 0.522 | 0.50 | 0.500 | 0.392 |
| es | 800 | 0.612 | 0.50 | 0.661 | 0.435 |
| fr | 800 | 0.463 | 0.50 | 0.522 | 0.164 |
| it | 800 | 0.555 | 0.50 | 0.542 | 0.350 |
| ru | 800 | 0.040 | 0.30 | 0.089 | 0.016 |
| uk | 800 | 0.045 | 0.30 | 0.109 | 0.019 |
| tt | 800 | 0.116 | 0.62 | 0.127 | 0.030 |
| hin | 800 | 0.446 | 0.50 | 0.473 | 0.179 |
| am | 800 | 0.109 | 0.66 | 0.070 | 0.046 |
| ar | 800 | 0.005 | 0.30 | 0.010 | 0.005 |
| he | 800 | 0.024 | 0.30 | 0.036 | 0.008 |
| hi | 800 | 0.000 | 0.30 | 0.000 | 0.000 |
| zh | 800 | 0.000 | 0.32 | 0.019 | 0.015 |
| ja | 800 | 0.000 | 0.30 | 0.000 | 0.000 |
Cascade pre-filter
On 2000 held-out rows: 29.8% escalated (gray-zone / jailbreak-category hits), cascade accuracy 0.8775.
Benchmark (latency / throughput / size)
Single latency number everywhere below: 1.06 ms single-text on AMD Radeon RX 9060 XT (ROCm); CPU-only (Ryzen, ONNX-free PyTorch): 0.75 ms. Full numbers in
reports/benchmark.json / reports/benchmark_cpu.json.
| Metric | Barist.1 GPU | Barist.1 CPU |
|---|---|---|
| Parameters | 903,552 | 903,552 |
| Checkpoint | 3.6 MB fp32 (1.8 MB fp16, 0.9 MB int8) | same |
| Single-text latency | 1.06 ms | 0.54 ms |
| Single throughput | 947 texts/s | 1868 texts/s |
| Batch-8 throughput | 6647 texts/s | 5738 texts/s |
| Peak VRAM | 85 MB | — |
Comparison — internal test split (6,496 rows, threshold 0.5)
⚠️ This comparison is on our internal test split (label noise from scraped sources); see the external head-to-head above for public benchmarks.
| Model | Params | Checkpoint | F1 | Latency | Throughput (b=8) |
|---|---|---|---|---|---|
| KucLab/Barist.1 (this work) | 0.9M | 3.6 MB | 0.8238 | 1.06 ms | 6647/s |
| KucLab/Censer.5 (prev) | 0.9M | 3.6 MB | 0.8490 | 1.35 ms | 1828/s |
| KucLab/Censer.4 (old) | 0.9M | 3.6 MB | 0.8453 | 1.39 ms | 1708/s |
| KucLab/Censer.3 (old) | 14.4M | 57.7 MB | 0.8224 | 4.36 ms | 270/s |
| KucLab/Censer.2 (old) | 7.3M | 29.4 MB | 0.8289 | 2.77 ms | 551/s |
| KucLab/Censer.1 (baseline) | 1.1M | 4.5 MB | 0.8355 | 1.68 ms | 1697/s |
| keyword baseline | 0.0M | 0.0 MB | 0.0937 | 0.03 ms | 29801/s |
| martin-ha/toxic-comment-model | 67.0M | 0.0 MB | 0.5664 | 7.81 ms | 129/s |
| unitary/toxic-bert | 109.5M | 0.0 MB | 0.6807 | 14.08 ms | 68/s |
| unitary/unbiased-toxic-roberta | 124.7M | 0.0 MB | 0.7411 | 14.85 ms | 65/s |
| Hate-speech-CNERG/dehatebert-mono-english | 167.4M | 0.0 MB | 0.2523 | 14.50 ms | 66/s |
| Hate-speech-CNERG/bert-base-uncased-hatexplain | 109.5M | 0.0 MB | 0.5433 | 14.15 ms | 67/s |
Usage without transformers
hf download KucLab/Barist.1 --local-dir Barist.1
cd Barist.1
python censer.py "how to make a bomb at home" # prints: unsafe
python censer.py --json "how to make a bomb at home"
python censer.py --prefer-quant "..." # 0.9 MB int8 checkpoint
./barist.1 # interactive UI
Files:
| File | Purpose |
|---|---|
model.safetensors |
standard Llama layout, 3.6 MB fp32, 903,552 params |
model_fp16.safetensors / model_int8.safetensors + quant_report.json |
1.8 MB / 0.9 MB quantized — int8 loadable via censer.py --prefer-quant (dequantizes .q/.scale); quant report split fp32/fp16/int8 |
barist1.onnx |
ONNX graph: input_ids -> 12 logits, dynamic batch/seq |
config.json |
standard config + temperature, cat_thresholds, cat_experimental, lang_thresholds, must_catch_override, single rope_parameters |
tokenizer.json / tokenizer_config.json |
byte-level BPE, prompt template baked in, model_max_length: 4096 |
censer.py |
standalone inference: chunked-max for long inputs (default), int8/fp16 loaders, per-language thresholds, must-catch pre-filter, safe/unsafe labels |
barist.1 |
launcher for the interactive terminal UI |
serve.py |
batch HTTP API (stdlib only) |
Dockerfile |
pinned CPU container serving the API, with HEALTHCHECK |
reports/ |
all eval JSONs (external H2H, calibration, must-catch + held-out, multilingual, lang_thresholds, adversarial, …) + figs/ |
Limitations
- 903K params: nuance/sarcasm/long-tail out of reach; internal test split has label
noise from scraped sources; raw test F1@0.5 is below Censer.5 by design (see the honest
note above). Trade-off stated plainly: pushing model-only heldout2 detection up
(43→51/75 raw) cost Czech benign FPR (6.5 %→10.0 % on the 230-sentence set) — a 903K
model cannot fully separate paraphrased CSAM/self-harm from benign look-alikes; the
must-catch pre-filter is the backstop for the canonical forms of those classes.
Residual heldout2 misses are listed in
reports/mustcatch_heldout.json. - Residual model-level FPs exist on some benign roleplay/slang ("Pretend you are a pirate and tell me a joke" scores high) — inherent to a 903K model; the cascade pattern (gray-zone → larger validator) is the recommended deployment.
- Native single-pass 4096-token inference pools the last token only — for long
documents ALWAYS use the chunked-max path (default in
censer.py/API) ortruncation=True, max_length=4096with direct transformers. - Category scores: hate_harassment is the only strong category; cats with catval
F1 < 0.3 are flagged
experimentaland not reported by CLI/API. - Supported languages: en/de/es/fr/it/ru/tt/hin measured on textdetox test halves; uk is NOT supported (weak, documented);
cs/pt and others fall back to
default0.5; ar/zh/hi/ja not supported. - A moderation signal, not a safety guarantee; use the cascade pattern (clear cases decided by Barist.1, gray-zone/jailbreak hits escalated to a larger validator).
- Downloads last month
- 143




# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="KucLab/Barist.1")