Token Classification
Transformers
German
English
pii-detection
named-entity-recognition
privacy
xlm-roberta
Instructions to use SanoAI/sano-shield-1-multilingual with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SanoAI/sano-shield-1-multilingual with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="SanoAI/sano-shield-1-multilingual")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SanoAI/sano-shield-1-multilingual", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Publish Sano Shield 1.1 model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,109 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- de
|
| 4 |
+
- en
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: token-classification
|
| 7 |
+
base_model: bardsai/eu-pii-anonimization-multilang
|
| 8 |
+
tags:
|
| 9 |
+
- pii-detection
|
| 10 |
+
- named-entity-recognition
|
| 11 |
+
- privacy
|
| 12 |
+
- xlm-roberta
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Sano Shield 1.1
|
| 16 |
+
|
| 17 |
+
Sano Shield 1.1 is Sano AI's multilingual privacy model for identifying sensitive
|
| 18 |
+
information before text reaches an AI provider. Its technical model ID is
|
| 19 |
+
`sano-shield-1-multilingual`.
|
| 20 |
+
|
| 21 |
+
> **Availability:** This repository publishes the model card only. Model weights,
|
| 22 |
+
> tokenizer files, ONNX artifacts, and training data are not publicly distributed or
|
| 23 |
+
> downloadable from Hugging Face.
|
| 24 |
+
|
| 25 |
+
## Model details
|
| 26 |
+
|
| 27 |
+
| Field | Value |
|
| 28 |
+
|---|---|
|
| 29 |
+
| Model family | Sano Shield |
|
| 30 |
+
| Release | Sano Shield 1.1 |
|
| 31 |
+
| Technical ID | `sano-shield-1-multilingual` |
|
| 32 |
+
| Task | Token classification / sensitive-entity recognition |
|
| 33 |
+
| Evaluated languages | German and English |
|
| 34 |
+
| Entity classes | 35 entity types, 69 BIO token labels |
|
| 35 |
+
| Architecture | XLM-RoBERTa token classifier |
|
| 36 |
+
| Base-model lineage | [`bardsai/eu-pii-anonimization-multilang`](https://huggingface.co/bardsai/eu-pii-anonimization-multilang) |
|
| 37 |
+
| Release date | 2026-08-01 |
|
| 38 |
+
|
| 39 |
+
Sano Shield 1.1 continues a private Sano Shield 1.0 checkpoint. Sano Shield 1.0 was a
|
| 40 |
+
full-parameter continued fine-tune of the pinned base-model revision
|
| 41 |
+
`0e72e19f030ed4e661b1673e549af8e0dd176386`. Training targets come from Sano's
|
| 42 |
+
versioned synthetic corpus rather than predictions copied from a separate evaluator.
|
| 43 |
+
|
| 44 |
+
## Intended use
|
| 45 |
+
|
| 46 |
+
Sano Shield 1.1 is designed as one component in a privacy pipeline:
|
| 47 |
+
|
| 48 |
+
1. identify sensitive spans in German and English text;
|
| 49 |
+
2. replace those spans with controlled placeholders before external model inference; and
|
| 50 |
+
3. support re-identification only inside a trusted boundary.
|
| 51 |
+
|
| 52 |
+
Production deployments should combine the model with deterministic recognizers, policy
|
| 53 |
+
checks, monitoring, and fail-safe handling. Organization names remain user-selectable but
|
| 54 |
+
are not treated as mandatory natural-person PII by the release policy.
|
| 55 |
+
|
| 56 |
+
The model should not be used as the sole basis for legal-compliance decisions, medical
|
| 57 |
+
decisions, identity verification, employee monitoring, or irreversible actions affecting
|
| 58 |
+
a person.
|
| 59 |
+
|
| 60 |
+
## Evaluation
|
| 61 |
+
|
| 62 |
+
The promoted checkpoint passed both synthetic checkpoint gates and a separately maintained
|
| 63 |
+
product-pipeline evaluation. The product evaluation data was held out from training.
|
| 64 |
+
|
| 65 |
+
| Product gate | Sano Shield 1.1 result |
|
| 66 |
+
|---|---:|
|
| 67 |
+
| German protected-span recall | 470 / 470 (100%) |
|
| 68 |
+
| English protected-span recall | 4,187 / 4,188 (99.976%) |
|
| 69 |
+
| Zero-touch documents | 29 / 30 |
|
| 70 |
+
| Raw false or unknown detections | 83, reduced from 141 |
|
| 71 |
+
| ONNX/PyTorch label agreement | 100% |
|
| 72 |
+
|
| 73 |
+
On the synthetic continuation evaluation, exact entity F1 improved by 0.0454 for German
|
| 74 |
+
and 0.0209 for English relative to the Sano Shield 1.0 parent, while privacy-span recall
|
| 75 |
+
was unchanged.
|
| 76 |
+
|
| 77 |
+
These results do not guarantee equivalent performance on other domains. The held-out
|
| 78 |
+
product evaluation measures Sano's release policy and complete product pipeline, including
|
| 79 |
+
deterministic rules; it should not be interpreted as a neural-model-only benchmark.
|
| 80 |
+
|
| 81 |
+
## Training
|
| 82 |
+
|
| 83 |
+
- Parent: private Sano Shield 1.0 selected checkpoint
|
| 84 |
+
- Corpus: Sano Shield v0.4 synthetic continuation corpus
|
| 85 |
+
- Schedule: one epoch at a `1e-6` learning rate
|
| 86 |
+
- Composition: 62.5% replay, 25% positive contextual data, 4.2% contrastive data, and
|
| 87 |
+
8.3% new negatives
|
| 88 |
+
- Loss: square-root inverse class weighting capped at `3.0`, with the outside label at
|
| 89 |
+
weight `1.0`
|
| 90 |
+
|
| 91 |
+
The continuation run restarted from Sano Shield 1.0 rather than from either rejected
|
| 92 |
+
candidate run.
|
| 93 |
+
|
| 94 |
+
## Limitations
|
| 95 |
+
|
| 96 |
+
- German and English are the only release-policy target languages.
|
| 97 |
+
- Unseen document types, OCR errors, adversarial formatting, and ambiguous context can
|
| 98 |
+
produce missed or extra spans.
|
| 99 |
+
- No statistical detector can guarantee that all sensitive information is found.
|
| 100 |
+
- The model recognizes spans; it does not determine whether processing them is lawful or
|
| 101 |
+
satisfy a particular compliance regime.
|
| 102 |
+
- High-risk deployments require domain-specific, legally usable, human-reviewed evaluation.
|
| 103 |
+
|
| 104 |
+
## Distribution
|
| 105 |
+
|
| 106 |
+
This public page is provided for transparency about the model's purpose, lineage,
|
| 107 |
+
evaluation, and limitations. It does not grant access to the checkpoint or corpus, and no
|
| 108 |
+
public redistribution license for those artifacts is granted here. Contact Sano AI for
|
| 109 |
+
deployment and access information.
|