SallySims commited on
Commit
4a72cb3
Β·
verified Β·
1 Parent(s): b8ba5b3

Add detailed model card

Browse files
Files changed (1) hide show
  1. README.md +122 -0
README.md ADDED
@@ -0,0 +1,122 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: apache-2.0
4
+ tags:
5
+ - pytorch
6
+ - text-classification
7
+ - dei
8
+ - accessibility
9
+ - equibert
10
+ metrics:
11
+ - f1
12
+ - accuracy
13
+ ---
14
+
15
+ # EquiBERT β€” Event Exclusion Classifier
16
+
17
+ **Model ID:** `SallySims/equibert-event-exclusion`
18
+
19
+ Detects exclusionary elements in workplace event communications β€”
20
+ identifying barriers that may prevent participation by certain groups.
21
+
22
+ ## Labels
23
+
24
+ | ID | Label | Example |
25
+ |----|-------|---------|
26
+ | 0 | `none` | No exclusion detected |
27
+ | 1 | `dietary` | Pork BBQ only, no alternatives offered |
28
+ | 2 | `cultural` | Christmas party framed as mandatory |
29
+ | 3 | `religious` | Friday evening events conflicting with observance |
30
+ | 4 | `ability` | No lift, standing room only venue |
31
+ | 5 | `socioeconomic` | Expensive mandatory team activities |
32
+ | 6 | `family_status` | After-hours events excluding carers |
33
+ | 7 | `timezone` | Global calls at unsuitable times |
34
+
35
+ ## Usage
36
+
37
+ ```python
38
+ text = "Team drinks Friday at the pub β€” first round on the company. No lift at venue."
39
+ inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=128)
40
+ # label = id2label[model(**inputs).logits.argmax(-1).item()]
41
+ ```
42
+
43
+ ## Model Description
44
+
45
+ EquiBERT is a multi-task DEI (Diversity, Equity and Inclusion) transformer
46
+ built on a dual-encoder backbone that fuses **RoBERTa-base** and
47
+ **DeBERTa-v3-base** via a learned weighted sum (Ξ± parameter).
48
+ The fused representation is fed into task-specific heads covering
49
+ 17 distinct DEI analysis tasks.
50
+
51
+ **Organisation:** [SallySims](https://huggingface.co/SallySims)
52
+ **Framework:** PyTorch + HuggingFace Transformers
53
+ **Backbone:** RoBERTa-base + DeBERTa-v3-base (dual encoder, fused)
54
+ **Language:** English
55
+ **Domain:** Organisational DEI text β€” HR communications, policies,
56
+ job descriptions, performance reviews, leadership statements, reports
57
+
58
+ ## Architecture
59
+
60
+ ```
61
+ Input Text
62
+ β”‚
63
+ β”œβ”€β”€β–Ά RoBERTa-base encoder ──▢ Linear projection
64
+ β”‚ β”‚
65
+ └──▢ DeBERTa-v3-base encoder ──▢ Linear projection
66
+ β”‚
67
+ Weighted fusion (learned Ξ±)
68
+ β”‚
69
+ Layer Norm + Dropout
70
+ β”‚
71
+ Task-specific head (see below)
72
+ ```
73
+
74
+ ## Training Data
75
+
76
+ Trained on synthetic DEI organisational text generated by the
77
+ EquiBERT synthetic data pipeline, covering 20 DEI categories
78
+ across HR, policy, leadership, and workforce analytics domains.
79
+ For production use, fine-tune on real labelled DEI data.
80
+
81
+ ## Limitations
82
+
83
+ - Trained on synthetic data β€” predictions should be validated
84
+ before use in real HR or policy decisions.
85
+ - English-only.
86
+ - Not a substitute for qualified DEI practitioners or legal advice.
87
+ - May reflect biases present in the training corpus.
88
+
89
+ ## Citation
90
+
91
+ If you use EquiBERT in your research, please cite:
92
+
93
+ ```bibtex
94
+ @misc{equibert2024,
95
+ author = {SallySims},
96
+ title = {EquiBERT: A Multi-Task DEI Transformer},
97
+ year = {2024},
98
+ publisher = {HuggingFace},
99
+ url = {https://huggingface.co/SallySims}
100
+ }
101
+ ```
102
+
103
+ ## All EquiBERT Models
104
+
105
+ | Model | Task | Primary Metric |
106
+ |-------|------|---------------|
107
+ | [equibert-bias-classifier](https://huggingface.co/SallySims/equibert-bias-classifier) | Bias Detection | Macro F1 |
108
+ | [equibert-microaggression](https://huggingface.co/SallySims/equibert-microaggression) | Microaggression Detection | Macro F1 |
109
+ | [equibert-category-tagger](https://huggingface.co/SallySims/equibert-category-tagger) | DEI Category Tagging | Macro F1 |
110
+ | [equibert-event-exclusion](https://huggingface.co/SallySims/equibert-event-exclusion) | Event Exclusion Classification | Macro F1 |
111
+ | [equibert-inclusive-language](https://huggingface.co/SallySims/equibert-inclusive-language) | Inclusive Language Scoring | Span F1 |
112
+ | [equibert-review-auditor](https://huggingface.co/SallySims/equibert-review-auditor) | Performance Review Auditing | Span F1 |
113
+ | [equibert-washing-detector](https://huggingface.co/SallySims/equibert-washing-detector) | DEI Washing Detection | MAE |
114
+ | [equibert-framing-scorer](https://huggingface.co/SallySims/equibert-framing-scorer) | Report Framing Scoring | MAE |
115
+ | [equibert-awareness-scorer](https://huggingface.co/SallySims/equibert-awareness-scorer) | DEI Awareness Scoring | MAE |
116
+ | [equibert-similarity](https://huggingface.co/SallySims/equibert-similarity) | Semantic Similarity | Accuracy |
117
+ | [equibert-ner](https://huggingface.co/SallySims/equibert-ner) | DEI Entity Recognition | Span F1 |
118
+ | [equibert-relation-extraction](https://huggingface.co/SallySims/equibert-relation-extraction) | Relation Extraction | Macro F1 |
119
+ | [equibert-qa](https://huggingface.co/SallySims/equibert-qa) | Extractive QA | Span EM |
120
+ | [equibert-search](https://huggingface.co/SallySims/equibert-search) | Semantic Search | MRR@10 |
121
+ | [equibert-nli](https://huggingface.co/SallySims/equibert-nli) | NLI / Textual Entailment | Macro F1 |
122
+ | [equibert-generator](https://huggingface.co/SallySims/equibert-generator) | DEI Text Generation | ROUGE-L |