SallySims commited on
Commit
6eddb27
Β·
verified Β·
1 Parent(s): f3978b9

Add detailed model card

Browse files
Files changed (1) hide show
  1. README.md +122 -0
README.md ADDED
@@ -0,0 +1,122 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: apache-2.0
4
+ tags:
5
+ - pytorch
6
+ - text-classification
7
+ - dei
8
+ - report-framing
9
+ - equibert
10
+ metrics:
11
+ - mae
12
+ - rmse
13
+ ---
14
+
15
+ # EquiBERT β€” Report Framing Scorer
16
+
17
+ **Model ID:** `SallySims/equibert-framing-scorer`
18
+
19
+ Scores DEI reports and communications on equitable framing β€”
20
+ detecting victim-blaming, minimisation, deflection, and
21
+ structural vs individualist attribution of equity gaps.
22
+
23
+ ## Output Dimensions (all 0.0–1.0)
24
+
25
+ | Index | Dimension | High score means... |
26
+ |-------|-----------|-------------------|
27
+ | 0 | `equity_score` | Overall equitable framing (main score) |
28
+ | 1 | `equity_framing` | Gaps attributed to structural causes |
29
+ | 2 | `minimisation` | Low = gap downplayed or dismissed |
30
+ | 3 | `deflection` | Low = responsibility avoided |
31
+ | 4 | `victim_blaming` | Low = individuals blamed for systemic gaps |
32
+ | 5 | `structural_awareness` | Root causes acknowledged |
33
+ | 6 | `data_transparency` | Disaggregated data used |
34
+
35
+ ## Framing Examples
36
+
37
+ | Text | Equity Score |
38
+ |------|-------------|
39
+ | "The pay gap reflects personal choices women make" | 0.08 |
40
+ | "The pay gap is complex and progress is being made" | 0.41 |
41
+ | "The pay gap reflects structural bias β€” root cause analysis identified..." | 0.91 |
42
+
43
+ ## Model Description
44
+
45
+ EquiBERT is a multi-task DEI (Diversity, Equity and Inclusion) transformer
46
+ built on a dual-encoder backbone that fuses **RoBERTa-base** and
47
+ **DeBERTa-v3-base** via a learned weighted sum (Ξ± parameter).
48
+ The fused representation is fed into task-specific heads covering
49
+ 17 distinct DEI analysis tasks.
50
+
51
+ **Organisation:** [SallySims](https://huggingface.co/SallySims)
52
+ **Framework:** PyTorch + HuggingFace Transformers
53
+ **Backbone:** RoBERTa-base + DeBERTa-v3-base (dual encoder, fused)
54
+ **Language:** English
55
+ **Domain:** Organisational DEI text β€” HR communications, policies,
56
+ job descriptions, performance reviews, leadership statements, reports
57
+
58
+ ## Architecture
59
+
60
+ ```
61
+ Input Text
62
+ β”‚
63
+ β”œβ”€β”€β–Ά RoBERTa-base encoder ──▢ Linear projection
64
+ β”‚ β”‚
65
+ └──▢ DeBERTa-v3-base encoder ──▢ Linear projection
66
+ β”‚
67
+ Weighted fusion (learned Ξ±)
68
+ β”‚
69
+ Layer Norm + Dropout
70
+ β”‚
71
+ Task-specific head (see below)
72
+ ```
73
+
74
+ ## Training Data
75
+
76
+ Trained on synthetic DEI organisational text generated by the
77
+ EquiBERT synthetic data pipeline, covering 20 DEI categories
78
+ across HR, policy, leadership, and workforce analytics domains.
79
+ For production use, fine-tune on real labelled DEI data.
80
+
81
+ ## Limitations
82
+
83
+ - Trained on synthetic data β€” predictions should be validated
84
+ before use in real HR or policy decisions.
85
+ - English-only.
86
+ - Not a substitute for qualified DEI practitioners or legal advice.
87
+ - May reflect biases present in the training corpus.
88
+
89
+ ## Citation
90
+
91
+ If you use EquiBERT in your research, please cite:
92
+
93
+ ```bibtex
94
+ @misc{equibert2024,
95
+ author = {SallySims},
96
+ title = {EquiBERT: A Multi-Task DEI Transformer},
97
+ year = {2024},
98
+ publisher = {HuggingFace},
99
+ url = {https://huggingface.co/SallySims}
100
+ }
101
+ ```
102
+
103
+ ## All EquiBERT Models
104
+
105
+ | Model | Task | Primary Metric |
106
+ |-------|------|---------------|
107
+ | [equibert-bias-classifier](https://huggingface.co/SallySims/equibert-bias-classifier) | Bias Detection | Macro F1 |
108
+ | [equibert-microaggression](https://huggingface.co/SallySims/equibert-microaggression) | Microaggression Detection | Macro F1 |
109
+ | [equibert-category-tagger](https://huggingface.co/SallySims/equibert-category-tagger) | DEI Category Tagging | Macro F1 |
110
+ | [equibert-event-exclusion](https://huggingface.co/SallySims/equibert-event-exclusion) | Event Exclusion Classification | Macro F1 |
111
+ | [equibert-inclusive-language](https://huggingface.co/SallySims/equibert-inclusive-language) | Inclusive Language Scoring | Span F1 |
112
+ | [equibert-review-auditor](https://huggingface.co/SallySims/equibert-review-auditor) | Performance Review Auditing | Span F1 |
113
+ | [equibert-washing-detector](https://huggingface.co/SallySims/equibert-washing-detector) | DEI Washing Detection | MAE |
114
+ | [equibert-framing-scorer](https://huggingface.co/SallySims/equibert-framing-scorer) | Report Framing Scoring | MAE |
115
+ | [equibert-awareness-scorer](https://huggingface.co/SallySims/equibert-awareness-scorer) | DEI Awareness Scoring | MAE |
116
+ | [equibert-similarity](https://huggingface.co/SallySims/equibert-similarity) | Semantic Similarity | Accuracy |
117
+ | [equibert-ner](https://huggingface.co/SallySims/equibert-ner) | DEI Entity Recognition | Span F1 |
118
+ | [equibert-relation-extraction](https://huggingface.co/SallySims/equibert-relation-extraction) | Relation Extraction | Macro F1 |
119
+ | [equibert-qa](https://huggingface.co/SallySims/equibert-qa) | Extractive QA | Span EM |
120
+ | [equibert-search](https://huggingface.co/SallySims/equibert-search) | Semantic Search | MRR@10 |
121
+ | [equibert-nli](https://huggingface.co/SallySims/equibert-nli) | NLI / Textual Entailment | Macro F1 |
122
+ | [equibert-generator](https://huggingface.co/SallySims/equibert-generator) | DEI Text Generation | ROUGE-L |