Text Classification
Transformers
Safetensors
English
modernbert
Mixture of Experts
text-embeddings-inference
suayptalha commited on
Commit
bd4d5fb
·
verified ·
1 Parent(s): c94cb93

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -5
README.md CHANGED
@@ -14,8 +14,17 @@ tags:
14
  - moe
15
  ---
16
 
17
- CSV_FILES = [
18
- ("results-diagnose.csv", 0), # path, label
19
- ("results-treatment.csv", 1),
20
- ("results-psy.csv", 2),
21
- ]
 
 
 
 
 
 
 
 
 
 
14
  - moe
15
  ---
16
 
17
+ # MoE Router Model
18
+
19
+ Classify clinical text into:
20
+
21
+ * **0:** Diagnosis
22
+ * **1:** Treatment
23
+ * **2:** Psychological Support
24
+
25
+ ## Training
26
+
27
+ * **Base model:** ModernBERT-base
28
+ * **Epochs:** 3
29
+ * **Learning rate:** 3e-5
30
+ * **Batch size:** 16