jvaquet commited on
Commit
e4bcc87
·
verified ·
1 Parent(s): 53c7292

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -5,4 +5,24 @@ tags:
5
  - multilabel-token-classification
6
  base_model:
7
  - google-bert/bert-large-cased
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  - multilabel-token-classification
6
  base_model:
7
  - google-bert/bert-large-cased
8
+ ---
9
+ # Overview
10
+ - This is an extension of the `bert-large-cased` model to enable **multi-label token classification**.
11
+ - The training objective is BCELoss.
12
+ - Labels are one-hot encoded.
13
+ - Model output logits can be normalized using sigmoid activation.
14
+
15
+ # Usage
16
+ ## Training
17
+ To initialize the model for training, simply provide `id2label` and `label2id`, similarly to standard token classification fine tuning:
18
+ ```python
19
+ from transformers import AutoModelForTokenClassification
20
+
21
+ model = AutoModelForTokenClassification.from_pretrained('jvaquet/multilabel-classification-bert',
22
+ id2label = id2label,
23
+ label2id = label2id,
24
+ trust_remote_code=True)
25
+ ```
26
+
27
+
28
+