lysandre HF Staff commited on
Commit
7de4e36
·
1 Parent(s): 8fccccf

Add model weights and configuration

Browse files
Files changed (1) hide show
  1. README.md +0 -19
README.md DELETED
@@ -1,19 +0,0 @@
1
- ---
2
- language: en
3
- license: apache-2.0
4
- datasets:
5
- - sst-2
6
- ---
7
-
8
- # DistilBERT base uncased finetuned SST-2
9
-
10
- This model is a fine-tune checkpoint of [DistilBERT-base-uncased](https://huggingface.co/distilbert-base-uncased), fine-tuned on SST-2.
11
- This model reaches an accuracy of 91.3 on the dev set (for comparison, Bert bert-base-uncased version reaches an accuracy of 92.7).
12
-
13
- # Fine-tuning hyper-parameters
14
-
15
- - learning_rate = 1e-5
16
- - batch_size = 32
17
- - warmup = 600
18
- - max_seq_length = 128
19
- - num_train_epochs = 3.0