AyoubChLin commited on
Commit
c40bf85
·
1 Parent(s): 377bd53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -14
README.md CHANGED
@@ -13,36 +13,30 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # disitilbert_zeroshot_economics
15
 
16
- This model is a fine-tuned version of [AyoubChLin/disitilbert_zeroshot_economics](https://huggingface.co/AyoubChLin/disitilbert_zeroshot_economics) on an unknown dataset.
17
 
18
- ## Model description
19
-
20
- More information needed
21
-
22
- ## Intended uses & limitations
23
-
24
- More information needed
25
 
26
  ## Training and evaluation data
27
 
28
- More information needed
 
29
 
30
  ## Training procedure
31
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
- - learning_rate: 8e-06
36
- - train_batch_size: 64
37
- - eval_batch_size: 16
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 2
42
 
43
  ### Training results
44
 
45
-
46
 
47
  ### Framework versions
48
 
 
13
 
14
  # disitilbert_zeroshot_economics
15
 
16
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
 
 
 
 
 
 
 
 
18
 
19
  ## Training and evaluation data
20
 
21
+ train on [teknium/dataforge-economics](https://huggingface.co/datasets/teknium/dataforge-economics)
22
+ on the task of zeroshot
23
 
24
  ## Training procedure
25
 
26
  ### Training hyperparameters
27
 
28
  The following hyperparameters were used during training:
29
+ - learning_rate: 1e-05
30
+ - train_batch_size: 32
31
+ - eval_batch_size: 32
32
  - seed: 42
33
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
34
  - lr_scheduler_type: linear
35
+ - num_epochs: 5
36
 
37
  ### Training results
38
 
39
+ eval loss : 0.0503
40
 
41
  ### Framework versions
42