kwwww commited on
Commit
d799d16
·
1 Parent(s): 6b5d444

Upload model

Browse files
Files changed (3) hide show
  1. README.md +3 -61
  2. adapter_config.json +6 -0
  3. adapter_model.bin +1 -1
README.md CHANGED
@@ -1,67 +1,9 @@
1
  ---
2
- license: apache-2.0
3
- tags:
4
- - generated_from_trainer
5
- datasets:
6
- - bionlp2004
7
- metrics:
8
- - precision
9
- - recall
10
- - f1
11
- - accuracy
12
- model-index:
13
- - name: mytest
14
- results: []
15
  ---
16
-
17
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
- should probably proofread and complete it, then remove this comment. -->
19
-
20
- # mytest
21
-
22
- This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the bionlp2004 dataset.
23
- It achieves the following results on the evaluation set:
24
- - Loss: 0.1750
25
- - Precision: 0.7228
26
- - Recall: 0.7834
27
- - F1: 0.7519
28
- - Accuracy: 0.9401
29
-
30
- ## Model description
31
-
32
- More information needed
33
-
34
- ## Intended uses & limitations
35
-
36
- More information needed
37
-
38
- ## Training and evaluation data
39
-
40
- More information needed
41
-
42
  ## Training procedure
43
 
44
- ### Training hyperparameters
45
-
46
- The following hyperparameters were used during training:
47
- - learning_rate: 0.001
48
- - train_batch_size: 16
49
- - eval_batch_size: 16
50
- - seed: 42
51
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
- - lr_scheduler_type: linear
53
- - num_epochs: 1
54
-
55
- ### Training results
56
-
57
- | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
58
- |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
59
- | 0.2044 | 1.0 | 1039 | 0.1750 | 0.7228 | 0.7834 | 0.7519 | 0.9401 |
60
-
61
-
62
  ### Framework versions
63
 
64
- - Transformers 4.29.2
65
- - Pytorch 2.0.1+cu117
66
- - Datasets 2.12.0
67
- - Tokenizers 0.13.3
 
1
  ---
2
+ library_name: peft
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  ## Training procedure
5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ### Framework versions
7
 
8
+
9
+ - PEFT 0.6.0.dev0
 
 
adapter_config.json CHANGED
@@ -1,14 +1,20 @@
1
  {
 
 
2
  "base_model_name_or_path": "bert-base-uncased",
3
  "bias": "all",
4
  "fan_in_fan_out": false,
5
  "inference_mode": true,
6
  "init_lora_weights": true,
 
 
7
  "lora_alpha": 16,
8
  "lora_dropout": 0.1,
9
  "modules_to_save": null,
10
  "peft_type": "LORA",
11
  "r": 16,
 
 
12
  "target_modules": [
13
  "query",
14
  "value"
 
1
  {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
  "base_model_name_or_path": "bert-base-uncased",
5
  "bias": "all",
6
  "fan_in_fan_out": false,
7
  "inference_mode": true,
8
  "init_lora_weights": true,
9
+ "layers_pattern": null,
10
+ "layers_to_transform": null,
11
  "lora_alpha": 16,
12
  "lora_dropout": 0.1,
13
  "modules_to_save": null,
14
  "peft_type": "LORA",
15
  "r": 16,
16
+ "rank_pattern": {},
17
+ "revision": null,
18
  "target_modules": [
19
  "query",
20
  "value"
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b16a7695f430a295a481bb6bea09c7398e9a412c544481fe31cc8f250926209
3
  size 2854621
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e09b089682e6570fcdc3f2f6c1e9cd68a8980ae54377ee368776061baee8ddf
3
  size 2854621