voidful commited on
Commit
b0cfd13
·
verified ·
1 Parent(s): c7ba92a

Model save

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [voidful/llm-codec-abl-ftp](https://huggingface.co/voidful/llm-codec-abl-ftp) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 12.0999
19
 
20
  ## Model description
21
 
@@ -49,7 +49,7 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:-----:|:---------------:|
52
- | 12.1109 | 1.0 | 35156 | 12.0999 |
53
 
54
 
55
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [voidful/llm-codec-abl-ftp](https://huggingface.co/voidful/llm-codec-abl-ftp) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 12.0997
19
 
20
  ## Model description
21
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:-----:|:---------------:|
52
+ | 12.1107 | 1.0 | 35156 | 12.0997 |
53
 
54
 
55
  ### Framework versions
final/adapter_config.json CHANGED
@@ -24,13 +24,13 @@
24
  "rank_pattern": {},
25
  "revision": null,
26
  "target_modules": [
27
- "v_proj",
28
- "down_proj",
29
  "gate_proj",
 
 
30
  "k_proj",
31
  "q_proj",
32
- "up_proj",
33
- "o_proj"
34
  ],
35
  "task_type": "CAUSAL_LM",
36
  "trainable_token_indices": null,
 
24
  "rank_pattern": {},
25
  "revision": null,
26
  "target_modules": [
 
 
27
  "gate_proj",
28
+ "o_proj",
29
+ "v_proj",
30
  "k_proj",
31
  "q_proj",
32
+ "down_proj",
33
+ "up_proj"
34
  ],
35
  "task_type": "CAUSAL_LM",
36
  "trainable_token_indices": null,
final/adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:627569e126261684eecc0f5b6d2db03a9e27060c11cbf53ff7a40267900df92e
3
  size 2501071448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d429532f59101c43e978d5922a0d92fdbc2569bdd8a2f5a5c30391076e186bf
3
  size 2501071448
final/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:354f5ade26ef901daf3e675da6d7dfa183cc7fff2da0fcc1c5d0991869c7c303
3
  size 5841
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9559e073553ed46f87b592d739c58d139e44fc56a226eba21461d47bd539ea88
3
  size 5841