Hugging Face's logo

Mohitcr1
/
mistral_instruct_generation

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files
xet
 Metrics Community
Mohitcr1 commited on
Commit
44fb6ad
·
verified ·
1 Parent(s): 5b04def

End of training

Browse files
Files changed (5) hide show
  1. README.md +8 -8
  2. adapter_config.json +1 -0
  3. adapter_model.safetensors +1 -1
  4. runs/Mar11_07-10-25_3ac72f125fd6/events.out.tfevents.1710141065.3ac72f125fd6.312.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.0689
24
 
25
  ## Model description
26
 
@@ -52,17 +52,17 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
- | 0.6675 | 2.86 | 20 | 0.5153 |
56
- | 0.1621 | 5.71 | 40 | 0.1178 |
57
- | 0.0369 | 8.57 | 60 | 0.0707 |
58
- | 0.0179 | 11.43 | 80 | 0.0652 |
59
- | 0.0138 | 14.29 | 100 | 0.0689 |
60
 
61
 
62
  ### Framework versions
63
 
64
- - PEFT 0.8.2
65
  - Transformers 4.37.0
66
  - Pytorch 2.1.2
67
- - Datasets 2.17.1
68
  - Tokenizers 0.15.1
 
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.0141
24
 
25
  ## Model description
26
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
+ | 1.0245 | 1.25 | 20 | 0.9835 |
56
+ | 0.833 | 2.5 | 40 | 0.9249 |
57
+ | 0.7451 | 3.75 | 60 | 0.9172 |
58
+ | 0.6741 | 5.0 | 80 | 0.9335 |
59
+ | 0.5957 | 6.25 | 100 | 1.0141 |
60
 
61
 
62
  ### Framework versions
63
 
64
+ - PEFT 0.9.0
65
  - Transformers 4.37.0
66
  - Pytorch 2.1.2
67
+ - Datasets 2.18.0
68
  - Tokenizers 0.15.1
adapter_config.json CHANGED
@@ -23,5 +23,6 @@
23
  "q_proj"
24
  ],
25
  "task_type": "CAUSAL_LM",
 
26
  "use_rslora": false
27
  }
 
23
  "q_proj"
24
  ],
25
  "task_type": "CAUSAL_LM",
26
+ "use_dora": false,
27
  "use_rslora": false
28
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a70529a6c16f35ba46dbc14d500e94fd67e85e5678d9913a10b9e51bb611f97
3
  size 109069176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f25cb8bc11ff3405d94d8ef0da21908bffc976d06bae27d352da056451175a0d
3
  size 109069176
runs/Mar11_07-10-25_3ac72f125fd6/events.out.tfevents.1710141065.3ac72f125fd6.312.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12e255bdf9c69ecfd6d20912348e15933779ceaaefcae679ba45b6ab34ee7bea
3
+ size 8015
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffbee34eee499f41d4ea6ac62e262fae9bf0789c97a5f032d204aa261ad629d3
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fd16ac66f553d6c601e2f5a75b1c9a9ef7e8fb05141fcba9499d58d44d98fef
3
  size 4728