Hugging Face's logo

Weni
/
ZeroShot-Multilanguage-Zephyr-7B

PEFT
PyTorch
English
Portuguese
mistral
Model card Files
xet
Community
2
Mel-Iza0 commited on
Commit
b5f4a9d
·
1 Parent(s): 37ab216

Training in progress, epoch 1, checkpoint

Browse files
Files changed (6) hide show
  1. checkpoint-919/README.md +0 -26
  2. checkpoint-919/adapter_model.bin +1 -1
  3. checkpoint-919/optimizer.pt +1 -1
  4. checkpoint-919/scheduler.pt +1 -1
  5. checkpoint-919/trainer_state.json +0 -0
  6. checkpoint-919/training_args.bin +1 -1
checkpoint-919/README.md CHANGED
@@ -4,30 +4,6 @@ library_name: peft
4
  ## Training procedure
5
 
6
 
7
- The following `bitsandbytes` quantization config was used during training:
8
- - quant_method: bitsandbytes
9
- - load_in_8bit: False
10
- - load_in_4bit: True
11
- - llm_int8_threshold: 6.0
12
- - llm_int8_skip_modules: None
13
- - llm_int8_enable_fp32_cpu_offload: False
14
- - llm_int8_has_fp16_weight: False
15
- - bnb_4bit_quant_type: nf4
16
- - bnb_4bit_use_double_quant: True
17
- - bnb_4bit_compute_dtype: bfloat16
18
-
19
- The following `bitsandbytes` quantization config was used during training:
20
- - quant_method: bitsandbytes
21
- - load_in_8bit: False
22
- - load_in_4bit: True
23
- - llm_int8_threshold: 6.0
24
- - llm_int8_skip_modules: None
25
- - llm_int8_enable_fp32_cpu_offload: False
26
- - llm_int8_has_fp16_weight: False
27
- - bnb_4bit_quant_type: nf4
28
- - bnb_4bit_use_double_quant: True
29
- - bnb_4bit_compute_dtype: bfloat16
30
-
31
  The following `bitsandbytes` quantization config was used during training:
32
  - quant_method: bitsandbytes
33
  - load_in_8bit: False
@@ -53,8 +29,6 @@ The following `bitsandbytes` quantization config was used during training:
53
  - bnb_4bit_compute_dtype: bfloat16
54
  ### Framework versions
55
 
56
- - PEFT 0.4.0
57
- - PEFT 0.4.0
58
  - PEFT 0.4.0
59
 
60
  - PEFT 0.4.0
 
4
  ## Training procedure
5
 
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  The following `bitsandbytes` quantization config was used during training:
8
  - quant_method: bitsandbytes
9
  - load_in_8bit: False
 
29
  - bnb_4bit_compute_dtype: bfloat16
30
  ### Framework versions
31
 
 
 
32
  - PEFT 0.4.0
33
 
34
  - PEFT 0.4.0
checkpoint-919/adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5163e95d72bdf26b13e3ccbb6c02aca6b81042bad316bc50851cd88b4c814a45
3
  size 109098378
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8754a69ca0f5cf8aacc1631367c947d1d0d3de09b99f1bd02a295c635d09111
3
  size 109098378
checkpoint-919/optimizer.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:406e1f2b88fbedb02260ae2a0d4ae06772ed40e3e9b20e5df8540ca85274601c
3
  size 218211962
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579a737fd98785e2d3636b8a7394805a3fbb939d2ae4c02d43d3a4502d56a8fd
3
  size 218211962
checkpoint-919/scheduler.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:89e8917d34638469d2ca830e146eea6301d70d66c169c772e2a4f1f474599a55
3
  size 1064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29dc2b858e027e717ae94f0fc3363bf0efcc098a78b050c0de81da6feb4eceda
3
  size 1064
checkpoint-919/trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
checkpoint-919/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75c3f8568aaf8b5dfbcb892da714ab8dbe1198201deb9ebda1b395708f7006af
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e1fde683410a24e241e9f6c20bab29175de26c53191b73f8124d15838780ad1
3
  size 4856