Training in progress, epoch 3
Browse files- README.md +7 -3
- adapter_model.safetensors +1 -1
README.md
CHANGED
|
@@ -1,13 +1,16 @@
|
|
| 1 |
---
|
| 2 |
base_model: unsloth/mistral-7b-v0.3-bnb-4bit
|
| 3 |
-
library_name:
|
| 4 |
model_name: kto_simplification_balanced
|
| 5 |
tags:
|
| 6 |
-
-
|
| 7 |
- kto
|
| 8 |
-
-
|
|
|
|
| 9 |
- trl
|
|
|
|
| 10 |
licence: license
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
# Model Card for kto_simplification_balanced
|
|
@@ -35,6 +38,7 @@ This model was trained with KTO, a method introduced in [KTO: Model Alignment as
|
|
| 35 |
|
| 36 |
### Framework versions
|
| 37 |
|
|
|
|
| 38 |
- TRL: 0.24.0
|
| 39 |
- Transformers: 4.57.3
|
| 40 |
- Pytorch: 2.9.0
|
|
|
|
| 1 |
---
|
| 2 |
base_model: unsloth/mistral-7b-v0.3-bnb-4bit
|
| 3 |
+
library_name: peft
|
| 4 |
model_name: kto_simplification_balanced
|
| 5 |
tags:
|
| 6 |
+
- base_model:adapter:unsloth/mistral-7b-v0.3-bnb-4bit
|
| 7 |
- kto
|
| 8 |
+
- lora
|
| 9 |
+
- transformers
|
| 10 |
- trl
|
| 11 |
+
- unsloth
|
| 12 |
licence: license
|
| 13 |
+
pipeline_tag: text-generation
|
| 14 |
---
|
| 15 |
|
| 16 |
# Model Card for kto_simplification_balanced
|
|
|
|
| 38 |
|
| 39 |
### Framework versions
|
| 40 |
|
| 41 |
+
- PEFT 0.18.0
|
| 42 |
- TRL: 0.24.0
|
| 43 |
- Transformers: 4.57.3
|
| 44 |
- Pytorch: 2.9.0
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 167832240
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b999f9295c8f7650e1f04ce99f87a0028eda80872edb326f97d22e7f8c04c143
|
| 3 |
size 167832240
|