Text Generation
PEFT
TensorBoard
Safetensors
PyTorch
English
trl
sft
Generated from Trainer
Eval Results (legacy)
Instructions to use Menouar/phi-2-basic-maths with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Menouar/phi-2-basic-maths with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2") model = PeftModel.from_pretrained(base_model, "Menouar/phi-2-basic-maths") - Notebooks
- Google Colab
- Kaggle
Training in progress, epoch 1
Browse files
adapter_config.json
CHANGED
|
@@ -19,12 +19,12 @@
|
|
| 19 |
"rank_pattern": {},
|
| 20 |
"revision": null,
|
| 21 |
"target_modules": [
|
| 22 |
-
"q_proj",
|
| 23 |
-
"fc2",
|
| 24 |
"v_proj",
|
| 25 |
"k_proj",
|
| 26 |
-
"
|
| 27 |
-
"
|
|
|
|
|
|
|
| 28 |
],
|
| 29 |
"task_type": "CAUSAL_LM",
|
| 30 |
"use_rslora": false
|
|
|
|
| 19 |
"rank_pattern": {},
|
| 20 |
"revision": null,
|
| 21 |
"target_modules": [
|
|
|
|
|
|
|
| 22 |
"v_proj",
|
| 23 |
"k_proj",
|
| 24 |
+
"q_proj",
|
| 25 |
+
"fc2",
|
| 26 |
+
"dense",
|
| 27 |
+
"fc1"
|
| 28 |
],
|
| 29 |
"task_type": "CAUSAL_LM",
|
| 30 |
"use_rslora": false
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 755026760
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6509770e069c9e3dfb92beef713256016d344fd125fcea95fda9d851bc369a79
|
| 3 |
size 755026760
|
runs/Feb06_13-37-06_9e08d37cdcdf/events.out.tfevents.1707226635.9e08d37cdcdf.2041.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4238f9c2753c5a033a11601c5140b3dc5b3008fffd68025c99059a4f19ad505e
|
| 3 |
+
size 6331
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b949dc6c7871600ca38028dda8a49e67848d2b1d16475564f68313551a3d9fd4
|
| 3 |
size 4728
|