Model save

README.md

@@ -0,0 +1,62 @@
+---
+base_model: meta-llama/Meta-Llama-3-8B-Instruct
+library_name: peft
+license: llama3
+tags:
+- trl
+- sft
+- generated_from_trainer
+model-index:
+- name: P4_multi_without_retrieval_2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# P4_multi_without_retrieval_2
+
+This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 2
+- eval_batch_size: 4
+- seed: 42
+- distributed_type: multi-GPU
+- num_devices: 2
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 8
+- total_eval_batch_size: 8
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 2
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.13.1
+- Transformers 4.47.1
+- Pytorch 2.5.1+cu124
+- Datasets 2.19.0
+- Tokenizers 0.21.0

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f08cf52bba6d4cc68fa47fb03fb57252f3a0bbc9fd7dec00722436cb2fbdb20d
+oid sha256:55f83024641809f4d0b15f9e553259549b0a4eb76732a268bd989a22722b6761
 size 167832240

all_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 2.0,
+    "total_flos": 1.54790643235396e+18,
+    "train_loss": 0.3593486731773929,
+    "train_runtime": 16225.5696,
+    "train_samples": 28422,
+    "train_samples_per_second": 3.503,
+    "train_steps_per_second": 0.438
+}

runs/Jan17_22-29-29_f82d07273834/events.out.tfevents.1737181814.f82d07273834.1534445.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e6dafe90793963c54bd880521289970bf0a93e11eaefc1c80df148799b87acd7
-size 285366
+oid sha256:e73bdb924459d01e6a1b3f21c6a57cf877a4ec7f2eccbd8601ba593a67bdcbff
+size 307031

train_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 2.0,
+    "total_flos": 1.54790643235396e+18,
+    "train_loss": 0.3593486731773929,
+    "train_runtime": 16225.5696,
+    "train_samples": 28422,
+    "train_samples_per_second": 3.503,
+    "train_steps_per_second": 0.438
+}