Model save

README.md

@@ -0,0 +1,62 @@
+---
+library_name: transformers
+tags:
+- generated_from_trainer
+model-index:
+- name: CPT_data
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# CPT_data
+
+This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.9953
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-06
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- distributed_type: multi-GPU
+- num_devices: 2
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 32
+- total_eval_batch_size: 16
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 200
+- num_epochs: 1
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 2.027         | 1.0   | 944  | 1.9953          |
+
+
+### Framework versions
+
+- Transformers 4.46.2
+- Pytorch 2.5.1+cu124
+- Datasets 3.1.0
+- Tokenizers 0.20.1

generation_config.json

@@ -0,0 +1,9 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": 128001,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.46.2"
+}

model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:00a8b5ed0d3efe5d607ceba1089ca27c25381ebf1490f00e465608de0f9215cf
+oid sha256:48ae92f63151d847d389552ea999e4058157e14431e2358e356f873fb7f504d8
 size 4976698672

model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1a192f1168daec542caec48196b49a0e93bf48438361e156d103444cd458dea6
+oid sha256:b9be42696b949f331af4c91c6c4323c68efcbdb7ecbf2030cc9c3754e975bbc3
 size 4999802720

model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d031b92323855c8900ee6632c2e4b6ed279a223be7df5d263870a92794c63554
+oid sha256:df0587bb9c0eaacef90dd5ab731eae37731e8beb016c5c967629e5214d28c02d
 size 4915916176

model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fea4795e5390dd5dc0e99e78deeef049e86fded598a91c1dc42d24be7053f59b
+oid sha256:e29981fdc882db895a03f7c63c74b0c6672dfd88799d4589d639f205261bcd95
 size 1168138808