Pavanb/fincausal_llama-2_instruction_tuning_lora

README.md

@@ -12,7 +12,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # results
 
-This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
+This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the None dataset.
 
 ## Model description
 
@@ -32,23 +32,19 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 4
-- eval_batch_size: 8
+- train_batch_size: 8
+- eval_batch_size: 16
 - seed: 42
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 16
+- total_train_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
 - training_steps: 200
 
-### Training results
-
-
-
 ### Framework versions
 
-- Transformers 4.33.1
+- Transformers 4.33.2
 - Pytorch 2.0.0
 - Datasets 2.1.0
 - Tokenizers 0.13.3

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:256a6b180d0263861d2c67e81da65213f643a08ebcb40606e9c2bccedce9cc33
+oid sha256:08d6e9f5754f73e82c879136b1afee6d56ea5b09ecdc05918a4c7225f67a1e9c
 size 134263757

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7b6a79aab4940e11585653d1a484b5f4c1d7565f41792ab5e67bea91b128e2e7
+oid sha256:7c32825168f5da892c4f0a5d1f5112d6c92dadbf0da798ea3dd927140943de98
 size 4027