nakcnx
/

typhoon-sql-qlora

Model card Files Files and versions

nakcnx commited on Jan 30, 2024

Commit

298a2f9

·

verified ·

1 Parent(s): ef9dd84

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ language:
 [Typhoon-7b](scb10x/typhoon-7b) QLoRA Finetune by unsloth with [SQL Context](b-mc2/sql-create-context) dataset.
 #### Training Hyperparameters
-Batch Size: 48 (4(BS)x4(GAS)x3(GPU))
 The following `bitsandbytes` quantization config was used during training:
 - r = 64
 - lora_alpha = 16

 [Typhoon-7b](scb10x/typhoon-7b) QLoRA Finetune by unsloth with [SQL Context](b-mc2/sql-create-context) dataset.
 #### Training Hyperparameters
+Batch Size: 48 (4(BS)x4(GAS)x3(GPU))
 The following `bitsandbytes` quantization config was used during training:
 - r = 64
 - lora_alpha = 16