| # Fine-tuned Model: Legal-gemma3-12b-it-lora | |
| ## 📚 Training Configuration | |
| - **data_path**: `QomSSLab/Legal_DS_SFT` | |
| - **output_dir**: `gemma312b_lora_chckpnts` | |
| - **new_model_name**: `Legal-gemma3-12b-it-lora` | |
| - **data_ratio**: `1.0` | |
| - **model_name**: `QomSSLab/Legal-gemma3-12b-pt-v2` | |
| - **use_4bit**: `False` | |
| - **use_lora**: `True` | |
| - **max_seq_length**: `9000` | |
| - **batch_size**: `1` | |
| - **gradient_accu**: `8` | |
| - **epochs**: `2` | |
| - **learning_rate**: `5e-05` | |
| - **lora_alpha**: `64` | |
| - **lora_drop**: `0.05` | |
| - **lora_r**: `64` | |
| - **tune_embedding_layer**: `False` | |
| - **hf_token**: `********` | |
| - **resume_from_checkpoint**: `True` | |
| - **use_8bit_optimizer**: `True` | |
| - **push_to_hub**: `True` | |
| --- | |
| Auto-generated after training. | |