QomSSLab
/

Legal-gemma3-27b-pt-lora

Model card Files Files and versions

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Fine-tuned Model: Legal-gemma3-27b-pt-lora

📚 Training Configuration

data_path: QomSSLab/Legal_DS_PT
text_column: text
output_dir: gemma327b_lora_chckpnts
new_model_name: Legal-gemma3-27b-pt-lora
model_name: gemma-3-27b-pt-ForCausalLM
use_4bit: False
use_lora: True
max_seq_length: 1000
batch_size: 1
gradient_accu: 4
epochs: 3
learning_rate: 5e-05
lora_alpha: 256
lora_drop: 0.05
lora_r: 256
tune_embedding_layer: False
hf_token: ********
resume_from_checkpoint: True
use_8bit_optimizer: True
push_to_hub: True

Auto-generated after training.

Downloads last month: 1

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support