Pozify / configs /coach_summary_lora.default.json
nvti's picture
chore: update base model to NVIDIA-Nemotron-3-Nano-4B-BF16 across configurations and documentation; adjust max sequence length to 2048; upgrade GitHub Actions cache to v5
ad20540
Raw
History Blame Contribute Delete
499 Bytes
{
"base_model": "nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16",
"train_file": "/Users/h/Documents/Pozify/data/sft/coach_summary_train.jsonl",
"eval_file": "/Users/h/Documents/Pozify/data/sft/coach_summary_eval.jsonl",
"output_dir": "/Users/h/Documents/Pozify/models/coach_summary_lora",
"lora_r": 16,
"lora_alpha": 32,
"lora_dropout": 0.05,
"learning_rate": 0.0002,
"num_train_epochs": 2,
"per_device_train_batch_size": 1,
"gradient_accumulation_steps": 8,
"max_seq_length": 2048
}