qare-bitnet-lora / train_config.json
UlukaDev's picture
QARE: BitNet b1.58 LoRA adapter + runtime
8a46533 verified
Raw
History Blame Contribute Delete
278 Bytes
{
"data_dir": "dataset",
"out": "/content/drive/MyDrive/qare-lora-v3",
"model": "microsoft/bitnet-b1.58-2B-4T-bf16",
"epochs": 3.0,
"bs": 8,
"grad_accum": 2,
"lr": 0.0001,
"maxlen": 768,
"lora_r": 16,
"lora_alpha": 32,
"max_steps": -1,
"full_ft": false
}