cminst
/

Llama-1B-Perturbed-BPE-init

Model card Files Files and versions

Llama-1B-Perturbed-BPE-init / tokenizer.json

Commit History

Init weights: Llama 1B (16L/2048H/32A/8KV) + perturbed BPE (p=0.3) 32K tokenizer

aad621c
verified

qingy2024 commited on May 12