cminst
/

Llama-1B-Perturbed-BPE-init

Model card Files Files and versions

Llama-1B-Perturbed-BPE-init / tokenizer.json

qingy2024's picture

Init weights: Llama 1B (16L/2048H/32A/8KV) + perturbed BPE (p=0.3) 32K tokenizer

aad621c verified 3 months ago

History Contribute Delete

2.04 MB

File too large to display, you can check the raw version instead.