File size: 319 Bytes
39548c0 8bf9f24 39548c0 c26d8b8 23ad26e 39548c0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | ---
base_model:
- meta-llama/Llama-3.1-70B
---
# NOT SUITABLE FOR CHAT INFERENCE AS-IS
llama3.1-base
Base 3.1 weights with transplanted llama 3.3 special token embeddings.
Unusable for chat in base state, intended to enable easy instruct qlora tuning of llama 3.1 base.
No need to target embeddings or lm_head.
|