Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ llama3.1-base
|
|
| 7 |
|
| 8 |
Base 3.1 weights with transplanted llama 3.3 special token embeddings.
|
| 9 |
|
| 10 |
-
Unusable for chat in base state, intended to enable easy instruct qlora tuning of llama 3.1 base.
|
|
|
|
|
|
|
| 11 |
|
| 12 |
|
|
|
|
| 7 |
|
| 8 |
Base 3.1 weights with transplanted llama 3.3 special token embeddings.
|
| 9 |
|
| 10 |
+
Unusable for chat in base state, intended to enable easy instruct qlora tuning of llama 3.1 base.
|
| 11 |
+
|
| 12 |
+
No need to target embeddings or lm_head.
|
| 13 |
|
| 14 |
|