Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
# On Gemma 4, `v_proj` does not exist on 5 of the 30 layers — and your LoRA config does not know it
|
|
@@ -360,4 +362,4 @@ Attention-logit control (background for consequence 3):
|
|
| 360 |
|
| 361 |
Code excerpts are from `huggingface/transformers`, Apache License 2.0. Gemma is
|
| 362 |
provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms.
|
| 363 |
-
"Gemma 4" is used descriptively; this article is not affiliated with or endorsed by Google.
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
base_model:
|
| 4 |
+
- google/gemma-4-26B-A4B-it
|
| 5 |
---
|
| 6 |
|
| 7 |
# On Gemma 4, `v_proj` does not exist on 5 of the 30 layers — and your LoRA config does not know it
|
|
|
|
| 362 |
|
| 363 |
Code excerpts are from `huggingface/transformers`, Apache License 2.0. Gemma is
|
| 364 |
provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms.
|
| 365 |
+
"Gemma 4" is used descriptively; this article is not affiliated with or endorsed by Google.
|