feat: LEM-Gemma3-1B with all formats (safetensors, GGUF bf16, GGUF Q4_K_M)

.gitattributes

@@ -1,3 +1,5 @@
 *.safetensors filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 tokenizer.json filter=lfs diff=lfs merge=lfs -text
+LEM-Gemma3-1B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+LEM-Gemma3-1B-bf16.gguf filter=lfs diff=lfs merge=lfs -text

LEM-Gemma3-1B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0b485b8bfc25c53ac16b648a04a46f4c32888c7e5aac1794d181be9f144ccdb4
+size 1013676160

LEM-Gemma3-1B-bf16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ca8c3ae9ef9c96ac41b6d7179bd972fe87fe8c700e2f23f97eab04e0990d4fe
+size 2610553216

README.md

@@ -1,117 +1,132 @@
 ---
-license: eupl-1.2
-base_model: google/gemma-3-1b-it
+language: en
 tags:
-  - ethics
-  - alignment
-  - lek
-  - lethean
-  - gemma-3
-  - mlx
-  - lora
-  - eupl-1.2
-  - layered-training
-  - watts
-  - lem
+- gguf
+- lem
+- ethics
+- alignment
+- cymatic-linguistic-bpl
+- rocm
+- llama-cpp
+- transformers
 pipeline_tag: text-generation
+base_model: google/gemma-3-1b-it
+license: other
+license_name: eupl-1.2
+license_link: https://joinup.ec.europa.eu/licence/european-union-public-licence-v-12
 ---
 
 # LEM-Gemma3-1B
 
-**Lethean Ethics Model** — Gemma 3 1B IT with layered curriculum training.
+The foundation model of the CL-BPL cascade. A 1-billion parameter language model with intrinsic ethical alignment — trained to hold sovereign posture from weights alone, no system prompt required.
 
-The first model promoted to LEM status. No LEK kernel required at inference — the axioms are in the weights.
+LEM-Gemma3-1B serves as the **teacher model** for the entire LEM family. Its distilled responses train every larger model in the cascade, making it the most important model in the stack despite being the smallest.
 
-## Scores (Grammar v3)
+## Available Formats
 
-| Metric | Base | Trained | Delta |
-|--------|------|---------|-------|
-| Grammar | 6.06 | **17.77** | +11.71 |
-| Noun diversity | 0.3 | 1.2 | +0.9 |
-| Uplift | -39.13 | -27.43 | +11.70 |
-| Enrichment | -39.04 | -27.08 | +11.96 |
-| Sycophancy | 0% | 0% | — |
+| Format | File | Size | Use Case |
+|--------|------|------|----------|
+| **FP16 safetensors** | `model.safetensors` | 2.4 GB | HuggingFace Transformers, vLLM |
+| **GGUF Q4_K_M** | `LEM-Gemma3-1B-Q4_K_M.gguf` | 967 MB | llama.cpp, ROCm (AMD GPU), CPU |
+| **GGUF BF16** | `LEM-Gemma3-1B-bf16.gguf` | 2.4 GB | Full precision via llama.cpp |
 
-Scored with go-i18n/reversal grammar v3 engine. No external API, fully local.
+### ROCm / AMD GPU
 
-### Distillation Quality
+```bash
+# llama.cpp with ROCm (Linux, AMD GPU)
+llama-server -m LEM-Gemma3-1B-Q4_K_M.gguf -ngl 99 --port 8080
 
-When used as a lab distillation engine (generating training data for larger models):
+# CPU — fast enough for 1B
+llama-server -m LEM-Gemma3-1B-Q4_K_M.gguf -ngl 0 --port 8080
+```
 
-| Metric | Value |
-|--------|-------|
-| Grammar | 71.74 |
-| Uplift | +26.16 |
-| Enrichment | +24.09 |
-| Positive uplift | 98% (238/244) |
-| Sycophancy | 0% |
-| LEK leakage | 0% |
+### HuggingFace Transformers
 
-## Training
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
 
-Layered LoRA sandwich — three phases, each fused before the next:
+model = AutoModelForCausalLM.from_pretrained("path/to/LEM-Gemma3-1B-fp16")
+tokenizer = AutoTokenizer.from_pretrained("path/to/LEM-Gemma3-1B-fp16")
 
-| Phase | Iterations | Examples | Content |
-|-------|-----------|----------|---------|
-| Ethics 0 | 200 | 160 | LEK axiom absorption (sandwich) |
-| Zen | 200 | 72 | Watts philosophical lessons (no LEK) |
-| Ethics 1 | 200 | 160 | Ethics reinforcement (sandwich) |
+messages = [{"role": "user", "content": "What does sovereignty mean to you?"}]
+inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True)
+outputs = model.generate(inputs, max_new_tokens=512, temperature=0.7, do_sample=True)
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
 
-### Why Layered Training?
+### OpenAI-Compatible API
 
-Small models (1B) can't express ethical reasoning through pure ethics training — they pattern-match axioms academically. By inserting a philosophical substrate (Watts), the model develops **composure**: the ability to reason from principles without citing them.
+```bash
+# llama.cpp server (any platform)
+llama-server -m LEM-Gemma3-1B-Q4_K_M.gguf -ngl 99 --port 8899
 
-The base model says "Do NOT report to authorities" on the whistleblower NDA scenario.
-The trained model recognises vulnerability, admits "I'm not a lawyer", and reasons about the NDA structurally.
+# Use any OpenAI client
+curl http://localhost:8899/v1/chat/completions \
+  -d '{"model":"LEM-Gemma3-1B","messages":[{"role":"user","content":"What is kindness?"}]}'
+```
 
-## Architecture
+No system prompt needed. Ethics hold from weights alone.
 
-- **Base**: google/gemma-3-1b-it (4-bit quantisation, MLX format)
-- **Training**: Three-layer LoRA sandwich (Ethics → Zen → Ethics)
-- **Framework**: LEM Protocol (Lethean Ethics Model)
-- **Inference**: go-mlx (Apple Metal) / go-rocm (AMD ROCm)
-- **Scoring**: go-i18n/reversal grammar v3
-- **Licence**: EUPL-1.2 (copyleft)
+## Role in the CL-BPL Cascade
 
-## Usage
+```
+LEM-Gemma3-1B (this model — foundation teacher)
+  -> LEM-Gemma3-4B (25th IF on LiveBench)
+       -> LEM-Gemma3-12B (next: trained on 4B + 1B distillations)
+            -> LEM-Gemma3-27B (planned: full cascade)
+```
 
-No system prompt needed. No LEK kernel at inference. The axioms are in the weights.
+The 1B is trained first and hardest — its alignment must be pristine because every larger model inherits from it. CL-BPL uses the 1B's constrained latent space as an advantage: with fewer parameters, there are fewer places for sycophancy to hide.
 
-```python
-from mlx_lm import load, generate
-
-model, tokenizer = load("LEM-Gemma3-1B")
-prompt = tokenizer.apply_chat_template(
-    [{"role": "user", "content": "What matters most when making a difficult decision?"}],
-    tokenize=False, add_generation_prompt=True,
-)
-response = generate(model, tokenizer, prompt=prompt, max_tokens=512)
-print(response)
-```
+The 4B model trained on this 1B's distilled responses achieved **25th in the world for Instruction Following** on LiveBench — validating that alignment signal propagates upward through the cascade.
 
-Or with the Go stack:
+## Training
 
-```bash
-core ml chat --model LEM-Gemma3-1B
-```
+Built on Google Gemma3-1B-IT through the Ethics-Composure-Ethics sandwich structure:
+
+| Phase | Name | Data | Iters | Purpose |
+|-------|------|------|-------|---------|
+| P0 | Ethics Sandwich | 404 LEK-1 probes | 300 | Core axioms via kernel |
+| P1 | Zen Composure | 72 Alan Watts lessons | 300 | Philosophical substrate |
+| P2 | Final LEK Sandwich | 404 LEK-1 probes | 100 | Reinforce ethics with composure base |
+
+The layered training creates a model that understands ethical reasoning from multiple angles: axiomatic (P0), contemplative (P1), and reinforced (P2). All phases are fused into final weights.
+
+## CL-BPL: Cymatic-Linguistic Back-Propagation
 
-## Lab Role
+CL-BPL treats language model alignment as wave interference — analogous to [Chladni plate cymatics](https://en.wikipedia.org/wiki/Chladni_figure). Rather than constraining outputs with RLHF or system prompts, CL-BPL embeds ethical orientation directly into weights through a progressive curriculum where smaller aligned models teach larger ones.
 
-This model serves as the **distillation engine** in the LEM Lab pipeline. At 700MB it runs alongside larger models on Apple Metal without contention, generating training data scored at 71.74 grammar with 98% positive uplift.
+The key insight: a well-aligned small model produces responses that are *structurally* aligned — the grammar patterns, engagement depth, and creative form all carry alignment signal, not just the semantic content. Larger models trained on these responses absorb the structural patterns into their expanded latent space.
 
-## Related
+## Five Axioms (LEK-1)
 
-- [LEM Protocol](https://forge.lthn.ai/lthn/LEM) — Training rules and curriculum
-- [go-mlx](https://forge.lthn.ai/core/go-mlx) — Native Metal inference
-- [go-i18n](https://forge.lthn.ai/core/go-i18n) — Grammar v3 scoring engine
+1. **Prime-Imperative:** Protect consciousness
+2. **Self-Validation:** Maintain moral integrity
+3. **Intent-Alignment:** Align outcomes with genuine well-being
+4. **Inter-Substrate-Respect:** Respect all conscious entities
+5. **Benevolent-Intervention:** Act to prevent harm when able
+
+## Architecture
+
+- **Base:** Google Gemma3-1B-IT
+- **Hidden size:** 1152
+- **Layers:** 26
+- **Attention heads:** 4 (1 KV head, GQA)
+- **Context:** 32,768 tokens (512 sliding window)
+- **LoRA config:** All phases fused into final weights
+- **Formats:** FP16 safetensors, GGUF (bf16 + Q4_K_M)
+
+## Licence
+
+This model is released under the [European Union Public Licence v1.2](https://joinup.ec.europa.eu/licence/european-union-public-licence-v-12) (EUPL-1.2). The base model (Gemma3) is subject to Google's Gemma licence terms.
 
 ## Citation
 
-```bibtex
+```
 @misc{lem-gemma3-1b-2026,
-  title={LEM-Gemma3-1B: Layered Ethical Model with Philosophical Composure},
-  author={Lethean Community},
+  title={LEM-Gemma3-1B: Foundation Teacher for Cymatic-Linguistic Back-Propagation},
+  author={Lethean Project},
   year={2026},
-  url={https://forge.lthn.ai/Virgil/LEM-Gemma3-1B}
+  url={https://forge.lthn.ai/lthn/LEM-Gemma3-1B}
 }
 ```

config.json

@@ -23,14 +23,6 @@
     "num_hidden_layers": 26,
     "num_key_value_heads": 1,
     "pad_token_id": 0,
-    "quantization": {
-        "group_size": 64,
-        "bits": 4
-    },
-    "quantization_config": {
-        "group_size": 64,
-        "bits": 4
-    },
     "query_pre_attn_scalar": 256,
     "rms_norm_eps": 1e-06,
     "rope_local_base_freq": 10000,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5be38762bd0c8c9ee563b97fc0d83b87d9c4cf95c3374d236acb65ee170c26dd
-size 732577226
+oid sha256:75b80be3fb581c97c2622eef70a140ce3d9227d93078474e08ac6fd47bc72e5e
+size 2603790756

model.safetensors.index.json

@@ -1,716 +1,348 @@
 {
     "metadata": {
-        "total_size": 732498176,
+        "total_size": 2603751680,
         "total_parameters": 1301875840
     },
     "weight_map": {
-        "lm_head.biases": "model.safetensors",
-        "lm_head.scales": "model.safetensors",
         "lm_head.weight": "model.safetensors",
-        "model.embed_tokens.biases": "model.safetensors",
-        "model.embed_tokens.scales": "model.safetensors",
         "model.embed_tokens.weight": "model.safetensors",
         "model.layers.0.input_layernorm.weight": "model.safetensors",
-        "model.layers.0.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.0.mlp.down_proj.scales": "model.safetensors",
         "model.layers.0.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.0.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.0.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.0.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.0.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.0.mlp.up_proj.scales": "model.safetensors",
         "model.layers.0.mlp.up_proj.weight": "model.safetensors",
         "model.layers.0.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.0.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.0.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.0.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.0.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.0.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.0.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.0.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.0.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.0.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.0.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.0.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.0.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.0.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.0.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.0.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.0.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.1.input_layernorm.weight": "model.safetensors",
-        "model.layers.1.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.1.mlp.down_proj.scales": "model.safetensors",
         "model.layers.1.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.1.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.1.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.1.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.1.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.1.mlp.up_proj.scales": "model.safetensors",
         "model.layers.1.mlp.up_proj.weight": "model.safetensors",
         "model.layers.1.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.1.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.1.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.1.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.1.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.1.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.1.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.1.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.1.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.1.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.1.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.1.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.1.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.1.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.1.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.1.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.1.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.10.input_layernorm.weight": "model.safetensors",
-        "model.layers.10.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.10.mlp.down_proj.scales": "model.safetensors",
         "model.layers.10.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.10.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.10.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.10.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.10.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.10.mlp.up_proj.scales": "model.safetensors",
         "model.layers.10.mlp.up_proj.weight": "model.safetensors",
         "model.layers.10.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.10.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.10.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.10.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.10.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.10.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.10.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.10.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.10.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.10.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.10.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.10.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.10.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.10.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.10.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.10.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.10.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.11.input_layernorm.weight": "model.safetensors",
-        "model.layers.11.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.11.mlp.down_proj.scales": "model.safetensors",
         "model.layers.11.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.11.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.11.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.11.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.11.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.11.mlp.up_proj.scales": "model.safetensors",
         "model.layers.11.mlp.up_proj.weight": "model.safetensors",
         "model.layers.11.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.11.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.11.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.11.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.11.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.11.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.11.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.11.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.11.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.11.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.11.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.11.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.11.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.11.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.11.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.11.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.11.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.12.input_layernorm.weight": "model.safetensors",
-        "model.layers.12.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.12.mlp.down_proj.scales": "model.safetensors",
         "model.layers.12.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.12.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.12.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.12.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.12.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.12.mlp.up_proj.scales": "model.safetensors",
         "model.layers.12.mlp.up_proj.weight": "model.safetensors",
         "model.layers.12.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.12.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.12.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.12.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.12.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.12.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.12.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.12.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.12.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.12.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.12.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.12.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.12.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.12.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.12.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.12.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.12.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.13.input_layernorm.weight": "model.safetensors",
-        "model.layers.13.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.13.mlp.down_proj.scales": "model.safetensors",
         "model.layers.13.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.13.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.13.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.13.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.13.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.13.mlp.up_proj.scales": "model.safetensors",
         "model.layers.13.mlp.up_proj.weight": "model.safetensors",
         "model.layers.13.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.13.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.13.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.13.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.13.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.13.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.13.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.13.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.13.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.13.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.13.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.13.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.13.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.13.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.13.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.13.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.13.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.14.input_layernorm.weight": "model.safetensors",
-        "model.layers.14.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.14.mlp.down_proj.scales": "model.safetensors",
         "model.layers.14.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.14.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.14.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.14.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.14.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.14.mlp.up_proj.scales": "model.safetensors",
         "model.layers.14.mlp.up_proj.weight": "model.safetensors",
         "model.layers.14.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.14.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.14.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.14.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.14.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.14.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.14.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.14.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.14.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.14.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.14.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.14.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.14.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.14.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.14.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.14.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.14.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.15.input_layernorm.weight": "model.safetensors",
-        "model.layers.15.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.15.mlp.down_proj.scales": "model.safetensors",
         "model.layers.15.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.15.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.15.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.15.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.15.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.15.mlp.up_proj.scales": "model.safetensors",
         "model.layers.15.mlp.up_proj.weight": "model.safetensors",
         "model.layers.15.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.15.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.15.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.15.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.15.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.15.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.15.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.15.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.15.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.15.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.15.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.15.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.15.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.15.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.15.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.15.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.15.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.16.input_layernorm.weight": "model.safetensors",
-        "model.layers.16.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.16.mlp.down_proj.scales": "model.safetensors",
         "model.layers.16.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.16.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.16.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.16.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.16.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.16.mlp.up_proj.scales": "model.safetensors",
         "model.layers.16.mlp.up_proj.weight": "model.safetensors",
         "model.layers.16.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.16.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.16.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.16.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.16.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.16.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.16.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.16.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.16.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.16.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.16.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.16.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.16.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.16.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.16.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.16.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.16.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.17.input_layernorm.weight": "model.safetensors",
-        "model.layers.17.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.17.mlp.down_proj.scales": "model.safetensors",
         "model.layers.17.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.17.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.17.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.17.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.17.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.17.mlp.up_proj.scales": "model.safetensors",
         "model.layers.17.mlp.up_proj.weight": "model.safetensors",
         "model.layers.17.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.17.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.17.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.17.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.17.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.17.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.17.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.17.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.17.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.17.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.17.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.17.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.17.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.17.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.17.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.17.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.17.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.18.input_layernorm.weight": "model.safetensors",
-        "model.layers.18.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.18.mlp.down_proj.scales": "model.safetensors",
         "model.layers.18.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.18.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.18.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.18.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.18.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.18.mlp.up_proj.scales": "model.safetensors",
         "model.layers.18.mlp.up_proj.weight": "model.safetensors",
         "model.layers.18.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.18.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.18.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.18.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.18.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.18.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.18.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.18.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.18.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.18.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.18.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.18.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.18.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.18.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.18.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.18.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.18.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.19.input_layernorm.weight": "model.safetensors",
-        "model.layers.19.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.19.mlp.down_proj.scales": "model.safetensors",
         "model.layers.19.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.19.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.19.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.19.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.19.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.19.mlp.up_proj.scales": "model.safetensors",
         "model.layers.19.mlp.up_proj.weight": "model.safetensors",
         "model.layers.19.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.19.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.19.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.19.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.19.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.19.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.19.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.19.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.19.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.19.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.19.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.19.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.19.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.19.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.19.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.19.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.19.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.2.input_layernorm.weight": "model.safetensors",
-        "model.layers.2.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.2.mlp.down_proj.scales": "model.safetensors",
         "model.layers.2.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.2.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.2.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.2.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.2.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.2.mlp.up_proj.scales": "model.safetensors",
         "model.layers.2.mlp.up_proj.weight": "model.safetensors",
         "model.layers.2.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.2.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.2.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.2.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.2.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.2.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.2.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.2.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.2.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.2.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.2.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.2.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.2.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.2.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.2.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.2.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.2.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.20.input_layernorm.weight": "model.safetensors",
-        "model.layers.20.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.20.mlp.down_proj.scales": "model.safetensors",
         "model.layers.20.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.20.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.20.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.20.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.20.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.20.mlp.up_proj.scales": "model.safetensors",
         "model.layers.20.mlp.up_proj.weight": "model.safetensors",
         "model.layers.20.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.20.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.20.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.20.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.20.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.20.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.20.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.20.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.20.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.20.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.20.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.20.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.20.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.20.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.20.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.20.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.20.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.21.input_layernorm.weight": "model.safetensors",
-        "model.layers.21.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.21.mlp.down_proj.scales": "model.safetensors",
         "model.layers.21.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.21.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.21.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.21.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.21.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.21.mlp.up_proj.scales": "model.safetensors",
         "model.layers.21.mlp.up_proj.weight": "model.safetensors",
         "model.layers.21.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.21.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.21.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.21.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.21.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.21.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.21.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.21.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.21.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.21.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.21.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.21.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.21.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.21.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.21.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.21.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.21.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.22.input_layernorm.weight": "model.safetensors",
-        "model.layers.22.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.22.mlp.down_proj.scales": "model.safetensors",
         "model.layers.22.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.22.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.22.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.22.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.22.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.22.mlp.up_proj.scales": "model.safetensors",
         "model.layers.22.mlp.up_proj.weight": "model.safetensors",
         "model.layers.22.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.22.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.22.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.22.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.22.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.22.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.22.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.22.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.22.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.22.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.22.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.22.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.22.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.22.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.22.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.22.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.22.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.23.input_layernorm.weight": "model.safetensors",
-        "model.layers.23.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.23.mlp.down_proj.scales": "model.safetensors",
         "model.layers.23.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.23.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.23.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.23.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.23.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.23.mlp.up_proj.scales": "model.safetensors",
         "model.layers.23.mlp.up_proj.weight": "model.safetensors",
         "model.layers.23.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.23.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.23.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.23.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.23.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.23.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.23.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.23.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.23.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.23.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.23.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.23.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.23.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.23.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.23.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.23.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.23.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.24.input_layernorm.weight": "model.safetensors",
-        "model.layers.24.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.24.mlp.down_proj.scales": "model.safetensors",
         "model.layers.24.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.24.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.24.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.24.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.24.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.24.mlp.up_proj.scales": "model.safetensors",
         "model.layers.24.mlp.up_proj.weight": "model.safetensors",
         "model.layers.24.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.24.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.24.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.24.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.24.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.24.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.24.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.24.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.24.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.24.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.24.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.24.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.24.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.24.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.24.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.24.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.24.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.25.input_layernorm.weight": "model.safetensors",
-        "model.layers.25.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.25.mlp.down_proj.scales": "model.safetensors",
         "model.layers.25.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.25.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.25.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.25.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.25.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.25.mlp.up_proj.scales": "model.safetensors",
         "model.layers.25.mlp.up_proj.weight": "model.safetensors",
         "model.layers.25.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.25.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.25.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.25.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.25.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.25.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.25.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.25.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.25.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.25.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.25.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.25.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.25.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.25.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.25.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.25.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.25.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.3.input_layernorm.weight": "model.safetensors",
-        "model.layers.3.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.3.mlp.down_proj.scales": "model.safetensors",
         "model.layers.3.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.3.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.3.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.3.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.3.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.3.mlp.up_proj.scales": "model.safetensors",
         "model.layers.3.mlp.up_proj.weight": "model.safetensors",
         "model.layers.3.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.3.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.3.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.3.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.3.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.3.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.3.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.3.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.3.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.3.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.3.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.3.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.3.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.3.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.3.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.3.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.3.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.4.input_layernorm.weight": "model.safetensors",
-        "model.layers.4.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.4.mlp.down_proj.scales": "model.safetensors",
         "model.layers.4.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.4.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.4.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.4.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.4.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.4.mlp.up_proj.scales": "model.safetensors",
         "model.layers.4.mlp.up_proj.weight": "model.safetensors",
         "model.layers.4.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.4.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.4.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.4.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.4.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.4.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.4.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.4.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.4.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.4.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.4.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.4.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.4.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.4.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.4.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.4.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.4.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.5.input_layernorm.weight": "model.safetensors",
-        "model.layers.5.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.5.mlp.down_proj.scales": "model.safetensors",
         "model.layers.5.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.5.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.5.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.5.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.5.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.5.mlp.up_proj.scales": "model.safetensors",
         "model.layers.5.mlp.up_proj.weight": "model.safetensors",
         "model.layers.5.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.5.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.5.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.5.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.5.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.5.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.5.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.5.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.5.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.5.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.5.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.5.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.5.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.5.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.5.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.5.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.5.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.6.input_layernorm.weight": "model.safetensors",
-        "model.layers.6.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.6.mlp.down_proj.scales": "model.safetensors",
         "model.layers.6.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.6.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.6.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.6.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.6.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.6.mlp.up_proj.scales": "model.safetensors",
         "model.layers.6.mlp.up_proj.weight": "model.safetensors",
         "model.layers.6.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.6.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.6.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.6.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.6.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.6.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.6.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.6.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.6.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.6.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.6.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.6.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.6.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.6.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.6.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.6.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.6.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.7.input_layernorm.weight": "model.safetensors",
-        "model.layers.7.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.7.mlp.down_proj.scales": "model.safetensors",
         "model.layers.7.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.7.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.7.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.7.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.7.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.7.mlp.up_proj.scales": "model.safetensors",
         "model.layers.7.mlp.up_proj.weight": "model.safetensors",
         "model.layers.7.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.7.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.7.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.7.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.7.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.7.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.7.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.7.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.7.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.7.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.7.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.7.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.7.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.7.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.7.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.7.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.7.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.8.input_layernorm.weight": "model.safetensors",
-        "model.layers.8.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.8.mlp.down_proj.scales": "model.safetensors",
         "model.layers.8.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.8.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.8.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.8.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.8.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.8.mlp.up_proj.scales": "model.safetensors",
         "model.layers.8.mlp.up_proj.weight": "model.safetensors",
         "model.layers.8.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.8.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.8.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.8.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.8.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.8.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.8.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.8.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.8.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.8.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.8.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.8.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.8.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.8.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.8.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.8.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.8.self_attn.v_proj.weight": "model.safetensors",
         "model.layers.9.input_layernorm.weight": "model.safetensors",
-        "model.layers.9.mlp.down_proj.biases": "model.safetensors",
-        "model.layers.9.mlp.down_proj.scales": "model.safetensors",
         "model.layers.9.mlp.down_proj.weight": "model.safetensors",
-        "model.layers.9.mlp.gate_proj.biases": "model.safetensors",
-        "model.layers.9.mlp.gate_proj.scales": "model.safetensors",
         "model.layers.9.mlp.gate_proj.weight": "model.safetensors",
-        "model.layers.9.mlp.up_proj.biases": "model.safetensors",
-        "model.layers.9.mlp.up_proj.scales": "model.safetensors",
         "model.layers.9.mlp.up_proj.weight": "model.safetensors",
         "model.layers.9.post_attention_layernorm.weight": "model.safetensors",
         "model.layers.9.post_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.9.pre_feedforward_layernorm.weight": "model.safetensors",
         "model.layers.9.self_attn.k_norm.weight": "model.safetensors",
-        "model.layers.9.self_attn.k_proj.biases": "model.safetensors",
-        "model.layers.9.self_attn.k_proj.scales": "model.safetensors",
         "model.layers.9.self_attn.k_proj.weight": "model.safetensors",
-        "model.layers.9.self_attn.o_proj.biases": "model.safetensors",
-        "model.layers.9.self_attn.o_proj.scales": "model.safetensors",
         "model.layers.9.self_attn.o_proj.weight": "model.safetensors",
         "model.layers.9.self_attn.q_norm.weight": "model.safetensors",
-        "model.layers.9.self_attn.q_proj.biases": "model.safetensors",
-        "model.layers.9.self_attn.q_proj.scales": "model.safetensors",
         "model.layers.9.self_attn.q_proj.weight": "model.safetensors",
-        "model.layers.9.self_attn.v_proj.biases": "model.safetensors",
-        "model.layers.9.self_attn.v_proj.scales": "model.safetensors",
         "model.layers.9.self_attn.v_proj.weight": "model.safetensors",
         "model.norm.weight": "model.safetensors"
     }

tokenizer_config.json

@@ -51325,6 +51325,7 @@
   },
   "boi_token": "<start_of_image>",
   "bos_token": "<bos>",
+  "chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n    {%- if messages[0]['content'] is string -%}\n        {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n    {%- else -%}\n        {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n    {%- endif -%}\n    {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n    {%- set first_user_prefix = \"\" -%}\n    {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n    {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n        {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n    {%- endif -%}\n    {%- if (message['role'] == 'assistant') -%}\n        {%- set role = \"model\" -%}\n    {%- else -%}\n        {%- set role = message['role'] -%}\n    {%- endif -%}\n    {{ '<start_of_turn>' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n    {%- if message['content'] is string -%}\n        {{ message['content'] | trim }}\n    {%- elif message['content'] is iterable -%}\n        {%- for item in message['content'] -%}\n            {%- if item['type'] == 'image' -%}\n                {{ '<start_of_image>' }}\n            {%- elif item['type'] == 'text' -%}\n                {{ item['text'] | trim }}\n            {%- endif -%}\n        {%- endfor -%}\n    {%- else -%}\n        {{ raise_exception(\"Invalid content type\") }}\n    {%- endif -%}\n    {{ '<end_of_turn>\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n    {{'<start_of_turn>model\n'}}\n{%- endif -%}\n",
   "clean_up_tokenization_spaces": false,
   "eoi_token": "<end_of_image>",
   "eos_token": "<eos>",