Upload 15 files

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+axl_translate-q4_k_m_v2.gguf filter=lfs diff=lfs merge=lfs -text
+axl-translate-f16-v2.gguf filter=lfs diff=lfs merge=lfs -text
+axl-translate-f16-v3.gguf filter=lfs diff=lfs merge=lfs -text
+axl-translate-f16-v4.gguf filter=lfs diff=lfs merge=lfs -text
+axl-translate-f16.gguf filter=lfs diff=lfs merge=lfs -text
+axl-translate-q4_k_m_real.gguf filter=lfs diff=lfs merge=lfs -text

Modelfile

@@ -0,0 +1,14 @@
+FROM ./axl_translate-f16.gguf
+
+TEMPLATE """{{ .System }}
+
+User: {{ .Prompt }}
+Assistant: """
+
+SYSTEM """You are AXL-Translate, a code generation assistant built by Koinic."""
+
+PARAMETER temperature 0.8
+PARAMETER top_k 40
+PARAMETER top_p 0.9
+PARAMETER repeat_penalty 1.1
+PARAMETER num_ctx 256

README.md

@@ -1,3 +1,190 @@
 ---
 license: apache-2.0
+language:
+  - code
+tags:
+  - code-generation
+  - multi-scale-transformer
+  - cpu-optimized
+  - koinic
+  - pytorch
+  - llama
+  - gguf
+  - byte-level
+  - code-translation
+  - multi-language
+pipeline_tag: text-generation
+library_name: transformers
+datasets:
+  - koinic/axl-translation-pairs
+widget:
+  - text: "Translate:\ndef add(a, b):\n    return a + b\nResult:"
+model-index:
+  - name: AXL-Translate
+    results:
+      - task:
+          type: text-generation
+        metrics:
+          - name: Perplexity (byte-level)
+            type: perplexity
+            value: 1.86
 ---
+
+# AXL-Translate
+
+Code translation. Python-JS-Rust. 15.2M params. PPL 1.86. Context 256 bytes. Part of the AXL model family by [KoinicLabs](https://huggingface.co/KoinicLabs).
+
+## Model Details
+
+| Property | Value |
+|----------|-------|
+| Developed by | [KoinicLabs](https://huggingface.co/KoinicLabs) |
+| Architecture | Multi-Scale Transformer |
+| Parameters | 15M |
+| Optimizer | SGD |
+| Attention | SDPA |
+| Vocab Size | 258 (byte-level) |
+| Context Window | 256 bytes |
+| d_model | 256 |
+| Attention Heads | 4 |
+| Layers per Scale | 4 |
+| Downsample Factors | [1, 2, 4] |
+| License | Apache 2.0 |
+
+### Sources
+
+- **Repository:** [GitHub](https://github.com/Koinic/AXL)
+- **Organization:** [KoinicLabs](https://huggingface.co/KoinicLabs)
+
+## Uses
+
+### Direct Use
+
+Code translation between Python, JavaScript, Rust.
+
+```python
+import torch
+from multiscale_transformer.model.model import MultiScaleTransformer
+from multiscale_transformer.training.tokenizer import ByteTokenizer
+ckpt = torch.load("axl_translate.pt", map_location="cpu")
+model = MultiScaleTransformer(config)
+model.load_state_dict(ckpt["model_state_dict"])
+model.eval()
+tokenizer = ByteTokenizer()
+ids = torch.tensor([tokenizer.encode("def hello():")], dtype=torch.long)
+with torch.no_grad():
+    out = model.generate(ids, max_new_tokens=50, temperature=0.8)
+print(tokenizer.decode(out[0].tolist()))
+```
+
+### Out-of-Scope Use
+
+Not for general code generation. Translation-specific model only. For integration with tools like Continue.dev, LlamaIndex, or LangChain, use the Python API server which provides OpenAI-compatible endpoints.
+
+## Bias, Risks, and Limitations
+
+Byte-level perplexity is not comparable to BPE-level perplexity. Specialized for translation. Python/JS/Rust only. Max context 256 bytes. Note: GGUF files for Ollama use a simplified single-stack encoder. For full AXL quality, use the Python API server.
+
+### Recommendations
+
+- Use for prototyping and experimentation, not production code generation.
+- Byte-level perplexity (258 vocab) is not comparable to BPE-level perplexity (32K vocab).
+- For better results, use the Lion-optimized version if available.
+
+## Training Details
+
+### Training Data
+
+Rewritten from numpy to PyTorch. Trained with Lion on 3MB translation pairs. 10 min.
+
+### Preprocessing
+
+Byte-level tokenization with vocabulary size 258 (256 bytes + BOS + EOS). No vocabulary training required.
+
+### Speeds, Sizes, Times
+
+| Metric | Value |
+|--------|-------|
+| Training Steps | 3942 |
+| Training Time | 10 min |
+| Final Loss | 0.6703 |
+
+## Evaluation
+
+### Metrics
+
+Perplexity on held-out Python code using byte-level tokenization.
+
+### Results
+
+| Metric | Value |
+|--------|-------|
+| Perplexity (byte-level) | 1.86 |
+| Final Loss | 0.6703 |
+| Training Steps | 3942 |
+| Training Time | 10 min |
+
+**Summary:** Converts code between Python, JavaScript, and Rust.
+
+## Environmental Impact
+
+| Property | Value |
+|----------|-------|
+| Hardware | AMD Ryzen 5 5600G |
+| Hours Used | 0.167 |
+| Carbon Emitted | 0.0070 kg CO2 |
+| Cloud Provider | None (local CPU) |
+
+## Technical Specifications
+
+### Model Architecture
+
+Multi-Scale Transformer with three parallel encoder stacks at resolution scales 1x, 2x, and 4x. Cross-scale attention connects all scale pairs. Adaptive gating fusion. SwiGLU feed-forward. RoPE positional encoding.
+
+### Compute Infrastructure
+
+| Property | Value |
+|----------|-------|
+| Hardware | AMD Ryzen 5 5600G (6 cores, 12 threads) |
+| RAM | 16 GB |
+| GPU | None (CPU-only) |
+
+## Citation
+
+```bibtex
+@misc{axl_2026,
+  title={AXL: AXL-Translate - Multi-Scale Transformer for CPU Code Generation},
+  author={Koinic},
+  year={2026},
+  url={https://huggingface.co/KoinicLabs}
+}
+```
+
+## How to Get Started
+
+### With Ollama
+
+```bash
+ollama create axl-translate -f Modelfile
+ollama run axl-translate "def fibonacci():"
+```
+
+### With Python
+
+```python
+import torch
+from multiscale_transformer.model.config import load_config
+from multiscale_transformer.model.model import MultiScaleTransformer
+from multiscale_transformer.training.tokenizer import ByteTokenizer
+config = load_config("config.json")
+model = MultiScaleTransformer(config)
+ckpt = torch.load("axl_translate.pt", map_location="cpu")
+model.load_state_dict(ckpt["model_state_dict"])
+model.eval()
+tokenizer = ByteTokenizer()
+prompt = "def fibonacci():"
+ids = torch.tensor([tokenizer.encode(prompt)], dtype=torch.long)
+with torch.no_grad():
+    out = model.generate(ids, max_new_tokens=100, temperature=0.8, top_k=40)
+print(tokenizer.decode(out[0].tolist()))
+```

axl-translate-f16-v2.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36d437c8e240109075713e8613d38f17cbe3b56005c95b16061bb0ee649113db
+size 30503808

axl-translate-f16-v3.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:866df01df576fd6409a0acae7a2176de70cfd74c46aeecc14c07c96b2f9d5086
+size 30503808

axl-translate-f16-v4.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c56f7795cf9740eb06ff9f3d20e45928ef378d7f46b73104dad4f67fb7e3348c
+size 30500064

axl-translate-f16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2109bac554beb4528862a702fe0ed734aed6d186d7ea7bdf87813d005a2ea890
+size 30504224

axl-translate-q4_k_m_real.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cdbcf6d0d9d822c370b59d9e3f9d7184d6fabffb67f656ecf293ef72b5ce94a3
+size 17935136

axl_translate-q4_k_m_v2.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf2d3372888fd79686eeea9dab8f112b547eba7066e20f35a4434ceba8b1f2f3
+size 17934656

axl_translate.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6fb76618616b6bab83ac19c4f6c7acb8306e31cd4409a542dc2e891d7c9c5b62
+size 60789239

config.json

@@ -0,0 +1,31 @@
+{
+  "model_type": "multiscale_transformer",
+  "architectures": [
+    "MultiScaleForCausalLM"
+  ],
+  "vocab_size": 258,
+  "d_model": 256,
+  "n_heads": 4,
+  "d_ff": 688,
+  "n_layers_per_scale": 4,
+  "n_cross_attn_layers": 1,
+  "max_seq_len": 256,
+  "dropout": 0.0,
+  "bias": false,
+  "rope_theta": 10000.0,
+  "downsample_factors": [
+    1,
+    2,
+    4
+  ],
+  "num_parameters": 14376192,
+  "training_results": {
+    "model": "AXL-Translate",
+    "params": 15174400,
+    "steps": 3942,
+    "time": 600.0003161430359,
+    "final_loss": 0.6703445315361023,
+    "perplexity": 1.86,
+    "max_seq_len": 256
+  }
+}

generation_config.json

@@ -0,0 +1,8 @@
+{
+  "max_new_tokens": 256,
+  "temperature": 0.8,
+  "top_k": 40,
+  "top_p": 0.9,
+  "repetition_penalty": 1.1,
+  "do_sample": true
+}

index.html

@@ -0,0 +1,95 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<meta charset="UTF-8">
+<meta name="viewport" content="width=device-width,initial-scale=1.0">
+<title>AXL-Translate - AXL</title>
+<style>*{margin:0;padding:0;box-sizing:border-box}
+body{font-family:-apple-system,BlinkMacSystemFont,Segoe UI,Roboto,sans-serif;background:#0d1117;color:#c9d1d9;line-height:1.6}
+a{color:#58a6ff;text-decoration:none}a:hover{text-decoration:underline}
+.hero{padding:40px 20px;text-align:center;border-bottom:1px solid #30363d;background:linear-gradient(135deg,#0d1117,#161b22,#0d1117)}
+.hero h1{font-size:2.2rem;color:#fff;letter-spacing:-1px}
+.cat{display:inline-block;padding:3px 12px;border-radius:12px;font-size:.75rem;font-weight:600;margin-bottom:12px}
+.cat.Lion{background:#1f3a5f;color:#4285f4}
+.cat.SGD{background:#3d1f1f;color:#f85149}
+.cat.Specialized{background:#2d1b69;color:#bb86fc}
+.desc{color:#8b949e;font-size:.95rem;max-width:600px;margin:12px auto 0}
+.ms{display:flex;flex-wrap:wrap;gap:12px;justify-content:center;padding:24px 20px}
+.mc{background:#161b22;border:1px solid #30363d;border-radius:10px;padding:16px 24px;text-align:center;min-width:120px}
+.v{font-size:1.5rem;font-weight:700;color:#fff}.l{font-size:.75rem;color:#8b949e;margin-top:2px}
+.tabs{max-width:800px;margin:0 auto;padding:0 20px}
+.tabs>input[type=radio]{display:none}
+.tl{display:inline-block;background:#21262d;border:1px solid #30363d;color:#8b949e;padding:7px 16px;border-radius:8px;cursor:pointer;font-size:.85rem;margin:0 4px 16px;transition:all .2s}
+.tl:hover{background:#30363d;color:#c9d1d9}
+.p{display:none;background:#161b22;border:1px solid #30363d;border-radius:12px;padding:24px;margin-bottom:24px}
+#t1:checked~.p1,#t2:checked~.p2,#t3:checked~.p3,#t4:checked~.p4{display:block}
+#t1:checked+label[for=t1],#t2:checked+label[for=t2],#t3:checked+label[for=t3],#t4:checked+label[for=t4]{background:#bb86fc;color:#fff;border-color:#bb86fc}
+table{width:100%;border-collapse:collapse}
+th{text-align:left;color:#8b949e;font-size:.8rem;padding:8px 12px;border-bottom:1px solid #21262d;font-weight:600}
+td{padding:8px 12px;font-size:.9rem;border-bottom:1px solid #21262d}
+pre{background:#0d1117;padding:14px;border-radius:8px;overflow-x:auto;margin:12px 0}
+code{color:#c9d1d9;font-size:.82rem;line-height:1.5}
+.note{background:#21262d;border-left:3px solid #bb86fc;padding:12px 16px;border-radius:0 8px 8px 0;margin:12px 0;font-size:.85rem;color:#8b949e}
+.story{font-size:.9rem;color:#8b949e;line-height:1.6;margin:8px 0}
+.back{text-align:center;padding:24px 20px 40px}
+.back a{color:#58a6ff;font-size:.9rem}
+@media(max-width:768px){.hero h1{font-size:1.6rem}.ms{flex-direction:column;align-items:center}.mc{min-width:200px}}</style>
+</head>
+<body>
+<div class="hero">
+<div class="cat Specialized">Specialized Optimized</div>
+<h1>AXL-Translate</h1>
+<p class="desc">Code translation. Python-JS-Rust. 15.2M params. PPL 1.86. Context 256 bytes.</p>
+</div>
+<div class="ms">
+<div class="mc"><div class="v">15M</div><div class="l">Parameters</div></div>
+<div class="mc"><div class="v">1.86</div><div class="l">Perplexity</div></div>
+<div class="mc"><div class="v">10 min</div><div class="l">Training</div></div>
+<div class="mc"><div class="v">31 MB</div><div class="l">GGUF</div></div>
+</div>
+<div class="tabs">
+<input type="radio" name="t" id="t1" checked><label for="t1" class="tl">Specs</label>
+<input type="radio" name="t" id="t2"><label for="t2" class="tl">Training</label>
+<input type="radio" name="t" id="t3"><label for="t3" class="tl">Usage</label>
+<input type="radio" name="t" id="t4"><label for="t4" class="tl">Download</label>
+<div class="p p1">
+<table>
+<tr><th>Property</th><th>Value</th></tr>
+<tr><td>Architecture</td><td>Multi-Scale Transformer</td></tr>
+<tr><td>d_model</td><td>?</td></tr>
+<tr><td>Attention Heads</td><td>?</td></tr>
+<tr><td>Layers per Scale</td><td>?</td></tr>
+<tr><td>Context Window</td><td>256 bytes</td></tr>
+<tr><td>Downsample Factors</td><td>[1, 2, 4]</td></tr>
+<tr><td>Vocab Size</td><td>258 (byte-level)</td></tr>
+<tr><td>Optimizer</td><td>SGD</td></tr>
+</table>
+</div>
+<div class="p p2">
+<div class="story">Rewritten from numpy to PyTorch. Trained with Lion on 3MB translation pairs. 10 min.</div>
+<table>
+<tr><th>Metric</th><th>Value</th></tr>
+<tr><td>Final Loss</td><td>0.6703</td></tr>
+<tr><td>Perplexity</td><td>1.86</td></tr>
+<tr><td>Training Steps</td><td>3942</td></tr>
+<tr><td>Training Time</td><td>10 min</td></tr>
+</table>
+</div>
+<div class="p p3">
+<h3 style="color:#fff;margin-bottom:12px">Usage</h3>
+<pre><code>ollama create axl-translate -f Modelfile
+ollama run axl-translate "def fibonacci():"</code></pre>
+<div class="note">Converts code between Python, JavaScript, and Rust.</div>
+</div>
+<div class="p p4">
+<table>
+<tr><th>File</th><th>Size</th><th>Format</th></tr>
+<tr><td>F16 GGUF</td><td>31 MB</td><td>Full precision</td></tr>
+<tr><td>Q4_K_M GGUF</td><td>18 MB</td><td>4-bit quantized</td></tr>
+</table>
+<div class="note" style="margin-top:16px">GGUF files work with Ollama and llama.cpp. Q4_K_M is about 3x smaller than F16.</div>
+</div>
+</div>
+<div class="back"><a href="../">← All AXL Models</a></div>
+</body>
+</html>

results.json

@@ -0,0 +1,9 @@
+{
+  "model": "AXL-Translate",
+  "params": 15174400,
+  "steps": 3942,
+  "time": 600.0003161430359,
+  "final_loss": 0.6703445315361023,
+  "perplexity": 1.86,
+  "max_seq_len": 256
+}

special_tokens_map.json

@@ -0,0 +1,6 @@
+{
+  "pad_token": "[PAD]",
+  "bos_token": "[BOS]",
+  "eos_token": "[EOS]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,8 @@
+{
+  "tokenizer_class": "ByteTokenizer",
+  "vocab_size": 258,
+  "pad_token": "[PAD]",
+  "bos_token": "[BOS]",
+  "eos_token": "[EOS]",
+  "unk_token": "[UNK]"
+}