Initial v0.1 closed-beta release

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+CipherModel-1.5B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text

CipherModel-1.5B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc324af070c2ecbfd324a30884d2f951a7ff756aba85cb811a6ec436933bb046
+size 1117320768

README.md

@@ -0,0 +1,110 @@
+---
+license: apache-2.0
+language:
+- en
+base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
+pipeline_tag: text-generation
+tags:
+- code
+- coding-assistant
+- llama-cpp
+- gguf
+- ciphercode
+- vscode
+library_name: gguf
+---
+
+# CipherModel-1.5B
+
+> **The model behind CipherCode™ — the AI coding assistant that writes code the way YOU would.**
+> Closed-beta v0.1, by **Lila AI LLC**.
+
+This repository hosts the GGUF Q4_K_M quantization served by the [CipherCode VS Code extension](https://github.com/lila-ai-llc/ciphercode-vscode) (closed beta). It is built on top of [Qwen/Qwen2.5-Coder-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct) and is suitable for inline code completion, refactor / explain / fix / docstring tasks, and short conversational coding chat.
+
+## What's in this repo
+
+| File | Size | Format |
+|---|---|---|
+| `CipherModel-1.5B-Q4_K_M.gguf` | ~1.07 GB | GGUF Q4_K_M (llama.cpp) |
+
+## What this is
+
+- **A redistribution of `Qwen2.5-Coder-1.5B-Instruct` in GGUF Q4_K_M format**, branded as CipherModel-1.5B for use in the CipherCode extension's closed beta.
+- **No fine-tuning has been applied yet at v0.1.** The "Cipher Persona" style adaptation that ships with CipherCode operates entirely at the system-prompt level, injecting the developer's detected style into every request — model weights are unchanged from base Qwen.
+- A future v0.2+ release of this repo will contain a true LoRA fine-tune merged into the base.
+
+## Usage
+
+### Via the CipherCode VS Code extension (recommended)
+
+```bash
+# Friends of Lila AI: install the .vsix sent to you privately
+code --install-extension ciphercode-0.1.0.vsix
+```
+
+The extension talks to a private Cloud Run endpoint that serves this model via `llama-server`. End users of the extension never need to download this GGUF themselves.
+
+### Direct with llama.cpp
+
+```bash
+# Download the GGUF
+huggingface-cli download guhantech/CipherModel-1.5B CipherModel-1.5B-Q4_K_M.gguf --local-dir .
+
+# Run llama-server
+llama-server \
+  -m CipherModel-1.5B-Q4_K_M.gguf \
+  --host 0.0.0.0 --port 8080 \
+  --ctx-size 4096 -np 5
+
+# Hit it
+curl -X POST http://localhost:8080/v1/chat/completions \
+  -H "Content-Type: application/json" \
+  -d '{"model":"cipher-model","messages":[{"role":"user","content":"write a python fizzbuzz"}],"max_tokens":256}'
+```
+
+### Direct with `llama-cpp-python`
+
+```python
+from llama_cpp import Llama
+llm = Llama(model_path="CipherModel-1.5B-Q4_K_M.gguf", n_ctx=4096)
+out = llm("def fizzbuzz(n):", max_tokens=256)
+print(out["choices"][0]["text"])
+```
+
+## Specifications
+
+- **Architecture:** Qwen2.5-Coder (transformer)
+- **Parameters:** 1.5 B
+- **Context window:** 32 K (we run at 4 K in production for memory)
+- **Quantization:** Q4_K_M
+- **License:** Apache 2.0 (inherited from base model)
+- **Languages supported:** strong in Python, JavaScript, TypeScript, Java, Go, Rust, C/C++ — see Qwen2.5-Coder's eval table for details
+
+## Limitations
+
+- Quality is meaningfully lower than Qwen-Coder-7B / 32B. For complex multi-file reasoning or long-context tasks, prefer the larger sizes.
+- Q4_K_M trades ~1–2% quality for ~4× smaller size vs full fp16. Acceptable for autocomplete and single-file tasks.
+- This is a closed-beta artifact; no SLAs, no support guarantees.
+
+## Citation / credits
+
+Built on top of:
+
+```bibtex
+@article{hui2024qwen2,
+  title={Qwen2.5-Coder Technical Report},
+  author={Binyuan Hui and Jian Yang and Zeyu Cui and Jiaxi Yang and Dayiheng Liu and Lei Zhang and Tianyu Liu and Jiajun Zhang and Bowen Yu and Keming Lu and Kai Dang and Yang Fan and Yichang Zhang and An Yang and Rui Men and Fei Huang and Bo Zheng and Yibo Miao and Shanghaoran Quan and Yunlong Feng and Xingzhang Ren and Xuancheng Ren and Jingren Zhou and Junyang Lin},
+  journal={arXiv preprint arXiv:2409.12186},
+  year={2024}
+}
+```
+
+## Trademark
+
+CipherCode™ and Cipher Persona™ are trademarks of **Lila AI LLC**. All rights reserved.
+
+The CipherModel weights themselves are released under Apache 2.0 (inherited from Qwen). The trademarks restrict only how you may name and brand derivative work — the underlying weights are free to use.
+
+---
+
+© 2026 Lila AI LLC.