murzik-15b-init / README.md
MagistrTheOne's picture
Murzik-15B: PT checkpoint (1500 steps, wiki+identity) β†’ murzik-15b-init
83d9edb verified
---
language:
- en
- ru
- de
- es
- fr
- zh
- uk
license: other
tags:
- murzik
- nullxes
- causal-lm
- custom_code
- multilingual
library_name: transformers
pipeline_tag: text-generation
---
# MURZIK-15B-INIT
**NULLXES MURZIK** β€” custom causal language model (dense ~13B).
Canonical Hugging Face repo for the Murzik-15B dense line.
| | |
|---|---|
| **Organization** | [NULLXES](https://nullxes.com) |
| **Contact** | [ceo@nullxes.com](mailto:ceo@nullxes.com) |
| **Architecture** | `MurzikForCausalLM` (custom, not a fork) |
| **Total params** | ~13B |
| **Precision** | bf16 |
| **HF repo** | `MagistrTheOne/murzik-15b-init` (this page) |
## Current checkpoint
| | |
|---|---|
| **Stage** | Pre-training (first run) |
| **Steps** | 1500 |
| **Data** | Wikipedia (en/ru/de/es/fr/zh/uk) + Murzik identity corpus |
| **Seq length** | 2048 |
| **Tokens seen** | ~49M (~0.37 epoch) |
| **Chat / instructions** | **Not yet** β€” SFT is the next stage |
Weights in this repo are **updated in place** (random init β†’ PT β†’ later SFT).
The repo name stays **`murzik-15b-init`**; only the README and files change per stage.
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "MagistrTheOne/murzik-15b-init"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_id,
trust_remote_code=True,
torch_dtype="auto",
device_map="auto",
)
```
## Chat template (after SFT)
Template name in LlamaFactory: `murzik`
```
<|murzik|><|system|>
{system}<|end|>
<|user|>
{user}<|end|>
<|assistant|>
{assistant}<|end|>
```
## Roadmap
| Stage | Status |
|-------|--------|
| Random init | done |
| Pre-training | done (first run, 1500 steps) |
| SFT (identity + Aya) | next |
| MoE 32B | separate line |
## License
Proprietary β€” **NULLXES**. Weights are published for research and integration testing.
Commercial use requires written permission: **ceo@nullxes.com**.
## Citation
```bibtex
@misc{murzik15b_init2026,
title = {NULLXES MURZIK-15B},
author = {NULLXES},
year = {2026},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/MagistrTheOne/murzik-15b-init}},
contact = {ceo@nullxes.com}
}
```