metadata
license: mit
tags:
- bitnet
- lora
- ternary
- trillim
- cpu-inference
base_model: microsoft/bitnet-b1.58-2B-4T-bf16
BitNet-GenZ-LoRA-TRNQ
Ternary-quantized LoRA adapter for Trillim/BitNet-TRNQ that changes the model's style to speak in GenZ slang, packaged for the Trillim DarkNet inference engine.
This adapter runs entirely on CPU — no GPU required.
Adapter Details
| Type | LoRA adapter |
| Style | GenZ slang |
| Architecture | BitNet (BitNetForCausalLM) |
| Quantization | Ternary ({-1, 0, 1}) |
| Platforms | x86_64, aarch64 |
| Base model | Trillim/BitNet-TRNQ |
| Source model | microsoft/bitnet-b1.58-2B-4T-bf16 |
| License | MIT |
Usage
pip install trillim
trillim pull Trillim/BitNet-TRNQ
trillim pull Trillim/BitNet-GenZ-LoRA-TRNQ
trillim chat Trillim/BitNet-TRNQ --lora Trillim/BitNet-GenZ-LoRA-TRNQ
This starts an interactive CLI chat.
What's in this repo
| File | Description |
|---|---|
qmodel.lora |
Ternary-quantized LoRA weights in Trillim format |
lora_tokenizer.json |
Tokenizer |
lora_tokenizer_config.json |
Tokenizer configuration |
lora_chat_template.jinja |
Chat template |
trillim_config.json |
Trillim metadata |
License
This adapter is released under the MIT License, following the license of the source model.