File size: 1,662 Bytes
401f081 de5fdff 401f081 de5fdff 401f081 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 | ---
license: mit
tags:
- bitnet
- lora
- ternary
- trillim
- cpu-inference
base_model: microsoft/bitnet-b1.58-2B-4T-bf16
---
# BitNet-Search-LoRA-TRNQ
Ternary-quantized LoRA adapter for [Trillim/BitNet-TRNQ](https://huggingface.co/Trillim/BitNet-TRNQ) that teaches the model to search. Generates search queries in `<search>...</search>` XML tags. Need to use Trillim (https://trillim.com) with a search harness to respond to the model's search calls and improve results.
This adapter runs entirely on CPU — no GPU required.
## Adapter Details
| | |
|---|---|
| **Type** | LoRA adapter |
| **Style** | Search tool call |
| **Architecture** | BitNet (BitNetForCausalLM) |
| **Quantization** | Ternary ({-1, 0, 1}) |
| **Platforms** | x86_64, aarch64 |
| **Base model** | [Trillim/BitNet-TRNQ](https://huggingface.co/Trillim/BitNet-TRNQ) |
| **Source model** | [microsoft/bitnet-b1.58-2B-4T-bf16](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-bf16) |
| **License** | MIT |
## Usage
```bash
pip install trillim
trillim pull Trillim/BitNet-TRNQ
trillim pull Trillim/BitNet-Search-LoRA-TRNQ
trillim chat Trillim/BitNet-TRNQ Trillim/BitNet-Search-LoRA-TRNQ
```
This starts an interactive CLI chat.
## What's in this repo
| File | Description |
|---|---|
| `qmodel.lora` | Ternary-quantized LoRA weights in Trillim format |
| `tokenizer.json` | Tokenizer |
| `tokenizer_config.json` | Tokenizer configuration |
| `chat_template.jinja` | Chat template |
| `trillim_config.json` | Trillim metadata |
## License
This adapter is released under the [MIT License](https://opensource.org/licenses/MIT), following the license of the source model.
|