File size: 1,211 Bytes
c3ca111 4681fa9 c3ca111 4681fa9 c3ca111 f53ddbb c3ca111 4681fa9 c3ca111 4681fa9 c3ca111 f53ddbb c3ca111 4681fa9 c3ca111 4681fa9 c3ca111 4681fa9 45ecba7 4681fa9 45ecba7 4681fa9 45ecba7 4681fa9 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
language:
- en
license: apache-2.0
tags:
- mamba
- ssm
- causal-lm
- gguf
- quantized
- neuralai
- base-model
---
# 🧠 NeuralAI · Mamba K2
NeuralAI's scaled Mamba SSM base, quantized to **Q4_K_M GGUF (460MB)** for fast local inference.
## Model Details
- **Architecture:** Mamba SSM (`state-spaces/mamba-790m-hf`)
- **Parameters:** 793M
- **Quantization:** Q4_K_M via llama.cpp
- **Status:** Base pretrained weights — SFT queued to convert to instruction-tuned chat
- **Creator:** De'Andrew Preston Harris, NeuralAI
## Status
- Mamba K2 is **base-model only** until SFT training is complete.
- Output will be base-model continuations, not aligned chat, until the SFT checkpoint is merged.
- Follow [github.com/Subject-Emu-5259/NeuralAI](https://github.com/Subject-Emu-5259/NeuralAI) for SFT releases.
## Prompt Format (planned: neuralai-intel)
After SFT, K2 will use the same vocabulary-friendly format as K1:
```text
### System:
You are NeuralAI, a helpful assistant.
### User:
{your question}
### Assistant:
```
## Use with LM Studio / llama.cpp
```bash
python3 -m llama_cpp.server --model mamba-790m-hf.Q4_K_M.gguf --chat_format neuralai-intel
```
## License
Apache 2.0
|