Paris99 commited on
Commit
bee0f79
·
verified ·
1 Parent(s): a8e5503

Card: GitHub link and sizes

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -8,7 +8,7 @@ tags: [mlx, sensenova, sensenova-loop, looped-transformer, mhc, qwen3_5, apple-s
8
  ---
9
  # SenseNova-Loop-9B-Preview — MLX 8-bit
10
 
11
- An 8-bit MLX conversion (affine, group size 64) of [sensenova/SenseNova-Loop-9B-Preview](https://huggingface.co/sensenova/SenseNova-Loop-9B-Preview) (revision `9937e91`, released 30 October 2026) for Apple Silicon. 8.9 GB of weights. Text model; image input is not part of this build yet. Practically identical to SenseNova's original weights; the recommended build.
12
 
13
  Published by [NetProjects](https://netprojects.com) (Internet Projects Ltd). Not affiliated with SenseTime / SenseNova.
14
 
@@ -19,7 +19,7 @@ SenseNova-Loop is a Qwen3.5-based model with two additions, and this build runs
19
  - **Looped execution:** layers 0–3 run once, layers 4–27 run **twice** with shared weights, then layers 28–31: 56 layer passes per token. Every pass has its own cache slot (KV cache for full attention, conv and recurrent state for Gated DeltaNet).
20
  - **Two-stream mHC** on layers 4–27: the hidden state is split into two residual streams that are routed by small float32 routers (pre / post gates and a 2×2 Sinkhorn mixing matrix, 20 iterations). The 96 router tensors stay in float32 and are never quantized.
21
 
22
- The model code is `sensenova_loop.py`, included in this repo and loaded by mlx-lm through `trust_remote_code=True`.
23
 
24
  ## Results (MacBook Pro M5 Max, 128 GB, 7 November 2026)
25
 
@@ -29,7 +29,7 @@ Agreement with SenseNova's own PyTorch code (Transformers 5.18, bf16) on 16 prom
29
  |---|---|---|---|
30
  | Same top token as the reference | 97.6% | 97.2% | 89.2% |
31
  | KL divergence at the last token | 0.0011 | 0.0037 | 0.064 |
32
- | Size | 8.9 GB | 6.8 GB | 4.7 GB |
33
 
34
  Short public benchmark (same harness for every build; first 300 ARC-Challenge test questions, log-likelihood over the 4 choices; first 50 GSM8K test questions, chat template, thinking off, greedy):
35
 
@@ -59,7 +59,7 @@ print(generate(model, tokenizer, prompt=prompt, max_tokens=256))
59
 
60
  Set `enable_thinking=True` for thinking mode. Server: `mlx_lm.server --model netprojects/SenseNova-Loop-9B-Preview-MLX-8bit --trust-remote-code`.
61
 
62
- **Other sizes:** [6-bit](https://huggingface.co/netprojects/SenseNova-Loop-9B-Preview-MLX-6bit) (6.8 GB) · [4-bit](https://huggingface.co/netprojects/SenseNova-Loop-9B-Preview-MLX-4bit) (4.7 GB)
63
 
64
  ## License
65
 
 
8
  ---
9
  # SenseNova-Loop-9B-Preview — MLX 8-bit
10
 
11
+ An 8-bit MLX conversion (affine, group size 64) of [sensenova/SenseNova-Loop-9B-Preview](https://huggingface.co/sensenova/SenseNova-Loop-9B-Preview) (revision `9937e91`, released 30 October 2026) for Apple Silicon. 9.6 GB of weights. Text model; image input is not part of this build yet. Practically identical to SenseNova's original weights; the recommended build.
12
 
13
  Published by [NetProjects](https://netprojects.com) (Internet Projects Ltd). Not affiliated with SenseTime / SenseNova.
14
 
 
19
  - **Looped execution:** layers 0–3 run once, layers 4–27 run **twice** with shared weights, then layers 28–31: 56 layer passes per token. Every pass has its own cache slot (KV cache for full attention, conv and recurrent state for Gated DeltaNet).
20
  - **Two-stream mHC** on layers 4–27: the hidden state is split into two residual streams that are routed by small float32 routers (pre / post gates and a 2×2 Sinkhorn mixing matrix, 20 iterations). The 96 router tensors stay in float32 and are never quantized.
21
 
22
+ The model code is `sensenova_loop.py`, included in this repo and loaded by mlx-lm through `trust_remote_code=True`. Source, converter, parity and benchmark scripts: [github.com/internet-projects/sensenova-loop-mlx](https://github.com/internet-projects/sensenova-loop-mlx).
23
 
24
  ## Results (MacBook Pro M5 Max, 128 GB, 7 November 2026)
25
 
 
29
  |---|---|---|---|
30
  | Same top token as the reference | 97.6% | 97.2% | 89.2% |
31
  | KL divergence at the last token | 0.0011 | 0.0037 | 0.064 |
32
+ | Size | 9.6 GB | 7.3 GB | 5.1 GB |
33
 
34
  Short public benchmark (same harness for every build; first 300 ARC-Challenge test questions, log-likelihood over the 4 choices; first 50 GSM8K test questions, chat template, thinking off, greedy):
35
 
 
59
 
60
  Set `enable_thinking=True` for thinking mode. Server: `mlx_lm.server --model netprojects/SenseNova-Loop-9B-Preview-MLX-8bit --trust-remote-code`.
61
 
62
+ **Other sizes:** [6-bit](https://huggingface.co/netprojects/SenseNova-Loop-9B-Preview-MLX-6bit) (7.3 GB) · [4-bit](https://huggingface.co/netprojects/SenseNova-Loop-9B-Preview-MLX-4bit) (5.1 GB)
63
 
64
  ## License
65