buley commited on
Commit
e33ec6b
·
verified ·
1 Parent(s): 844319f

add qwen3-coder-next.knot (qwen3next fat-station knot)

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +46 -0
  3. qwen3-coder-next.knot +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ qwen3-coder-next.knot filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3-Coder-Next
4
+ tags:
5
+ - knot
6
+ - fat-station
7
+ - distributed-inference
8
+ - qwen3next
9
+ - moe
10
+ ---
11
+
12
+ # qwen3-coder-next.knot
13
+
14
+ Sovereign `.knot` encoding of **Qwen3-Coder-Next** (`arch=qwen3next`) for the
15
+ Gnosis fat-station runtime. Converted from GGUF with `gguf-to-knot.py`
16
+ (K-quant block passthrough, arch-aware config).
17
+
18
+ ## Why a knot
19
+
20
+ `.knot` is a range-addressable weight container: a station fetches only the
21
+ tensors for the layers it owns, over HTTP, instead of loading a whole file.
22
+ That is what lets an A3B MoE this size run **sharded across Cloudflare
23
+ Containers** (12 GiB each) rather than needing one large host.
24
+
25
+ ## Architecture
26
+
27
+ Hybrid Mamba-2 gated-DeltaNet SSM with periodic full attention, and a
28
+ sparse MoE FFN on every layer. Roughly 3B parameters are active per token.
29
+ Long context is cheap because only the periodic attention layers carry a
30
+ KV cache.
31
+
32
+ ## Serving
33
+
34
+ Pipeline-parallel across N stations, each owning a contiguous layer range:
35
+
36
+ ```
37
+ FAT_STATION_KNOT=<this knot url>
38
+ FAT_STATION_SHARDED=1
39
+ FAT_STATION_ROLE=entry|mid|exit
40
+ FAT_STATION_LAYERS=0..6
41
+ ```
42
+
43
+ MoE shards cleanly along layers: a layer owns its entire expert set, so
44
+ top-k routing never needs a tensor held by another station.
45
+
46
+ Published by AFFECTIVELY. https://huggingface.co/forkjoin-ai
qwen3-coder-next.knot ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:332732a1b0bfb1ffaf7aeda528d77b6a77911f39d49392f7a1faf6f5e32cdccf
3
+ size 48481311137