KronosLabs commited on
Commit
4bddfeb
·
verified ·
1 Parent(s): 003f316

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - Qwen/Qwen3-Coder-Next
5
+ tags:
6
+ - code
7
+ ---
8
+
9
+ Iapetus-v2-Kernel is a 80-billion parameter coding model for Assembly (ptxas, arm, and x86), Cuda, C, C++ by Kronos Labs, fine-tuned on top of Qwen3-Coder-Next's Hybrid attention layout.
10
+ It was trained on closed source datasets containing synthetically generated and verified code. We hope to spur interest in LLM's capable of low-level programming.
11
+
12
+
13
+ The model contains the following layout:
14
+
15
+ Size: 80B Parameters, A3B (3 Billion Active)
16
+ Depth: 48 layers
17
+ Hybrid layout: 12 * (3 * (Gated DeltaNet -> MoE) -> 1 * (Gated Attention -> MoE))
18
+ MoE: 512 experts, 10 activated experts, 1 shared expert
19
+ Context Length: 262,144 native
20
+