Update LICENSE
Browse files
LICENSE
CHANGED
|
@@ -31,12 +31,12 @@ Licensor grants a **non-exclusive, worldwide, royalty-bearing license** to imple
|
|
| 31 |
|
| 32 |
### 3. Key Technical Components
|
| 33 |
|
| 34 |
-
| **Component**
|
| 35 |
-
|-----------------------------|---------------------------------------------------------------------------------|
|
| 36 |
-
| **Ternary Quantization**
|
| 37 |
-
| **Buffered Routing Embedding (BRE)** | Dynamic routing logic maximizing HBM-specific memory pooling.
|
| 38 |
-
| **SwiGLU-Attention (SWA) Fusion**
|
| 39 |
-
| **Hardware Optimization**
|
| 40 |
|
| 41 |
---
|
| 42 |
|
|
|
|
| 31 |
|
| 32 |
### 3. Key Technical Components
|
| 33 |
|
| 34 |
+
| **Component** | **Description** |
|
| 35 |
+
|--------------------------------------|---------------------------------------------------------------------------------|
|
| 36 |
+
| **Ternary Quantization** | Weights restricted to $W \in \{-1, 0, +1\}$ with learnable scaling ($\gamma$). |
|
| 37 |
+
| **Buffered Routing Embedding (BRE)** | Dynamic routing logic maximizing HBM-specific memory pooling. |
|
| 38 |
+
| **SwiGLU-Attention (SWA) Fusion** | Unified compute kernel merging FFN and MHA for efficiency. |
|
| 39 |
+
| **Hardware Optimization** | Optimization stack specifically for ROCm/HIP and non-NVIDIA hardware. |
|
| 40 |
|
| 41 |
---
|
| 42 |
|