camauri commited on
Commit
799d61b
·
verified ·
1 Parent(s): 68a4c0b

Model card: the engine is Janas-LLM

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -11,15 +11,15 @@ tags:
11
  - mixture-of-experts
12
  ---
13
 
14
- # Qwen3-Coder-Next for Janas
15
 
16
  No speed published for this model yet.
17
 
18
- These are the model's weights converted to **JNS**, the format of [Janas](https://github.com/prabanta-dev/janas), an inference engine in C for ordinary computers, with or without a GPU. The files are read by Janas only.
19
 
20
  ## Get it
21
 
22
- Janas for Linux x86-64 (Ubuntu 22.04, Debian 12 and later), then the model:
23
 
24
  ```sh
25
  curl -LO https://github.com/prabanta-dev/janas/releases/latest/download/janas-linux-x86_64.tar.gz
@@ -28,7 +28,7 @@ tar xf janas-linux-x86_64.tar.gz && cd janas
28
  ./janas-chat qwen3-coder-next
29
  ```
30
 
31
- `janas-get` downloads the files of this repository and checks them against the fingerprints below; `janas-chat` with no model shows the catalog and downloads the one you choose. Building Janas from its sources instead: [prabanta-dev/janas](https://github.com/prabanta-dev/janas).
32
 
33
  ## Files
34
 
@@ -38,7 +38,7 @@ tar xf janas-linux-x86_64.tar.gz && cd janas
38
 
39
  ## What was changed
40
 
41
- These files are a modified work of the original model, as the Apache License 2.0 requires to be stated. Nothing was retrained or pruned: each file is a GGUF file quantized by the people named above, rewritten by Janas's `gguf2jns` in the order Janas reads it, with the metadata carried over. Each (layer, expert) has a slot of its own, so that the experts a token needs can be read from disk on their own. The experts' down matrices were then cut by Janas's `jns_planes` into three planes of two bits each: a reordering of the same bits, which with all three planes gives back the quantized weights to the last bit.
42
 
43
  ## Licence and attribution
44
 
@@ -46,6 +46,6 @@ Licensed under the **Apache License 2.0**, as the original model: see `LICENSE`.
46
 
47
  - Model: [Qwen/Qwen3-Coder-Next](https://huggingface.co/Qwen/Qwen3-Coder-Next), by Alibaba Cloud (the Qwen team).
48
  - Quantized GGUF: [Qwen/Qwen3-Coder-Next-GGUF](https://huggingface.co/Qwen/Qwen3-Coder-Next-GGUF), by its authors.
49
- - Converted to JNS by the Janas project ([prabanta-dev/janas](https://github.com/prabanta-dev/janas), GPL-3.0-or-later; the licence of the engine does not apply to these files).
50
 
51
  The original repository carries no LICENSE file; its card declares Apache 2.0. `LICENSE` here is the licence's text as the Apache Software Foundation publishes it.
 
11
  - mixture-of-experts
12
  ---
13
 
14
+ # Qwen3-Coder-Next for Janas-LLM
15
 
16
  No speed published for this model yet.
17
 
18
+ These are the model's weights converted to **JNS**, the format of Janas-LLM, the inference engine in C of [Janas](https://github.com/prabanta-dev/janas), for ordinary computers, with or without a GPU. The files are read by Janas-LLM only.
19
 
20
  ## Get it
21
 
22
+ Janas-LLM for Linux x86-64 (Ubuntu 22.04, Debian 12 and later), then the model:
23
 
24
  ```sh
25
  curl -LO https://github.com/prabanta-dev/janas/releases/latest/download/janas-linux-x86_64.tar.gz
 
28
  ./janas-chat qwen3-coder-next
29
  ```
30
 
31
+ `janas-get` downloads the files of this repository and checks them against the fingerprints below; `janas-chat` with no model shows the catalog and downloads the one you choose. Building Janas-LLM from its sources instead: [prabanta-dev/janas](https://github.com/prabanta-dev/janas).
32
 
33
  ## Files
34
 
 
38
 
39
  ## What was changed
40
 
41
+ These files are a modified work of the original model, as the Apache License 2.0 requires to be stated. Nothing was retrained or pruned: each file is a GGUF file quantized by the people named above, rewritten by Janas-LLM's `gguf2jns` in the order Janas reads it, with the metadata carried over. Each (layer, expert) has a slot of its own, so that the experts a token needs can be read from disk on their own. The experts' down matrices were then cut by Janas-LLM's `jns_planes` into three planes of two bits each: a reordering of the same bits, which with all three planes gives back the quantized weights to the last bit.
42
 
43
  ## Licence and attribution
44
 
 
46
 
47
  - Model: [Qwen/Qwen3-Coder-Next](https://huggingface.co/Qwen/Qwen3-Coder-Next), by Alibaba Cloud (the Qwen team).
48
  - Quantized GGUF: [Qwen/Qwen3-Coder-Next-GGUF](https://huggingface.co/Qwen/Qwen3-Coder-Next-GGUF), by its authors.
49
+ - Converted to JNS by the Janas project with Janas-LLM ([prabanta-dev/janas](https://github.com/prabanta-dev/janas), GPL-3.0-or-later; the licence of the engine does not apply to these files).
50
 
51
  The original repository carries no LICENSE file; its card declares Apache 2.0. `LICENSE` here is the licence's text as the Apache Software Foundation publishes it.