prabodbc commited on
Commit
05548f9
verified
1 Parent(s): 76467ac

Professional model card

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -1,24 +1,24 @@
1
  ---
2
  license: apache-2.0
3
  base_model: Qwen/Qwen3-4B
 
 
4
  tags:
5
  - basert
6
- - base-format
7
  - apple-silicon
8
  - quantized
9
  ---
10
 
11
- # Qwen3-4B (BaseRT `.base`)
12
 
13
- [BaseRT](https://github.com/basecompute/baseRT) `.base` conversions of
14
- [`Qwen/Qwen3-4B`](https://huggingface.co/Qwen/Qwen3-4B) for the BaseRT Apple-Silicon (Metal)
15
- inference engine. Converted **directly from the bf16 source** (no
16
- quant-from-quant) to avoid compounding quantization error.
17
 
18
- | File | Quant | Size |
19
- |------|-------|------|
20
- | `Qwen3-4B-Q4.base` | `base_q4` | 2.1G |
21
- | `Qwen3-4B-Q8.base` | `base_q8` | 3.9G |
 
 
22
 
23
  ## Usage
24
 
@@ -28,4 +28,4 @@ basert pull basecompute/Qwen3-4B
28
  basert chat basecompute/Qwen3-4B
29
  ```
30
 
31
- Context: 32k License inherited from the base model.
 
1
  ---
2
  license: apache-2.0
3
  base_model: Qwen/Qwen3-4B
4
+ library_name: basert
5
+ pipeline_tag: text-generation
6
  tags:
7
  - basert
 
8
  - apple-silicon
9
  - quantized
10
  ---
11
 
12
+ # Qwen3-4B
13
 
14
+ [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`Qwen/Qwen3-4B`](https://huggingface.co/Qwen/Qwen3-4B) for fast local inference on Apple Silicon (Metal).
 
 
 
15
 
16
+ ## Files
17
+
18
+ | File | Precision | Size |
19
+ |------|-----------|------|
20
+ | `Qwen3-4B-Q4.base` | 4-bit | 2.3 GB |
21
+ | `Qwen3-4B-Q8.base` | 8-bit | 4.2 GB |
22
 
23
  ## Usage
24
 
 
28
  basert chat basecompute/Qwen3-4B
29
  ```
30
 
31
+ Released under the apache-2.0 license, inherited from the base model.