prabodbc commited on
Commit
d265379
·
verified ·
1 Parent(s): 6a5bb7a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3-8B
4
+ library_name: basert
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - basert
8
+ - apple-silicon
9
+ - quantized
10
+ ---
11
+
12
+ # Qwen3-8B
13
+
14
+ [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of
15
+ [`Qwen/Qwen3-8B`](https://huggingface.co/Qwen/Qwen3-8B) for fast local inference on Apple
16
+ Silicon (Metal).
17
+
18
+ ## Files
19
+
20
+ | File | Precision | Size |
21
+ |------|-----------|------|
22
+ | `Qwen3-8B-Q4.base` | 4-bit | 4.3G |
23
+ | `Qwen3-8B-Q8.base` | 8-bit | 7.9G |
24
+
25
+ ## Usage
26
+
27
+ ```bash
28
+ curl -LsSf https://basecompute.co/install.sh | sh
29
+ basert pull basecompute/Qwen3-8B
30
+ basert chat basecompute/Qwen3-8B
31
+ ```
32
+
33
+ Released under the apache-2.0 license, inherited from the base model.