fabian-basecompute commited on
Commit
e5faae5
·
verified ·
1 Parent(s): b4ae000

Add model card and config

Browse files
Files changed (2) hide show
  1. README.md +33 -0
  2. config.json +4 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3.8-27B
4
+ library_name: basert
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - basert
8
+ - apple-silicon
9
+ - quantized
10
+ ---
11
+
12
+ # Qwen3.8-27B
13
+
14
+ [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`Qwen/Qwen3.8-27B`](https://huggingface.co/Qwen/Qwen3.8-27B) for fast local inference on Apple Silicon (Metal).
15
+
16
+ A dense 27B vision-language reasoning model with hybrid attention (Gated DeltaNet + periodic full attention). Q4 needs ~24 GB Apple Silicon (tight); Q8 needs 48 GB+.
17
+
18
+ ## Files
19
+
20
+ | File | Precision | Size |
21
+ |------|-----------|------|
22
+ | `Qwen3.8-27B-Q4.base` | 4-bit | 17 GB |
23
+ | `Qwen3.8-27B-Q8.base` | 8-bit | 28 GB |
24
+
25
+ ## Usage
26
+
27
+ ```bash
28
+ curl -LsSf https://basecompute.co/install.sh | sh
29
+ basert pull basecompute/Qwen3.8-27B
30
+ basert chat basecompute/Qwen3.8-27B
31
+ ```
32
+
33
+ Released under the apache-2.0 license, inherited from the base model.
config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "library_name": "basert",
3
+ "format": "base"
4
+ }