prabodbc commited on
Commit
e13dbb1
verified
1 Parent(s): 719a079

Professional model card

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -1,24 +1,24 @@
1
  ---
2
  license: gemma
3
  base_model: google/gemma-3-1b-it
 
 
4
  tags:
5
  - basert
6
- - base-format
7
  - apple-silicon
8
  - quantized
9
  ---
10
 
11
- # gemma-3-1b-it (BaseRT `.base`)
12
 
13
- [BaseRT](https://github.com/basecompute/baseRT) `.base` conversions of
14
- [`google/gemma-3-1b-it`](https://huggingface.co/google/gemma-3-1b-it) for the BaseRT Apple-Silicon (Metal)
15
- inference engine. Converted **directly from the bf16 source** (no
16
- quant-from-quant) to avoid compounding quantization error.
17
 
18
- | File | Quant | Size |
19
- |------|-------|------|
20
- | `gemma-3-1b-it-Q4.base` | `base_q4` | 561M |
21
- | `gemma-3-1b-it-Q8.base` | `base_q8` | 1.0G |
 
 
22
 
23
  ## Usage
24
 
@@ -28,4 +28,4 @@ basert pull basecompute/gemma-3-1b-it
28
  basert chat basecompute/gemma-3-1b-it
29
  ```
30
 
31
- Context: 32k License inherited from the base model.
 
1
  ---
2
  license: gemma
3
  base_model: google/gemma-3-1b-it
4
+ library_name: basert
5
+ pipeline_tag: text-generation
6
  tags:
7
  - basert
 
8
  - apple-silicon
9
  - quantized
10
  ---
11
 
12
+ # gemma-3-1b-it
13
 
14
+ [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`google/gemma-3-1b-it`](https://huggingface.co/google/gemma-3-1b-it) for fast local inference on Apple Silicon (Metal).
 
 
 
15
 
16
+ ## Files
17
+
18
+ | File | Precision | Size |
19
+ |------|-----------|------|
20
+ | `gemma-3-1b-it-Q4.base` | 4-bit | 580 MB |
21
+ | `gemma-3-1b-it-Q8.base` | 8-bit | 1.0 GB |
22
 
23
  ## Usage
24
 
 
28
  basert chat basecompute/gemma-3-1b-it
29
  ```
30
 
31
+ Released under the gemma license, inherited from the base model.