stealth-model commited on
Commit
5602529
路
verified 路
1 Parent(s): 8a17468

Run it: Beam 1.0 GGUF files are here now

Browse files
Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -1,15 +1,20 @@
1
  ---
2
- license: cc-by-4.0
 
 
 
 
3
  tags:
4
  - missingno
5
  - beam
 
 
6
  - stealth-model
7
  - stealthmark
8
  - coding
9
  - reasoning
10
  - tool-use
11
  thumbnail: https://stealthmodels.com/missingno/assets/social-card.png
12
- new_version: reflection/Beam-1.0-501B-A23B
13
  ---
14
 
15
  <a href="https://stealthmodels.com/missingno/?utm_source=huggingface&utm_medium=referral&utm_campaign=missingno-card"><img src="https://huggingface.co/stealth-model/missingno/resolve/main/panels/hero.webp" alt="MISSINGNO., the purple mystery jelly in a fake moustache, at a Nous Portal checkpoint."></a>
@@ -46,7 +51,21 @@ StealthMark results for the released Beam 1.0:
46
  </details>
47
 
48
  ## Run it
49
- Beam 1.0 is open under Apache 2.0: [reflection/Beam-1.0-501B-A23B](https://huggingface.co/reflection/Beam-1.0-501B-A23B). Even in 2-bit it needs about 130 GB. GGUF files: [unsloth/Beam-1.0-501B-A23B-GGUF](https://huggingface.co/unsloth/Beam-1.0-501B-A23B-GGUF).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
 
51
  ---
52
  [Model guide](https://stealthmodels.com/missingno/?utm_source=huggingface&utm_medium=referral&utm_campaign=missingno-card) 路 [StealthMark leaderboard](https://huggingface.co/spaces/stealth-model/stealthmark) 路 [Follow us](https://huggingface.co/stealth-model)<br>
 
1
  ---
2
+ license: apache-2.0
3
+ base_model: reflection/Beam-1.0-501B-A23B
4
+ base_model_relation: quantized
5
+ pipeline_tag: text-generation
6
+ library_name: gguf
7
  tags:
8
  - missingno
9
  - beam
10
+ - gguf
11
+ - llama.cpp
12
  - stealth-model
13
  - stealthmark
14
  - coding
15
  - reasoning
16
  - tool-use
17
  thumbnail: https://stealthmodels.com/missingno/assets/social-card.png
 
18
  ---
19
 
20
  <a href="https://stealthmodels.com/missingno/?utm_source=huggingface&utm_medium=referral&utm_campaign=missingno-card"><img src="https://huggingface.co/stealth-model/missingno/resolve/main/panels/hero.webp" alt="MISSINGNO., the purple mystery jelly in a fake moustache, at a Nous Portal checkpoint."></a>
 
51
  </details>
52
 
53
  ## Run it
54
+ MissingNo was Beam 1.0, which is open under Apache 2.0 at [reflection/Beam-1.0-501B-A23B](https://huggingface.co/reflection/Beam-1.0-501B-A23B). Its GGUF files are right here.
55
+
56
+ | File | Size | Best for |
57
+ |---|---|---|
58
+ | `IQ2_XXS/` | 134 GB in 4 parts | The smallest size we recommend: 192 GB machines, or a 32 GB GPU with 128 GB of RAM |
59
+
60
+ ```bash
61
+ hf download stealth-model/missingno --local-dir beam-1.0 --include "IQ2_XXS/*"
62
+
63
+ llama-server \
64
+ -m beam-1.0/IQ2_XXS/Beam-1.0-501B-A23B-IQ2_XXS-00001-of-00004.gguf \
65
+ -ngl all --n-cpu-moe 52 -fa on --jinja --temp 0.7 --top-p 0.99
66
+ ```
67
+
68
+ `--n-cpu-moe 52` keeps all 52 expert layers in system RAM. Lower it until your GPU is full. On a 192 GB Mac, leave it out.
69
 
70
  ---
71
  [Model guide](https://stealthmodels.com/missingno/?utm_source=huggingface&utm_medium=referral&utm_campaign=missingno-card) 路 [StealthMark leaderboard](https://huggingface.co/spaces/stealth-model/stealthmark) 路 [Follow us](https://huggingface.co/stealth-model)<br>