Hugging Face's logo

Slaxikov
/
VokiLLM

GGUF
Russian
instruct
conversational
Model card Files
xet
 Community
Slaxikov commited on
Commit
fc0f327
·
verified ·
1 Parent(s): 001b62a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -24
README.md CHANGED
@@ -6,6 +6,7 @@ tags:
6
  - gguf
7
  - instruct
8
  ---
 
9
  # VokiLLM-0.5B-Instruct (GGUF)
10
 
11
  Готовые файлы модели **VokiLLM-0.5B-Instruct** в формате **GGUF**: FP16 и квантовки для `llama.cpp`/LM Studio и других совместимых рантаймов.
@@ -19,31 +20,33 @@ tags:
19
 
20
  ## Файлы
21
 
 
 
22
  | Файл | Квантование | Размер (bytes) |
23
  |---|---:|---:|
24
- | `vokillm-0.5b-instruct-fp16.gguf` | FP16 | 1266425856 |
25
- | `vokillm-0.5b-instruct-q8_0.gguf` | Q8_0 | 675710976 |
26
- | `vokillm-0.5b-instruct-q6_k.gguf` | Q6_K | 650379296 |
27
- | `vokillm-0.5b-instruct-q5_k_m.gguf` | Q5_K_M | 522186752 |
28
- | `vokillm-0.5b-instruct-q5_1.gguf` | Q5_1 | 521348096 |
29
- | `vokillm-0.5b-instruct-q5_k_s.gguf` | Q5_K_S | 514810880 |
30
- | `vokillm-0.5b-instruct-q5_0.gguf` | Q5_0 | 490475520 |
31
- | `vokillm-0.5b-instruct-q4_k_m.gguf` | Q4_K_M | 491400192 |
32
- | `vokillm-0.5b-instruct-q4_k_s.gguf` | Q4_K_S | 479064064 |
33
- | `vokillm-0.5b-instruct-q4_1.gguf` | Q4_1 | 459602944 |
34
- | `vokillm-0.5b-instruct-q3_k_l.gguf` | Q3_K_L | 445933568 |
35
- | `vokillm-0.5b-instruct-iq4_nl.gguf` | IQ4_NL | 430880768 |
36
- | `vokillm-0.5b-instruct-q4_0.gguf` | Q4_0 | 428730368 |
37
- | `vokillm-0.5b-instruct-iq4_xs.gguf` | IQ4_XS | 428020736 |
38
- | `vokillm-0.5b-instruct-q3_k_m.gguf` | Q3_K_M | 432041984 |
39
- | `vokillm-0.5b-instruct-iq3_xxs.gguf` | IQ3_XXS | 416919296 |
40
- | `vokillm-0.5b-instruct-iq3_s.gguf` | IQ3_S | 415182848 |
41
- | `vokillm-0.5b-instruct-q2_k.gguf` | Q2_K | 415182848 |
42
- | `vokillm-0.5b-instruct-q3_k_s.gguf` | Q3_K_S | 414838784 |
43
- | `vokillm-0.5b-instruct-iq2_s.gguf` | IQ2_S | 402312928 |
44
- | `vokillm-0.5b-instruct-iq2_xs.gguf` | IQ2_XS | 400985056 |
45
- | `vokillm-0.5b-instruct-iq2_xxs.gguf` | IQ2_XXS | 398125024 |
46
- | `vokillm-0.5b-instruct-iq1_s.gguf` | IQ1_S | 392404960 |
47
 
48
  ## Как запустить
49
 
@@ -62,4 +65,4 @@ llama-cli.exe -m "vokillm-0.5b-instruct-q4_k_m.gguf" -p "Привет! Коро
62
 
63
  ## Про квантовки IQ2/IQ1
64
 
65
- Квантовки `IQ2_*` и `IQ1_S` сделаны с **importance matrix (imatrix)** (это повышает качество для “экстремальных” квантовок).
 
6
  - gguf
7
  - instruct
8
  ---
9
+
10
  # VokiLLM-0.5B-Instruct (GGUF)
11
 
12
  Готовые файлы модели **VokiLLM-0.5B-Instruct** в формате **GGUF**: FP16 и квантовки для `llama.cpp`/LM Studio и других совместимых рантаймов.
 
20
 
21
  ## Файлы
22
 
23
+ Файлы лежат **в корне репозитория**. В таблице ниже названия — это **ссылки на скачивание**.
24
+
25
  | Файл | Квантование | Размер (bytes) |
26
  |---|---:|---:|
27
+ | [`vokillm-0.5b-instruct-fp16.gguf`](vokillm-0.5b-instruct-fp16.gguf?download=true) | FP16 | 1266425856 |
28
+ | [`vokillm-0.5b-instruct-q8_0.gguf`](vokillm-0.5b-instruct-q8_0.gguf?download=true) | Q8_0 | 675710976 |
29
+ | [`vokillm-0.5b-instruct-q6_k.gguf`](vokillm-0.5b-instruct-q6_k.gguf?download=true) | Q6_K | 650379296 |
30
+ | [`vokillm-0.5b-instruct-q5_k_m.gguf`](vokillm-0.5b-instruct-q5_k_m.gguf?download=true) | Q5_K_M | 522186752 |
31
+ | [`vokillm-0.5b-instruct-q5_1.gguf`](vokillm-0.5b-instruct-q5_1.gguf?download=true) | Q5_1 | 521348096 |
32
+ | [`vokillm-0.5b-instruct-q5_k_s.gguf`](vokillm-0.5b-instruct-q5_k_s.gguf?download=true) | Q5_K_S | 514810880 |
33
+ | [`vokillm-0.5b-instruct-q5_0.gguf`](vokillm-0.5b-instruct-q5_0.gguf?download=true) | Q5_0 | 490475520 |
34
+ | [`vokillm-0.5b-instruct-q4_k_m.gguf`](vokillm-0.5b-instruct-q4_k_m.gguf?download=true) | Q4_K_M | 491400192 |
35
+ | [`vokillm-0.5b-instruct-q4_k_s.gguf`](vokillm-0.5b-instruct-q4_k_s.gguf?download=true) | Q4_K_S | 479064064 |
36
+ | [`vokillm-0.5b-instruct-q4_1.gguf`](vokillm-0.5b-instruct-q4_1.gguf?download=true) | Q4_1 | 459602944 |
37
+ | [`vokillm-0.5b-instruct-q3_k_l.gguf`](vokillm-0.5b-instruct-q3_k_l.gguf?download=true) | Q3_K_L | 445933568 |
38
+ | [`vokillm-0.5b-instruct-iq4_nl.gguf`](vokillm-0.5b-instruct-iq4_nl.gguf?download=true) | IQ4_NL | 430880768 |
39
+ | [`vokillm-0.5b-instruct-q4_0.gguf`](vokillm-0.5b-instruct-q4_0.gguf?download=true) | Q4_0 | 428730368 |
40
+ | [`vokillm-0.5b-instruct-iq4_xs.gguf`](vokillm-0.5b-instruct-iq4_xs.gguf?download=true) | IQ4_XS | 428020736 |
41
+ | [`vokillm-0.5b-instruct-q3_k_m.gguf`](vokillm-0.5b-instruct-q3_k_m.gguf?download=true) | Q3_K_M | 432041984 |
42
+ | [`vokillm-0.5b-instruct-iq3_xxs.gguf`](vokillm-0.5b-instruct-iq3_xxs.gguf?download=true) | IQ3_XXS | 416919296 |
43
+ | [`vokillm-0.5b-instruct-iq3_s.gguf`](vokillm-0.5b-instruct-iq3_s.gguf?download=true) | IQ3_S | 415182848 |
44
+ | [`vokillm-0.5b-instruct-q2_k.gguf`](vokillm-0.5b-instruct-q2_k.gguf?download=true) | Q2_K | 415182848 |
45
+ | [`vokillm-0.5b-instruct-q3_k_s.gguf`](vokillm-0.5b-instruct-q3_k_s.gguf?download=true) | Q3_K_S | 414838784 |
46
+ | [`vokillm-0.5b-instruct-iq2_s.gguf`](vokillm-0.5b-instruct-iq2_s.gguf?download=true) | IQ2_S | 402312928 |
47
+ | [`vokillm-0.5b-instruct-iq2_xs.gguf`](vokillm-0.5b-instruct-iq2_xs.gguf?download=true) | IQ2_XS | 400985056 |
48
+ | [`vokillm-0.5b-instruct-iq2_xxs.gguf`](vokillm-0.5b-instruct-iq2_xxs.gguf?download=true) | IQ2_XXS | 398125024 |
49
+ | [`vokillm-0.5b-instruct-iq1_s.gguf`](vokillm-0.5b-instruct-iq1_s.gguf?download=true) | IQ1_S | 392404960 |
50
 
51
  ## Как запустить
52
 
 
65
 
66
  ## Про квантовки IQ2/IQ1
67
 
68
+ Квантовки `IQ2_*` и `IQ1_S` сделаны с **importance matrix (imatrix)** (это повышает качество для “экстремальных” квантовок).