Text Generation
GGUF
English
TensorBlock
GGUF
morriszms commited on
Commit
2c55f06
·
verified ·
1 Parent(s): 19d7c0e

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ TinyMistral-248M-v2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ TinyMistral-248M-v2-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ TinyMistral-248M-v2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ TinyMistral-248M-v2-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ TinyMistral-248M-v2-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ TinyMistral-248M-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ TinyMistral-248M-v2-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ TinyMistral-248M-v2-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
+ TinyMistral-248M-v2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ TinyMistral-248M-v2-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ TinyMistral-248M-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ TinyMistral-248M-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ datasets:
7
+ - Skylion007/openwebtext
8
+ - Locutusque/TM-DATA
9
+ inference:
10
+ parameters:
11
+ do_sample: true
12
+ temperature: 0.7
13
+ top_p: 0.2
14
+ top_k: 14
15
+ max_new_tokens: 250
16
+ repetition_penalty: 1.16
17
+ widget:
18
+ - text: 'TITLE: Dirichlet density QUESTION [5 upvotes]: How to solve the following
19
+ exercise: Let $q$ be prime. Show that the set of primes p for which $p \equiv
20
+ 1\pmod q$ and $2^{(p-1)/q} \equiv 1 \pmod p$ has Dirichlet density $\dfrac{1}{q(q-1)}$.
21
+ I want to show that $X^q-2$ (mod $p$) has a solution and $q$ divides $p-1$ , these
22
+ two conditions are simultaneonusly satisfied iff p splits completely in $\Bbb{Q}(\zeta_q,2^{\frac{1}{q}})$.
23
+ $\zeta_q $ is primitive $q^{th}$ root of unity. If this is proved the I can conclude
24
+ the result by Chebotarev density theorem. REPLY [2 votes]:'
25
+ - text: An emerging clinical approach to treat substance abuse disorders involves
26
+ a form of cognitive-behavioral therapy whereby addicts learn to reduce their reactivity
27
+ to drug-paired stimuli through cue-exposure or extinction training. It is, however,
28
+ - text: '\begin{document} \begin{frontmatter} \author{Mahouton Norbert Hounkonnou\corref{cor1}${}^1$}
29
+ \cortext[cor1]{norbert.hounkonnou@cipma.uac.bj} \author{Sama Arjika\corref{cor2}${}^1$}
30
+ \cortext[cor2]{rjksama2008@gmail.com} \author{ Won Sang Chung\corref{cor3}${}^2$
31
+ } \cortext[cor3]{mimip4444@hanmail.net} \title{\bf New families of $q$ and $(q;p)-$Hermite
32
+ polynomials } \address{${}^1$International Chair of Mathematical Physics and Applications
33
+ \\ (ICMPA-UNESCO Chair), University of Abomey-Calavi,\\ 072 B. P.: 50 Cotonou,
34
+ Republic of Benin,\\ ${}^2$Department of Physics and Research Institute of Natural
35
+ Science, \\ College of Natural Science, \\ Gyeongsang National University, Jinju
36
+ 660-701, Korea } \begin{abstract} In this paper, we construct a new family of
37
+ $q-$Hermite polynomials denoted by $H_n(x,s|q).$ Main properties and relations
38
+ are established and'
39
+ base_model: Locutusque/TinyMistral-248M-v2
40
+ tags:
41
+ - TensorBlock
42
+ - GGUF
43
+ ---
44
+
45
+ <div style="width: auto; margin-left: auto; margin-right: auto">
46
+ <img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
47
+ </div>
48
+ <div style="display: flex; justify-content: space-between; width: 100%;">
49
+ <div style="display: flex; flex-direction: column; align-items: flex-start;">
50
+ <p style="margin-top: 0.5em; margin-bottom: 0em;">
51
+ Feedback and support: TensorBlock's <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
52
+ </p>
53
+ </div>
54
+ </div>
55
+
56
+ ## Locutusque/TinyMistral-248M-v2 - GGUF
57
+
58
+ This repo contains GGUF format model files for [Locutusque/TinyMistral-248M-v2](https://huggingface.co/Locutusque/TinyMistral-248M-v2).
59
+
60
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
61
+
62
+ <div style="text-align: left; margin: 20px 0;">
63
+ <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
64
+ Run them on the TensorBlock client using your local machine ↗
65
+ </a>
66
+ </div>
67
+
68
+ ## Prompt template
69
+
70
+ ```
71
+
72
+ ```
73
+
74
+ ## Model file specification
75
+
76
+ | Filename | Quant type | File Size | Description |
77
+ | -------- | ---------- | --------- | ----------- |
78
+ | [TinyMistral-248M-v2-Q2_K.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q2_K.gguf) | Q2_K | 0.098 GB | smallest, significant quality loss - not recommended for most purposes |
79
+ | [TinyMistral-248M-v2-Q3_K_S.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q3_K_S.gguf) | Q3_K_S | 0.112 GB | very small, high quality loss |
80
+ | [TinyMistral-248M-v2-Q3_K_M.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q3_K_M.gguf) | Q3_K_M | 0.120 GB | very small, high quality loss |
81
+ | [TinyMistral-248M-v2-Q3_K_L.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q3_K_L.gguf) | Q3_K_L | 0.128 GB | small, substantial quality loss |
82
+ | [TinyMistral-248M-v2-Q4_0.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q4_0.gguf) | Q4_0 | 0.139 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
83
+ | [TinyMistral-248M-v2-Q4_K_S.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q4_K_S.gguf) | Q4_K_S | 0.139 GB | small, greater quality loss |
84
+ | [TinyMistral-248M-v2-Q4_K_M.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q4_K_M.gguf) | Q4_K_M | 0.145 GB | medium, balanced quality - recommended |
85
+ | [TinyMistral-248M-v2-Q5_0.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q5_0.gguf) | Q5_0 | 0.164 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
86
+ | [TinyMistral-248M-v2-Q5_K_S.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q5_K_S.gguf) | Q5_K_S | 0.164 GB | large, low quality loss - recommended |
87
+ | [TinyMistral-248M-v2-Q5_K_M.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q5_K_M.gguf) | Q5_K_M | 0.167 GB | large, very low quality loss - recommended |
88
+ | [TinyMistral-248M-v2-Q6_K.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q6_K.gguf) | Q6_K | 0.190 GB | very large, extremely low quality loss |
89
+ | [TinyMistral-248M-v2-Q8_0.gguf](https://huggingface.co/tensorblock/TinyMistral-248M-v2-GGUF/blob/main/TinyMistral-248M-v2-Q8_0.gguf) | Q8_0 | 0.246 GB | very large, extremely low quality loss - not recommended |
90
+
91
+
92
+ ## Downloading instruction
93
+
94
+ ### Command line
95
+
96
+ Firstly, install Huggingface Client
97
+
98
+ ```shell
99
+ pip install -U "huggingface_hub[cli]"
100
+ ```
101
+
102
+ Then, downoad the individual model file the a local directory
103
+
104
+ ```shell
105
+ huggingface-cli download tensorblock/TinyMistral-248M-v2-GGUF --include "TinyMistral-248M-v2-Q2_K.gguf" --local-dir MY_LOCAL_DIR
106
+ ```
107
+
108
+ If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
109
+
110
+ ```shell
111
+ huggingface-cli download tensorblock/TinyMistral-248M-v2-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
112
+ ```
TinyMistral-248M-v2-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b04dcf32a3fbb420cf06d074f78e73edb50e74d5745ba1eaf09a9a097a712e87
3
+ size 105459392
TinyMistral-248M-v2-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11291137e2b3cb813f83d9a0cb191dc5c78a91c4ab39605eadc0dd4f1009c120
3
+ size 137222336
TinyMistral-248M-v2-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:049b0f05f7431430203e99c8c0c92cd592ed93f7df097bb1d4c0036d196a4c45
3
+ size 129030336
TinyMistral-248M-v2-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4611164496429cfb8270cebbf27202afd84c9266df40fdc76e24ea43e869bddc
3
+ size 120191168
TinyMistral-248M-v2-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ba0dda1e4d84fdc975d839e7483130bf4ebb3d2eed4fd74671abbd7b8fc7c55
3
+ size 148775776
TinyMistral-248M-v2-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:030129c3c3cc50dba56a631b109d9647091598805fb7e68710afe9c59f1c905b
3
+ size 155669344
TinyMistral-248M-v2-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f17e69fe1d9c1b77ba2fb27892f28a97599504cbf96d4f5067e819d038089573
3
+ size 149431136
TinyMistral-248M-v2-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fd681b2f651ee987b43d0cda45bdd7c9fed66dc7a60397da6ac632a8bc4d4c4
3
+ size 175678944
TinyMistral-248M-v2-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d19e7b7330951cc8bef7d56e632d1706fae56451d1bfc5dea1e31d974970b807
3
+ size 179230176
TinyMistral-248M-v2-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80d9d0dda5a3c46d81dbd1fc3add7d789cd1510a14c5a094a36405ec4d0e088a
3
+ size 175678944
TinyMistral-248M-v2-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94a15477d94c270eb069c11965df7e9bd2ce6892374a2fc0e42c18123a7cb1c2
3
+ size 204263584
TinyMistral-248M-v2-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4114d5beaf47a4154db2116b42a5f09244a995be03827a80a9352fb07bc11f1b
3
+ size 264325664