Upload folder using huggingface_hub

README.md

@@ -1,13 +1,9 @@
 ---
 library_name: transformers
 tags:
-- tiny
-- random
 - TensorBlock
 - GGUF
-license: mit
-pipeline_tag: text-generation
-base_model: distilabel-internal-testing/tiny-random-mistral
+base_model: hyper-accel/tiny-random-mistral
 ---
 
 <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -21,12 +17,11 @@ base_model: distilabel-internal-testing/tiny-random-mistral
     </div>
 </div>
 
-## distilabel-internal-testing/tiny-random-mistral - GGUF
+## hyper-accel/tiny-random-mistral - GGUF
 
-This repo contains GGUF format model files for [distilabel-internal-testing/tiny-random-mistral](https://huggingface.co/distilabel-internal-testing/tiny-random-mistral).
-
-The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+This repo contains GGUF format model files for [hyper-accel/tiny-random-mistral](https://huggingface.co/hyper-accel/tiny-random-mistral).
 
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4882](https://github.com/ggml-org/llama.cpp/commit/be7c3034108473beda214fd1d7c98fd6a7a3bdf5).
 
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
@@ -36,29 +31,26 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 ## Prompt template
 
-
 ```
-<s> [INST] {system_prompt}
-
-{prompt} [/INST]
+Unable to determine prompt format automatically. Please check the original model repository for the correct prompt format.
 ```
 
 ## Model file specification
 
 | Filename | Quant type | File Size | Description |
 | -------- | ---------- | --------- | ----------- |
-| [tiny-random-mistral-Q2_K.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q2_K.gguf) | Q2_K | 0.007 GB | smallest, significant quality loss - not recommended for most purposes |
-| [tiny-random-mistral-Q3_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_S.gguf) | Q3_K_S | 0.007 GB | very small, high quality loss |
-| [tiny-random-mistral-Q3_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_M.gguf) | Q3_K_M | 0.007 GB | very small, high quality loss |
-| [tiny-random-mistral-Q3_K_L.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_L.gguf) | Q3_K_L | 0.007 GB | small, substantial quality loss |
-| [tiny-random-mistral-Q4_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_0.gguf) | Q4_0 | 0.007 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
-| [tiny-random-mistral-Q4_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_K_S.gguf) | Q4_K_S | 0.007 GB | small, greater quality loss |
-| [tiny-random-mistral-Q4_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_K_M.gguf) | Q4_K_M | 0.007 GB | medium, balanced quality - recommended |
-| [tiny-random-mistral-Q5_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_0.gguf) | Q5_0 | 0.007 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
-| [tiny-random-mistral-Q5_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_K_S.gguf) | Q5_K_S | 0.008 GB | large, low quality loss - recommended |
-| [tiny-random-mistral-Q5_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_K_M.gguf) | Q5_K_M | 0.008 GB | large, very low quality loss - recommended |
-| [tiny-random-mistral-Q6_K.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q6_K.gguf) | Q6_K | 0.009 GB | very large, extremely low quality loss |
-| [tiny-random-mistral-Q8_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q8_0.gguf) | Q8_0 | 0.009 GB | very large, extremely low quality loss - not recommended |
+| [tiny-random-mistral-Q2_K.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q2_K.gguf) | Q2_K | 0.022 GB | smallest, significant quality loss - not recommended for most purposes |
+| [tiny-random-mistral-Q3_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_S.gguf) | Q3_K_S | 0.024 GB | very small, high quality loss |
+| [tiny-random-mistral-Q3_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_M.gguf) | Q3_K_M | 0.025 GB | very small, high quality loss |
+| [tiny-random-mistral-Q3_K_L.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q3_K_L.gguf) | Q3_K_L | 0.025 GB | small, substantial quality loss |
+| [tiny-random-mistral-Q4_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_0.gguf) | Q4_0 | 0.028 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [tiny-random-mistral-Q4_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_K_S.gguf) | Q4_K_S | 0.028 GB | small, greater quality loss |
+| [tiny-random-mistral-Q4_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q4_K_M.gguf) | Q4_K_M | 0.028 GB | medium, balanced quality - recommended |
+| [tiny-random-mistral-Q5_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_0.gguf) | Q5_0 | 0.031 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [tiny-random-mistral-Q5_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_K_S.gguf) | Q5_K_S | 0.031 GB | large, low quality loss - recommended |
+| [tiny-random-mistral-Q5_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q5_K_M.gguf) | Q5_K_M | 0.031 GB | large, very low quality loss - recommended |
+| [tiny-random-mistral-Q6_K.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q6_K.gguf) | Q6_K | 0.034 GB | very large, extremely low quality loss |
+| [tiny-random-mistral-Q8_0.gguf](https://huggingface.co/tensorblock/tiny-random-mistral-GGUF/blob/main/tiny-random-mistral-Q8_0.gguf) | Q8_0 | 0.044 GB | very large, extremely low quality loss - not recommended |
 
 
 ## Downloading instruction

tiny-random-mistral-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:102d5323586541aefc71a087b961815c69283f9211e858545d81ac220c6fbd7d
-size 7441792
+oid sha256:7e9a4a0c28be6bfd2aec15050954f3476674ca763e5aa6381a9fda91f1ccaf09
+size 22336992

tiny-random-mistral-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d8d16755c8e218fb31f23529ab99422bc78b5ae9d6dce9c4cfb5069db534de3e
-size 7451008
+oid sha256:3c6563ff459c7da5efdd1a9ae1ef139970cfdd591153032a57ab597419c1fb23
+size 25185760

tiny-random-mistral-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:312c9b6c6b80675a0d71f520b91ec4cc3013cff38c36b834420b398dff7cce91
-size 7448960
+oid sha256:5a34b1947cd9fb7960da5cd45bc27657bdfa9c30cfe8eb76478596dffbc27e59
+size 24858080

tiny-random-mistral-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f01ab8399c7f8d9d2004f418cee735a37a6e5881855a121328cf8fc340573770
-size 7441792
+oid sha256:564243d4f2ba18c98e288489d5f6d85dac779d2ad0c7ade483d4abcaf5b1f977
+size 24476128

tiny-random-mistral-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ae173c0860eec8d086ecee787c5a381a7d48ee41ec0ff4231cf2cb7bccd563e8
-size 7441792
+oid sha256:e571a9c6d05a7b87b92e510e512a86f43c3068ae61c23f6d8eb21ebe63bcbb12
+size 27661792

tiny-random-mistral-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0fdd8dd56408b5570e1e9efd679fdb9209de53cf99b00ee2bf899137c7025a76
-size 7980416
+oid sha256:aac2d370929d6589f997b0099a29d654afa33c307d2125492bd7c9f999d0df48
+size 27949024

tiny-random-mistral-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:60e282013745b2e6fc42ac9938d9dbfc9127f698cdcd4fbb17d4c9042dfc91b1
-size 7969152
+oid sha256:36a07ea0023cdc24bafd218831aa160259ff7914067dbbb8ab32cc336deb4d4a
+size 27678176

tiny-random-mistral-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc1cc3909a644316f9d525de9b156a675d96f7ab4d5926c8305e6e5cf58092d4
-size 7968128
+oid sha256:bf9626be958da71947f1b731ccf401c7fba7b9045dc09866b5b03b4436d4aae6
+size 30660064

tiny-random-mistral-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d81bb0a7a184efb5eead59e21cf34eafaf110e1a330b7fa2b013ecde28e026de
-size 8241536
+oid sha256:56fc5e27e104b1d84ee4b6afbfbbdd265fbfb184da208220bd74f5197f6834b5
+size 30808032

tiny-random-mistral-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7c12fc76db62df30cba825c448fdae6a74d66d42189d8deacf4dad3baafdf123
-size 8231296
+oid sha256:66266513bc038db47c1789159c500fb68bcdd34f1302a028228bde4b717d9507
+size 30660064

tiny-random-mistral-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc2a87a30f89f4079b3c3ac70ff6588442272dc8406d3cf39d7cc4268f6bf704
-size 9547136
+oid sha256:dbd99f790455af39793c47f1463c7040699eb7ef1b52e9e8482d312bc4503f71
+size 33845728

tiny-random-mistral-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2a3b2f424d6e8f8d3bb1a09b2a6b4e535520e89242619613608830895304440e
-size 9547136
+oid sha256:8eb63428e3eecf57e3a0f8a0f6613fc304cd4397756920145559b6b14f5e6cef
+size 43622880