Upload folder using huggingface_hub
Browse files- README.md +18 -19
- tiny-random-orion-Q2_K.gguf +2 -2
- tiny-random-orion-Q3_K_L.gguf +2 -2
- tiny-random-orion-Q3_K_M.gguf +2 -2
- tiny-random-orion-Q3_K_S.gguf +2 -2
- tiny-random-orion-Q4_0.gguf +2 -2
- tiny-random-orion-Q4_K_M.gguf +2 -2
- tiny-random-orion-Q4_K_S.gguf +2 -2
- tiny-random-orion-Q5_0.gguf +2 -2
- tiny-random-orion-Q5_K_M.gguf +2 -2
- tiny-random-orion-Q5_K_S.gguf +2 -2
- tiny-random-orion-Q6_K.gguf +2 -2
- tiny-random-orion-Q8_0.gguf +2 -2
README.md
CHANGED
|
@@ -1,8 +1,9 @@
|
|
| 1 |
---
|
| 2 |
-
|
| 3 |
tags:
|
| 4 |
- TensorBlock
|
| 5 |
- GGUF
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
@@ -16,12 +17,11 @@ tags:
|
|
| 16 |
</div>
|
| 17 |
</div>
|
| 18 |
|
| 19 |
-
##
|
| 20 |
|
| 21 |
-
This repo contains GGUF format model files for [
|
| 22 |
-
|
| 23 |
-
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
| 24 |
|
|
|
|
| 25 |
|
| 26 |
<div style="text-align: left; margin: 20px 0;">
|
| 27 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
|
@@ -31,27 +31,26 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
| 31 |
|
| 32 |
## Prompt template
|
| 33 |
|
| 34 |
-
|
| 35 |
```
|
| 36 |
-
|
| 37 |
```
|
| 38 |
|
| 39 |
## Model file specification
|
| 40 |
|
| 41 |
| Filename | Quant type | File Size | Description |
|
| 42 |
| -------- | ---------- | --------- | ----------- |
|
| 43 |
-
| [tiny-random-orion-Q2_K.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q2_K.gguf) | Q2_K | 0.
|
| 44 |
-
| [tiny-random-orion-Q3_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_S.gguf) | Q3_K_S | 0.
|
| 45 |
-
| [tiny-random-orion-Q3_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_M.gguf) | Q3_K_M | 0.
|
| 46 |
-
| [tiny-random-orion-Q3_K_L.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_L.gguf) | Q3_K_L | 0.
|
| 47 |
-
| [tiny-random-orion-Q4_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_0.gguf) | Q4_0 | 0.
|
| 48 |
-
| [tiny-random-orion-Q4_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_K_S.gguf) | Q4_K_S | 0.
|
| 49 |
-
| [tiny-random-orion-Q4_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_K_M.gguf) | Q4_K_M | 0.
|
| 50 |
-
| [tiny-random-orion-Q5_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_0.gguf) | Q5_0 | 0.
|
| 51 |
-
| [tiny-random-orion-Q5_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_K_S.gguf) | Q5_K_S | 0.
|
| 52 |
-
| [tiny-random-orion-Q5_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_K_M.gguf) | Q5_K_M | 0.
|
| 53 |
-
| [tiny-random-orion-Q6_K.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q6_K.gguf) | Q6_K | 0.
|
| 54 |
-
| [tiny-random-orion-Q8_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q8_0.gguf) | Q8_0 | 0.
|
| 55 |
|
| 56 |
|
| 57 |
## Downloading instruction
|
|
|
|
| 1 |
---
|
| 2 |
+
library_name: transformers
|
| 3 |
tags:
|
| 4 |
- TensorBlock
|
| 5 |
- GGUF
|
| 6 |
+
base_model: hyper-accel/tiny-random-orion
|
| 7 |
---
|
| 8 |
|
| 9 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
|
|
| 17 |
</div>
|
| 18 |
</div>
|
| 19 |
|
| 20 |
+
## hyper-accel/tiny-random-orion - GGUF
|
| 21 |
|
| 22 |
+
This repo contains GGUF format model files for [hyper-accel/tiny-random-orion](https://huggingface.co/hyper-accel/tiny-random-orion).
|
|
|
|
|
|
|
| 23 |
|
| 24 |
+
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4882](https://github.com/ggml-org/llama.cpp/commit/be7c3034108473beda214fd1d7c98fd6a7a3bdf5).
|
| 25 |
|
| 26 |
<div style="text-align: left; margin: 20px 0;">
|
| 27 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
|
|
|
| 31 |
|
| 32 |
## Prompt template
|
| 33 |
|
|
|
|
| 34 |
```
|
| 35 |
+
Unable to determine prompt format automatically. Please check the original model repository for the correct prompt format.
|
| 36 |
```
|
| 37 |
|
| 38 |
## Model file specification
|
| 39 |
|
| 40 |
| Filename | Quant type | File Size | Description |
|
| 41 |
| -------- | ---------- | --------- | ----------- |
|
| 42 |
+
| [tiny-random-orion-Q2_K.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q2_K.gguf) | Q2_K | 0.054 GB | smallest, significant quality loss - not recommended for most purposes |
|
| 43 |
+
| [tiny-random-orion-Q3_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_S.gguf) | Q3_K_S | 0.059 GB | very small, high quality loss |
|
| 44 |
+
| [tiny-random-orion-Q3_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_M.gguf) | Q3_K_M | 0.059 GB | very small, high quality loss |
|
| 45 |
+
| [tiny-random-orion-Q3_K_L.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q3_K_L.gguf) | Q3_K_L | 0.060 GB | small, substantial quality loss |
|
| 46 |
+
| [tiny-random-orion-Q4_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_0.gguf) | Q4_0 | 0.066 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|
| 47 |
+
| [tiny-random-orion-Q4_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_K_S.gguf) | Q4_K_S | 0.066 GB | small, greater quality loss |
|
| 48 |
+
| [tiny-random-orion-Q4_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q4_K_M.gguf) | Q4_K_M | 0.066 GB | medium, balanced quality - recommended |
|
| 49 |
+
| [tiny-random-orion-Q5_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_0.gguf) | Q5_0 | 0.072 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 50 |
+
| [tiny-random-orion-Q5_K_S.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_K_S.gguf) | Q5_K_S | 0.072 GB | large, low quality loss - recommended |
|
| 51 |
+
| [tiny-random-orion-Q5_K_M.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q5_K_M.gguf) | Q5_K_M | 0.072 GB | large, very low quality loss - recommended |
|
| 52 |
+
| [tiny-random-orion-Q6_K.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q6_K.gguf) | Q6_K | 0.079 GB | very large, extremely low quality loss |
|
| 53 |
+
| [tiny-random-orion-Q8_0.gguf](https://huggingface.co/tensorblock/tiny-random-orion-GGUF/blob/main/tiny-random-orion-Q8_0.gguf) | Q8_0 | 0.101 GB | very large, extremely low quality loss - not recommended |
|
| 54 |
|
| 55 |
|
| 56 |
## Downloading instruction
|
tiny-random-orion-Q2_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a15b040feac533aecfea2e7256a1e61b158db0f316468f6943fec404e609822f
|
| 3 |
+
size 54147104
|
tiny-random-orion-Q3_K_L.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8453c217d3e9e60f3470f6cd4a6567efd6acbdda61008c48e1967049062508be
|
| 3 |
+
size 59648544
|
tiny-random-orion-Q3_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29695cfb0aacbfdf40025a9560c28e6ce737fe39aa45d05c9eefb8e2ea430f3a
|
| 3 |
+
size 59386400
|
tiny-random-orion-Q3_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a38fde2f2e53e50c7dd8977a23b4f56bbd2a2ab49adc221c6aa1c71f9a7692c5
|
| 3 |
+
size 58972704
|
tiny-random-orion-Q4_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:67ddf51556de45042a5f07eea752094ad403b24d3990d3511587c4238ebb63b7
|
| 3 |
+
size 65631264
|
tiny-random-orion-Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c694e3bb86023465f308e1dc0e9e55e075504adc790c04b34a6087dac04e3169
|
| 3 |
+
size 65901600
|
tiny-random-orion-Q4_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:15be5027914e0e1522d9dc6039b64a7cd4beb4310cffd4ee947d20958fdfc6b4
|
| 3 |
+
size 65696800
|
tiny-random-orion-Q5_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a86f5098f449a11ebbcc03875b42ddb5a7b7c6310bb288196dd634b1e9bf58f8
|
| 3 |
+
size 71898144
|
tiny-random-orion-Q5_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6170a461fa9091811f9225682efc30b5f622382cb75f84cf11182b97ac6c6f59
|
| 3 |
+
size 72037408
|
tiny-random-orion-Q5_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9e7e83bc23ee266ef2aadcf478264ca8d0f9133bae2151e924a52cd3b7f51bf
|
| 3 |
+
size 71898144
|
tiny-random-orion-Q6_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09f59e7823fd3a45eeb6e80656037de7730bd7041ebaaee1a4fd78596d26fcce
|
| 3 |
+
size 78556704
|
tiny-random-orion-Q8_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6dbd8b61516b67230dbd8e174f7608a5a2344d99ca0ca10d2a4760b8e6c0a653
|
| 3 |
+
size 101190176
|