Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Blue-Orchid-2x7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Blue-Orchid-2x7b-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58f4e59b40eb0c3e1c9a85f758a794d4994b4f8e86caf0a1670525533fab7794
+size 4760823200

Blue-Orchid-2x7b-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d54d6791fd1189e4b4d80966158af9ff88f75450a159c3b8cb3a8d6f4736d431
+size 6729729440

Blue-Orchid-2x7b-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b86a5638a91856af7e0bbff6ba09f40e7f3f6aa5a137f15b2de2b87ebc154610
+size 6206490016

Blue-Orchid-2x7b-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb4e64588026bf9fe14354582c3d780f41c2dc9ffc59223e5f91fbf68d2898b9
+size 5587830176

Blue-Orchid-2x7b-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0d450a578306e682712abcfb4c9d8f2ec937293890f075483ae3b79b8ea68423
+size 7280862624

Blue-Orchid-2x7b-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7543cb6b103c1850ce2e0a1c0c44dea2343d39135d08c9aaa6d02cfd670f4954
+size 7782606240

Blue-Orchid-2x7b-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:487b6d68fe842c173b66d00c06a3331d3acf4f3826e1b9f00a6026db4d9c813f
+size 7341680032

Blue-Orchid-2x7b-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02cea8d7afebd41c3e45e99921cf85bffb6a4a10c4565bbe024f5f95660bedf7
+size 8874304928

Blue-Orchid-2x7b-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca943b85d68f5e900ade9d892da6b6e4b3a4c9160c08071c66fa1539fb2c9f88
+size 9132778912

Blue-Orchid-2x7b-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856651565f79c9921eb6fd9c08676bb3867d52de40200e04e0e2a9490e2d4fb8
+size 8874304928

Blue-Orchid-2x7b-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b85222349bd9d7971abcab295cfd56d263678e6cdadd731319771b34e5d1e23
+size 10567337376

Blue-Orchid-2x7b-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a9e86291f96061bcdfefc11f28c63be517a4a1d921d5e4f38d38b464a8d109f
+size 13686375840

README.md

@@ -0,0 +1,76 @@
+---
+license: apache-2.0
+tags:
+- TensorBlock
+- GGUF
+base_model: nakodanei/Blue-Orchid-2x7b
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## nakodanei/Blue-Orchid-2x7b - GGUF
+
+This repo contains GGUF format model files for [nakodanei/Blue-Orchid-2x7b](https://huggingface.co/nakodanei/Blue-Orchid-2x7b).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Blue-Orchid-2x7b-Q2_K.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q2_K.gguf) | Q2_K | 4.761 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Blue-Orchid-2x7b-Q3_K_S.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q3_K_S.gguf) | Q3_K_S | 5.588 GB | very small, high quality loss |
+| [Blue-Orchid-2x7b-Q3_K_M.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q3_K_M.gguf) | Q3_K_M | 6.206 GB | very small, high quality loss |
+| [Blue-Orchid-2x7b-Q3_K_L.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q3_K_L.gguf) | Q3_K_L | 6.730 GB | small, substantial quality loss |
+| [Blue-Orchid-2x7b-Q4_0.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q4_0.gguf) | Q4_0 | 7.281 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Blue-Orchid-2x7b-Q4_K_S.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q4_K_S.gguf) | Q4_K_S | 7.342 GB | small, greater quality loss |
+| [Blue-Orchid-2x7b-Q4_K_M.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q4_K_M.gguf) | Q4_K_M | 7.783 GB | medium, balanced quality - recommended |
+| [Blue-Orchid-2x7b-Q5_0.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q5_0.gguf) | Q5_0 | 8.874 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Blue-Orchid-2x7b-Q5_K_S.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q5_K_S.gguf) | Q5_K_S | 8.874 GB | large, low quality loss - recommended |
+| [Blue-Orchid-2x7b-Q5_K_M.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q5_K_M.gguf) | Q5_K_M | 9.133 GB | large, very low quality loss - recommended |
+| [Blue-Orchid-2x7b-Q6_K.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q6_K.gguf) | Q6_K | 10.567 GB | very large, extremely low quality loss |
+| [Blue-Orchid-2x7b-Q8_0.gguf](https://huggingface.co/tensorblock/Blue-Orchid-2x7b-GGUF/blob/main/Blue-Orchid-2x7b-Q8_0.gguf) | Q8_0 | 13.686 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Blue-Orchid-2x7b-GGUF --include "Blue-Orchid-2x7b-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Blue-Orchid-2x7b-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```