Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+aya-expanse-8b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,112 @@
+---
+inference: false
+library_name: transformers
+language:
+- en
+- fr
+- de
+- es
+- it
+- pt
+- ja
+- ko
+- zh
+- ar
+- el
+- fa
+- pl
+- id
+- cs
+- he
+- hi
+- nl
+- ro
+- ru
+- tr
+- uk
+- vi
+license: cc-by-nc-4.0
+extra_gated_prompt: By submitting this form, you agree to the [License Agreement](https://cohere.com/c4ai-cc-by-nc-license)  and
+  acknowledge that the information you provide will be collected, used, and shared
+  in accordance with Cohere’s [Privacy Policy]( https://cohere.com/privacy). You’ll
+  receive email updates about C4AI and Cohere research, events, products and services.
+  You can unsubscribe at any time.
+extra_gated_fields:
+  Name: text
+  Affiliation: text
+  Country: country
+  I agree to use this model for non-commercial use ONLY: checkbox
+tags:
+- TensorBlock
+- GGUF
+base_model: CohereForAI/aya-expanse-8b
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## CohereForAI/aya-expanse-8b - GGUF
+
+This repo contains GGUF format model files for [CohereForAI/aya-expanse-8b](https://huggingface.co/CohereForAI/aya-expanse-8b).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<BOS_TOKEN><|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>{system_prompt}<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>{prompt}<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [aya-expanse-8b-Q2_K.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q2_K.gguf) | Q2_K | 3.438 GB | smallest, significant quality loss - not recommended for most purposes |
+| [aya-expanse-8b-Q3_K_S.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q3_K_S.gguf) | Q3_K_S | 3.871 GB | very small, high quality loss |
+| [aya-expanse-8b-Q3_K_M.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q3_K_M.gguf) | Q3_K_M | 4.225 GB | very small, high quality loss |
+| [aya-expanse-8b-Q3_K_L.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q3_K_L.gguf) | Q3_K_L | 4.528 GB | small, substantial quality loss |
+| [aya-expanse-8b-Q4_0.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q4_0.gguf) | Q4_0 | 4.797 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [aya-expanse-8b-Q4_K_S.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q4_K_S.gguf) | Q4_K_S | 4.829 GB | small, greater quality loss |
+| [aya-expanse-8b-Q4_K_M.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q4_K_M.gguf) | Q4_K_M | 5.057 GB | medium, balanced quality - recommended |
+| [aya-expanse-8b-Q5_0.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q5_0.gguf) | Q5_0 | 5.670 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [aya-expanse-8b-Q5_K_S.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q5_K_S.gguf) | Q5_K_S | 5.670 GB | large, low quality loss - recommended |
+| [aya-expanse-8b-Q5_K_M.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q5_K_M.gguf) | Q5_K_M | 5.804 GB | large, very low quality loss - recommended |
+| [aya-expanse-8b-Q6_K.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q6_K.gguf) | Q6_K | 6.597 GB | very large, extremely low quality loss |
+| [aya-expanse-8b-Q8_0.gguf](https://huggingface.co/tensorblock/aya-expanse-8b-GGUF/blob/main/aya-expanse-8b-Q8_0.gguf) | Q8_0 | 8.541 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/aya-expanse-8b-GGUF --include "aya-expanse-8b-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/aya-expanse-8b-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

aya-expanse-8b-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9016e41b24512271de6dba788322fe8afbb78d8b1c0f344193f4b65385b5e53a
+size 3438497632

aya-expanse-8b-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:804b768a5c315c2625624981d028ad690cab0802fc7bb5d4e2740882afb91d2b
+size 4527968096

aya-expanse-8b-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d90647153f0ca61f89c6c24d9c1c4f7d1445d54e1a1f22564e17f4745973647d
+size 4224929632

aya-expanse-8b-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67ec0565b69c6401bdeb123baaab854ec4edf57c1fd5f82a9c3ec5cf6cd99422
+size 3870510944

aya-expanse-8b-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47c09437128319138fe535812d994c704360d981dab4b4df08d7760812d6fac6
+size 4797452128

aya-expanse-8b-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:add3774fe74108bf58ba44b236638c9997731f93f871142105bc1d60e8d71b8a
+size 5056974688

aya-expanse-8b-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:112fc8bdb793080355fbdd46e6f0f667bfb3c4ea3e691d30a839c044527aefe2
+size 4828909408

aya-expanse-8b-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a13ef5917d12cd2a4a963b3a5f8e557cce922a6ffb610a4080fce8dc56b7bc9d
+size 5669867360

aya-expanse-8b-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8005e8941fa09f4cd1deb4614c4985c64128f45f746fd04ad2d12937dff0d61a
+size 5803560800

aya-expanse-8b-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d661ddf337928f19e06fc81f68323c4b2d884b0ce74e471dcb6b4014d63ea06f
+size 5669867360

aya-expanse-8b-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:197b8095bde4c44e50636f1937f9628a306e2526701a2af2a587bd5455d2b748
+size 6596808544

aya-expanse-8b-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1038d84e4c01b5d68fa8f210c88766897f30812c2f02f73df4ad00fac6ebac78
+size 8541065056