Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Volare-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Volare-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,78 @@
+---
+license: mit
+language:
+- it
+- en
+library_name: transformers
+tags:
+- sft
+- it
+- gemma
+- chatml
+- TensorBlock
+- GGUF
+base_model: MoxoffSpA/Volare
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## MoxoffSpA/Volare - GGUF
+
+This repo contains GGUF format model files for [MoxoffSpA/Volare](https://huggingface.co/MoxoffSpA/Volare).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Volare-Q2_K.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q2_K.gguf) | Q2_K | 3.242 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Volare-Q3_K_S.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q3_K_S.gguf) | Q3_K_S | 3.709 GB | very small, high quality loss |
+| [Volare-Q3_K_M.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q3_K_M.gguf) | Q3_K_M | 4.069 GB | very small, high quality loss |
+| [Volare-Q3_K_L.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q3_K_L.gguf) | Q3_K_L | 4.386 GB | small, substantial quality loss |
+| [Volare-Q4_0.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q4_0.gguf) | Q4_0 | 4.668 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Volare-Q4_K_S.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q4_K_S.gguf) | Q4_K_S | 4.700 GB | small, greater quality loss |
+| [Volare-Q4_K_M.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q4_K_M.gguf) | Q4_K_M | 4.964 GB | medium, balanced quality - recommended |
+| [Volare-Q5_0.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q5_0.gguf) | Q5_0 | 5.570 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Volare-Q5_K_S.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q5_K_S.gguf) | Q5_K_S | 5.570 GB | large, low quality loss - recommended |
+| [Volare-Q5_K_M.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q5_K_M.gguf) | Q5_K_M | 5.723 GB | large, very low quality loss - recommended |
+| [Volare-Q6_K.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q6_K.gguf) | Q6_K | 6.529 GB | very large, extremely low quality loss |
+| [Volare-Q8_0.gguf](https://huggingface.co/tensorblock/Volare-GGUF/tree/main/Volare-Q8_0.gguf) | Q8_0 | 8.454 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Volare-GGUF --include "Volare-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Volare-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

Volare-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab2c91e7897d8285f9e7deb7484c76eb79d979e9c1bd13ea6862ee2b38e380a7
+size 3481447232

Volare-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea5dc24505dc8e7a28a38104ae6e284cdc0208fc63ca64aee15ef545f83611ef
+size 4709067584

Volare-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9f4dbe8f07aa1fc5bd6467fc7823ebb68bff520d3d79f76875d4eb18e6c6a77c
+size 4369328960

Volare-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a894048c3d2b27b049aec34a129afdb76b9166c7363340455ab3597f444b4596
+size 3982404416

Volare-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37d7e32826fc7798f29fc5f55f4a831ff7f3886259600e69162e9238067d206f
+size 5011843904

Volare-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76d8c27a4942ce23831aaf146a8c1ed2b5afed35bfbd4cdcfbc4555b8b631ffc
+size 5329759040

Volare-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a1837b838a680fb9b65cf2cc9ac377fe69a7d31bcabff5c58d1ab19826e8b10
+size 5046446912

Volare-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d770c3100095403d6c59c09014862e368a09699d4b7b8d8d57cba704b62645d
+size 5980728128

Volare-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f81fd9384440011a6e71da15d10f27ab71c5d77053f7742344d5e5238fad126
+size 6144502592

Volare-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8652c07ac9cc586dbdceb54a046d4924a543b650ad2ee0acf51fa52fa368108
+size 5980728128

Volare-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:658fac498b85ba8b93beb599614415ac62a6f4558ba8951c7e282c3b83a32c40
+size 7010167616

Volare-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc6ae70bd1767bc27855721b3870037bd1f86b005bf7344dc7f5d5a3a5d60170
+size 9077844800