Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+MultiLora-drop-sharegpt-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

MultiLora-drop-sharegpt-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:414183c15ea7e7c37c6b2d69403ba1e950e56dfb9f6aa0f2c149cfd5943b5a26
+size 2532864608

MultiLora-drop-sharegpt-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71b9d0d73cb2f38d7254c9293b0c5a4219de52dac6a4fd7bf68e203783a56745
+size 3597111904

MultiLora-drop-sharegpt-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6951f11fb70228e62dd94f59cd768e19333992daf154a3e93f5c8c8e17fd320
+size 3298005600

MultiLora-drop-sharegpt-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0d99a99910c2555736cedd6c2c7638d55c45534304360b103304466bae910b2
+size 2948305504

MultiLora-drop-sharegpt-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a157739051f1f4f30423bb9ca5106b291bc36b5a5dec003723a1973005d6d8c
+size 3825807968

MultiLora-drop-sharegpt-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df6feff5cf62abee3269c76ac41dd886e6a404d406352bf981d7d23f124f596a
+size 4081005152

MultiLora-drop-sharegpt-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:70914307b92782f86396268c688005629f03492862f7bf7f1d9c4e0f8a5e615b
+size 3856740960

MultiLora-drop-sharegpt-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54b8ad3d4b7a107b5f3a7cf3f5c03a97f2b2ae05836b8c38fc848f2f3f8a60b8
+size 4651692640

MultiLora-drop-sharegpt-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ea5fb73461f5d2e3a7746e6d89231930cc59f8ecbe40002e4f748afe6875d19
+size 4783157856

MultiLora-drop-sharegpt-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b6f46e76971ef5322db16a79161dcafa72c3787fe5ad2a369340016bd9b7f2b
+size 4651692640

MultiLora-drop-sharegpt-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:161abe63e8e305b39d9914260663fcf89a75233e57865b193b6fd681ea6d10e0
+size 5529195104

MultiLora-drop-sharegpt-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c36a93552023d7024e37458d39bdadcca994d9a0ca643f9f03179735a101148
+size 7161090656

README.md

@@ -0,0 +1,81 @@
+---
+license: llama2
+datasets:
+- anon8231489123/ShareGPT_Vicuna_unfiltered
+- EleutherAI/drop
+language:
+- en
+tags:
+- TensorBlock
+- GGUF
+base_model: Charlie911/MultiLora-drop-sharegpt
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## Charlie911/MultiLora-drop-sharegpt - GGUF
+
+This repo contains GGUF format model files for [Charlie911/MultiLora-drop-sharegpt](https://huggingface.co/Charlie911/MultiLora-drop-sharegpt).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [MultiLora-drop-sharegpt-Q2_K.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q2_K.gguf) | Q2_K | 2.533 GB | smallest, significant quality loss - not recommended for most purposes |
+| [MultiLora-drop-sharegpt-Q3_K_S.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q3_K_S.gguf) | Q3_K_S | 2.948 GB | very small, high quality loss |
+| [MultiLora-drop-sharegpt-Q3_K_M.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q3_K_M.gguf) | Q3_K_M | 3.298 GB | very small, high quality loss |
+| [MultiLora-drop-sharegpt-Q3_K_L.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q3_K_L.gguf) | Q3_K_L | 3.597 GB | small, substantial quality loss |
+| [MultiLora-drop-sharegpt-Q4_0.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q4_0.gguf) | Q4_0 | 3.826 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [MultiLora-drop-sharegpt-Q4_K_S.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q4_K_S.gguf) | Q4_K_S | 3.857 GB | small, greater quality loss |
+| [MultiLora-drop-sharegpt-Q4_K_M.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q4_K_M.gguf) | Q4_K_M | 4.081 GB | medium, balanced quality - recommended |
+| [MultiLora-drop-sharegpt-Q5_0.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q5_0.gguf) | Q5_0 | 4.652 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [MultiLora-drop-sharegpt-Q5_K_S.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q5_K_S.gguf) | Q5_K_S | 4.652 GB | large, low quality loss - recommended |
+| [MultiLora-drop-sharegpt-Q5_K_M.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q5_K_M.gguf) | Q5_K_M | 4.783 GB | large, very low quality loss - recommended |
+| [MultiLora-drop-sharegpt-Q6_K.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q6_K.gguf) | Q6_K | 5.529 GB | very large, extremely low quality loss |
+| [MultiLora-drop-sharegpt-Q8_0.gguf](https://huggingface.co/tensorblock/MultiLora-drop-sharegpt-GGUF/blob/main/MultiLora-drop-sharegpt-Q8_0.gguf) | Q8_0 | 7.161 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/MultiLora-drop-sharegpt-GGUF --include "MultiLora-drop-sharegpt-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/MultiLora-drop-sharegpt-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```