Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4110fd7b37d11809e02bf848c0252e815efa7cd692561480e3735acea0596d7a
+size 338731936

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf8d123b9deb3c0137f3e3f2f0671df59fabe5e4a2ea8dd94a4b9ebe6535b011
+size 369482656

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e751eb7dccdb1ff3468c7f09073acbb6f9577609ccf16db8cae22c27aae69cb
+size 355591072

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42cef1dc9c3684ab84bd62ae8f4ac0e30ec52c01b8f7ecdbc6cf913c93af6107
+size 338387872

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edda6e2658dbf67beb5cd309cfee15c66fbc889f9bbf6cfd61ab0625895b8ad4
+size 352279456

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a55346fd5436291726165bddca59e25674d7343a772fc6e6b954366b3048904d
+size 397932448

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1c0a8036e4b3fb0ae9cfb2f75dac16bb67b795a6e548ac7f9940c1a2b7f84c0
+size 385596320

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9c5487a8e6d191662fa2e21b7f06ae088f18da2c3e292eae7963ff2fb8be94b
+size 397007776

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4506ad0eecf8c45238360a73c4048770334b41fa23408c6287a913f00f3441d
+size 420210592

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:196a94075e84e4f0d1ea95346e1dd0c3bfca129745511bd07e14343b977b02ee
+size 412834720

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bcdefd75035a332413c5bc5acec14ff3346040a0323028f6e5062333ed4af53c
+size 505861024

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19381e469908743a03797e6fbdde20dd9744184c19e1fa9b547e8c7898919731
+size 531192736

README.md

@@ -0,0 +1,83 @@
+---
+license: apache-2.0
+language:
+- en
+base_model: alamios/DeepSeek-R1-DRAFT-Qwen2.5-0.5B
+pipeline_tag: text-generation
+library_name: transformers
+tags:
+- qwen
+- qwen2.5
+- deepseek
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## alamios/DeepSeek-R1-DRAFT-Qwen2.5-0.5B - GGUF
+
+This repo contains GGUF format model files for [alamios/DeepSeek-R1-DRAFT-Qwen2.5-0.5B](https://huggingface.co/alamios/DeepSeek-R1-DRAFT-Qwen2.5-0.5B).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4823](https://github.com/ggml-org/llama.cpp/commit/5bbe6a9fe9a8796a9389c85accec89dbc4d91e39).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<｜begin▁of▁sentence｜>{system_prompt}<｜User｜>{prompt}<｜Assistant｜><think>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K.gguf) | Q2_K | 0.339 GB | smallest, significant quality loss - not recommended for most purposes |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_S.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_S.gguf) | Q3_K_S | 0.338 GB | very small, high quality loss |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_M.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_M.gguf) | Q3_K_M | 0.356 GB | very small, high quality loss |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_L.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q3_K_L.gguf) | Q3_K_L | 0.369 GB | small, substantial quality loss |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_0.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_0.gguf) | Q4_0 | 0.352 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_S.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_S.gguf) | Q4_K_S | 0.386 GB | small, greater quality loss |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_M.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_M.gguf) | Q4_K_M | 0.398 GB | medium, balanced quality - recommended |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_0.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_0.gguf) | Q5_0 | 0.397 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_S.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_S.gguf) | Q5_K_S | 0.413 GB | large, low quality loss - recommended |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_M.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q5_K_M.gguf) | Q5_K_M | 0.420 GB | large, very low quality loss - recommended |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q6_K.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q6_K.gguf) | Q6_K | 0.506 GB | very large, extremely low quality loss |
+| [DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q8_0.gguf](https://huggingface.co/tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF/blob/main/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q8_0.gguf) | Q8_0 | 0.531 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF --include "DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```