Upload folder using huggingface_hub

README.md

@@ -1,16 +1,16 @@
 ---
-language:
-- en
-library_name: transformers
 license: gemma
+library_name: transformers
+pipeline_tag: text-generation
+extra_gated_heading: Access Gemma on Hugging Face
+extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
+  agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
+  Face and click below. Requests are processed immediately.
+extra_gated_button_content: Acknowledge license
+base_model: google/gemma-2-9b
 tags:
-- unsloth
-- transformers
-- gemma2
-- gemma
 - TensorBlock
 - GGUF
-base_model: unsloth/gemma-2-9b
 ---
 
 <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -24,13 +24,12 @@ base_model: unsloth/gemma-2-9b
     </div>
 </div>
 
-## unsloth/gemma-2-9b - GGUF
+## google/gemma-2-9b - GGUF
 
-This repo contains GGUF format model files for [unsloth/gemma-2-9b](https://huggingface.co/unsloth/gemma-2-9b).
+This repo contains GGUF format model files for [google/gemma-2-9b](https://huggingface.co/google/gemma-2-9b).
 
 The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
 
-
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
         Run them on the TensorBlock client using your local machine ↗
@@ -39,7 +38,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 ## Prompt template
 
-
 ```
 
 ```
@@ -48,18 +46,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 | Filename | Quant type | File Size | Description |
 | -------- | ---------- | --------- | ----------- |
-| [gemma-2-9b-Q2_K.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q2_K.gguf) | Q2_K | 3.544 GB | smallest, significant quality loss - not recommended for most purposes |
-| [gemma-2-9b-Q3_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_S.gguf) | Q3_K_S | 4.040 GB | very small, high quality loss |
-| [gemma-2-9b-Q3_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_M.gguf) | Q3_K_M | 4.435 GB | very small, high quality loss |
-| [gemma-2-9b-Q3_K_L.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_L.gguf) | Q3_K_L | 4.780 GB | small, substantial quality loss |
-| [gemma-2-9b-Q4_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_0.gguf) | Q4_0 | 5.069 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
-| [gemma-2-9b-Q4_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_K_S.gguf) | Q4_K_S | 5.103 GB | small, greater quality loss |
-| [gemma-2-9b-Q4_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_K_M.gguf) | Q4_K_M | 5.365 GB | medium, balanced quality - recommended |
-| [gemma-2-9b-Q5_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_0.gguf) | Q5_0 | 6.038 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
-| [gemma-2-9b-Q5_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_K_S.gguf) | Q5_K_S | 6.038 GB | large, low quality loss - recommended |
-| [gemma-2-9b-Q5_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_K_M.gguf) | Q5_K_M | 6.191 GB | large, very low quality loss - recommended |
-| [gemma-2-9b-Q6_K.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q6_K.gguf) | Q6_K | 7.068 GB | very large, extremely low quality loss |
-| [gemma-2-9b-Q8_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q8_0.gguf) | Q8_0 | 9.152 GB | very large, extremely low quality loss - not recommended |
+| [gemma-2-9b-Q2_K.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q2_K.gguf) | Q2_K | 3.805 GB | smallest, significant quality loss - not recommended for most purposes |
+| [gemma-2-9b-Q3_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_S.gguf) | Q3_K_S | 4.338 GB | very small, high quality loss |
+| [gemma-2-9b-Q3_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_M.gguf) | Q3_K_M | 4.762 GB | very small, high quality loss |
+| [gemma-2-9b-Q3_K_L.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q3_K_L.gguf) | Q3_K_L | 5.132 GB | small, substantial quality loss |
+| [gemma-2-9b-Q4_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_0.gguf) | Q4_0 | 5.443 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [gemma-2-9b-Q4_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_K_S.gguf) | Q4_K_S | 5.479 GB | small, greater quality loss |
+| [gemma-2-9b-Q4_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q4_K_M.gguf) | Q4_K_M | 5.761 GB | medium, balanced quality - recommended |
+| [gemma-2-9b-Q5_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_0.gguf) | Q5_0 | 6.484 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [gemma-2-9b-Q5_K_S.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_K_S.gguf) | Q5_K_S | 6.484 GB | large, low quality loss - recommended |
+| [gemma-2-9b-Q5_K_M.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q5_K_M.gguf) | Q5_K_M | 6.647 GB | large, very low quality loss - recommended |
+| [gemma-2-9b-Q6_K.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q6_K.gguf) | Q6_K | 7.589 GB | very large, extremely low quality loss |
+| [gemma-2-9b-Q8_0.gguf](https://huggingface.co/tensorblock/gemma-2-9b-GGUF/blob/main/gemma-2-9b-Q8_0.gguf) | Q8_0 | 9.827 GB | very large, extremely low quality loss - not recommended |
 
 
 ## Downloading instruction

gemma-2-9b-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6af6d1a8a93de3f6361af9ff8bfd8eb063d85539b9c6762ff23ffeec7f83d5af
-size 3805397376
+oid sha256:a0f0f62ff0b6cd8f2af7763f6035d3af9b7d5999f13a29bd49cbcb6e264669b1
+size 3805397280

gemma-2-9b-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5620d6a07c5797eca9b82ff231a8136be2f8b37bef4973e972053517988bcbed
-size 5132452224
+oid sha256:7cb628776cb02bb5cfa80d60fe8b6543d3656e38d80edc6f670cbcca007b3334
+size 5132452128

gemma-2-9b-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c07669932686f109abccbe89c740a52b4eaee1e7c59e44ca9c87069aac05bf5
-size 4761780608
+oid sha256:6d8639bdf1db18d7ccf9b6e6a78806dd839bbed5b84bdb6b6d8906b8ca1f29fa
+size 4761780512

gemma-2-9b-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b50703e49fce96d8dd39c735e51acd36946a0be8161ab4c5b89c6865fda9e0b2
-size 4337664384
+oid sha256:5484c2b6db099e00fa5d682841080772e7c1716de6b0a5b442e1f252c979a6d5
+size 4337664288

gemma-2-9b-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b2d98335b9b0003db0ceac3eb94ff69b8787abda1aea5367b60430574bf5ff32
-size 5443142016
+oid sha256:a7727d251eb83f63988e5dc7c5d61494b7f325cae37eb7fa6e5017b2ae7febf7
+size 5443141920

gemma-2-9b-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2b609d854cba451805e8e74e6c8e6a72f26dcc1e1c6deda72d4a1207a83dfcc8
-size 5761057152
+oid sha256:d2ce0f5b179ad209d0f7461d15a81bd1db975b452247290da5e72508128f8139
+size 5761057056

gemma-2-9b-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e587eba863465183e14b5f05f755b7457973b722b1d5fbf51071e3117c4f7b6
-size 5478924672
+oid sha256:4440de062603ee96e5bec7ae46b68edacbb08b62f897bf7ef9c3168e544c5a82
+size 5478924576

gemma-2-9b-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:683109a1123a175da4500ebcdc4ff29ed68b1ab60ad25c2cbd5077aaadf199b8
-size 6483591552
+oid sha256:ad2438dd6236528aa9e6da099e380dab20b806432625c53a5728e80725dac2f8
+size 6483591456

gemma-2-9b-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c79ee86231c3c6997692b789fdabf4a77f813c87c30d5c46766a6bdc05c85940
-size 6647366016
+oid sha256:5d43c0777c38d6eb835c26c14aeda656df2c9ad31d6a6255f3f479520b0d4535
+size 6647365920

gemma-2-9b-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:decfe2431ad3996aa7cb574cf83337bfef7c1f733ad8a578affae664b3fa1051
-size 6483591552
+oid sha256:8c166542809a3d054b9632b8d2f770006da574c699c03f0ba64519c42cf37a86
+size 6483591456

gemma-2-9b-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:122ec01c79d2288a849b9b0e6f10019ff75c070d97067a41af3475839b841379
-size 7589069184
+oid sha256:67a8fd5eb1507eb966b33905c145e8f3b9bfea9dad0cdeedad3e07d37892070a
+size 7589069088

gemma-2-9b-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:417157e97f370b176f6c7c092ef7e664acdbc574debad851c2c02e008d4b6afd
-size 9827148160
+oid sha256:93f7d9c9143fabe4ba1f9811cfa39ace3c889956bda6e4ace2115fe4646fee32
+size 9827148064