Upload folder using huggingface_hub
Browse files- README.md +4 -4
- gemma-2-2b-it-Q2_K.gguf +2 -2
- gemma-2-2b-it-Q3_K_L.gguf +2 -2
- gemma-2-2b-it-Q3_K_M.gguf +2 -2
- gemma-2-2b-it-Q3_K_S.gguf +2 -2
- gemma-2-2b-it-Q4_0.gguf +2 -2
- gemma-2-2b-it-Q4_K_M.gguf +2 -2
- gemma-2-2b-it-Q4_K_S.gguf +2 -2
- gemma-2-2b-it-Q5_0.gguf +2 -2
- gemma-2-2b-it-Q5_K_M.gguf +2 -2
- gemma-2-2b-it-Q5_K_S.gguf +2 -2
- gemma-2-2b-it-Q6_K.gguf +2 -2
- gemma-2-2b-it-Q8_0.gguf +2 -2
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
- conversational
|
| 12 |
- TensorBlock
|
| 13 |
- GGUF
|
| 14 |
-
base_model:
|
| 15 |
---
|
| 16 |
|
| 17 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
@@ -25,11 +25,11 @@ base_model: Efficient-Large-Model/gemma-2-2b-it
|
|
| 25 |
</div>
|
| 26 |
</div>
|
| 27 |
|
| 28 |
-
##
|
| 29 |
|
| 30 |
-
This repo contains GGUF format model files for [
|
| 31 |
|
| 32 |
-
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit
|
| 33 |
|
| 34 |
<div style="text-align: left; margin: 20px 0;">
|
| 35 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
|
|
|
| 11 |
- conversational
|
| 12 |
- TensorBlock
|
| 13 |
- GGUF
|
| 14 |
+
base_model: google/gemma-2-2b-it
|
| 15 |
---
|
| 16 |
|
| 17 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
|
|
| 25 |
</div>
|
| 26 |
</div>
|
| 27 |
|
| 28 |
+
## google/gemma-2-2b-it - GGUF
|
| 29 |
|
| 30 |
+
This repo contains GGUF format model files for [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it).
|
| 31 |
|
| 32 |
+
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
|
| 33 |
|
| 34 |
<div style="text-align: left; margin: 20px 0;">
|
| 35 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
gemma-2-2b-it-Q2_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2714aa841a1a32542017b8a582d9f07fc1d7a9da3b8438e373e45c089eeaef5
|
| 3 |
+
size 1229829984
|
gemma-2-2b-it-Q3_K_L.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02e11b439180acd20b1d6370812f2a07dc8e18430639027f919aa2ef67fd0ff5
|
| 3 |
+
size 1550436192
|
gemma-2-2b-it-Q3_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:73592fd5d24535d9c05c8344dac981a9d09bf653816730308ce322d95e2409b3
|
| 3 |
+
size 1461667680
|
gemma-2-2b-it-Q3_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aaff938c9532331a368c8b9c4c0f3eb32c6bbe899590b27a65c6b19e2f967aec
|
| 3 |
+
size 1360660320
|
gemma-2-2b-it-Q4_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f007089cd416d664f5b3817289db4688e80e810c0011fd0865aca4aabb6044b3
|
| 3 |
+
size 1629509472
|
gemma-2-2b-it-Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:120dcc1f51acaf22ba07e3afd5b1bb4521922a4a73273f7d0a66959c5769f5c2
|
| 3 |
+
size 1708582752
|
gemma-2-2b-it-Q4_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f3f2a33af2faab598d3b65dc6dedda854f377d1f6e806dc8ade8731bda90b20
|
| 3 |
+
size 1638651744
|
gemma-2-2b-it-Q5_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:573684f640b94ba553723c45430d62f9328fb4ebabebdf427faa49130b3c5267
|
| 3 |
+
size 1882543968
|
gemma-2-2b-it-Q5_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2b63948ca4227af6f6d8266701e3c6bcca1ef5827fffce47a0c8337c068ddcd3
|
| 3 |
+
size 1923278688
|
gemma-2-2b-it-Q5_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:08e7e3af16eceb1e54ebc9b28c690dca429bcd3205e0375b82bf434bb621d62f
|
| 3 |
+
size 1882543968
|
gemma-2-2b-it-Q6_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a533cd2706c86de3fa3e0302794314cdb8470efc61dc597c9b3ce81d7f22bc10
|
| 3 |
+
size 2151393120
|
gemma-2-2b-it-Q8_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a503860a2160ba85301e07fdcc63b5f271707350498bc3449f228ccbd0f7205
|
| 3 |
+
size 2784495456
|