morriszms commited on
Commit
39ea74a
·
verified ·
1 Parent(s): 47d9c44

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
  - conversational
12
  - TensorBlock
13
  - GGUF
14
- base_model: Efficient-Large-Model/gemma-2-2b-it
15
  ---
16
 
17
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -25,11 +25,11 @@ base_model: Efficient-Large-Model/gemma-2-2b-it
25
  </div>
26
  </div>
27
 
28
- ## Efficient-Large-Model/gemma-2-2b-it - GGUF
29
 
30
- This repo contains GGUF format model files for [Efficient-Large-Model/gemma-2-2b-it](https://huggingface.co/Efficient-Large-Model/gemma-2-2b-it).
31
 
32
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
33
 
34
  <div style="text-align: left; margin: 20px 0;">
35
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
11
  - conversational
12
  - TensorBlock
13
  - GGUF
14
+ base_model: google/gemma-2-2b-it
15
  ---
16
 
17
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
25
  </div>
26
  </div>
27
 
28
+ ## google/gemma-2-2b-it - GGUF
29
 
30
+ This repo contains GGUF format model files for [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it).
31
 
32
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
33
 
34
  <div style="text-align: left; margin: 20px 0;">
35
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
gemma-2-2b-it-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2002817cdd8346ba4feda365863815f424dde96389700dc2e6ed41868e0f46f9
3
- size 1229830016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2714aa841a1a32542017b8a582d9f07fc1d7a9da3b8438e373e45c089eeaef5
3
+ size 1229829984
gemma-2-2b-it-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:550c1354fd0af665321812e4e82c15b15d439d7dec5756e3845a6a210501feef
3
- size 1550436224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02e11b439180acd20b1d6370812f2a07dc8e18430639027f919aa2ef67fd0ff5
3
+ size 1550436192
gemma-2-2b-it-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2517f3cba5e021c22ada5b696b6a1d0c90953b6717eab30954a1a60bfbd3275
3
- size 1461667712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73592fd5d24535d9c05c8344dac981a9d09bf653816730308ce322d95e2409b3
3
+ size 1461667680
gemma-2-2b-it-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69113758ea177ea81030da13fcdd5767d349a526da7d7ebf52f7e72e1f51ef79
3
- size 1360660352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aaff938c9532331a368c8b9c4c0f3eb32c6bbe899590b27a65c6b19e2f967aec
3
+ size 1360660320
gemma-2-2b-it-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2268d3e5e054834e8e62ff07eedb02d8a4443b7f1fada2fa7f83454479f8df13
3
- size 1629509504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f007089cd416d664f5b3817289db4688e80e810c0011fd0865aca4aabb6044b3
3
+ size 1629509472
gemma-2-2b-it-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16dd8d04db92270211d0799896abd41da60456e5b8091bce7b587916b56492f7
3
- size 1708582784
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:120dcc1f51acaf22ba07e3afd5b1bb4521922a4a73273f7d0a66959c5769f5c2
3
+ size 1708582752
gemma-2-2b-it-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:886718b528e92bc59d3a5b805da67a6956563aa3d8f5625d70fa0bfb6d44ae5b
3
- size 1638651776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f3f2a33af2faab598d3b65dc6dedda854f377d1f6e806dc8ade8731bda90b20
3
+ size 1638651744
gemma-2-2b-it-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ea5a0cf4281fd342436384ec2a3caa6b2119d23ffbb1d398b230b66625e16d12
3
- size 1882544000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:573684f640b94ba553723c45430d62f9328fb4ebabebdf427faa49130b3c5267
3
+ size 1882543968
gemma-2-2b-it-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c71404dfa24a5bc66c2996c1e8159c83f74df5d283a191076fa468fc2adbcf83
3
- size 1923278720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b63948ca4227af6f6d8266701e3c6bcca1ef5827fffce47a0c8337c068ddcd3
3
+ size 1923278688
gemma-2-2b-it-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a21c26f34bfa1dc7207009835cc647f5ba01f5b0c04c48efd0c943da38a83aa
3
- size 1882544000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08e7e3af16eceb1e54ebc9b28c690dca429bcd3205e0375b82bf434bb621d62f
3
+ size 1882543968
gemma-2-2b-it-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:58badc0d874cb1d80147bd8ae1c9837575317e62a45c842adbfb43e95bc81f99
3
- size 2151393152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a533cd2706c86de3fa3e0302794314cdb8470efc61dc597c9b3ce81d7f22bc10
3
+ size 2151393120
gemma-2-2b-it-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:acdfdd9f9908c2922f1236446980846b96cce3f1e5c44d5e49408f617f693a2f
3
- size 2784495488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a503860a2160ba85301e07fdcc63b5f271707350498bc3449f228ccbd0f7205
3
+ size 2784495456