morriszms commited on
Commit
b0a063d
·
verified ·
1 Parent(s): 67f5d2c

Upload folder using huggingface_hub

Browse files
Phi-3-mini-128k-instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a5fecdbb19988ab2456b898ab04bd19906110c43ffb59e789a4b63bafb408fb
3
  size 1416204256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96a76c02b18b364fa4808d16de71fb9367386812029870a7ebb70a61041e8a05
3
  size 1416204256
Phi-3-mini-128k-instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:87d08143cb019299ff9652924527600e0af2dcea38d35b331a61cfd37df83ffb
3
  size 2087597536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6cf5b954a5abb33da2958738b8ae932c1da87e0bbdd78b40b538fb57f48cec9
3
  size 2087597536
Phi-3-mini-128k-instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:30c316a2b2284dd0ac5d275567d6aadbd43aee200aa67e43bc638e2ce591d613
3
  size 1955476960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0d322ba0c8ac3a81c8c66e1c098e96a6fec89574c3ee7d71dedfd70e3f580a6
3
  size 1955476960
Phi-3-mini-128k-instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:000df1ee88099632f4ee8acedc77e70b9eaae9c00b35b3176f1a2d2ed9d74ebe
3
  size 1681798624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b98e9797522eea8e29486c70eb4f4efeabbf53adb6884e83ca0c252f3418d96c
3
  size 1681798624
Phi-3-mini-128k-instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12b22d53df9978c912b0f4d12f85018eb81e7676feb8dc407d23d4b44dbc2f9c
3
  size 2176177120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2483118411df0bc67f5a9360ff0c0f38c64649746694d4b9c2214fd8e94c2ec0
3
  size 2176177120
Phi-3-mini-128k-instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2419a1155ff0023750b02cba407039cdef2543d2fac880fade6e610eb0d4e1c9
3
  size 2393232352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70c8654ad277dec459e254577780b91584020f5868ace6434d530afbf40a7e41
3
  size 2393232352
Phi-3-mini-128k-instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1c28352ebdb5a74f51632c9b69cbb116e917fe9cad8741df48e0de0f839f62ad
3
  size 2188760032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7cd4f161cf2c021bf69521ca483e9cdd43a5f56765e60850c9c72f04a46e519
3
  size 2188760032
Phi-3-mini-128k-instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f47a9cf56b6e47c0050da579c3c7ce5707e39a7d410dc6b6869854e91dff66e2
3
  size 2641474528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:396304571d578d38f03b023ed059ab7ee08199b9948e2b37f2dc4b2af463b202
3
  size 2641474528
Phi-3-mini-128k-instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:39368cfe6bb1c69980bc9e3bb840e74ffcff5dc9b52e21f1d0c39288bacf64f3
3
  size 2815276000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45b512cfaacef262ea01496686c6061aae37f03c4f2f9b20cdf997e3fa7cc1e9
3
  size 2815276000
Phi-3-mini-128k-instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:76b9f359e5bd09eb38b13c3b8d27364b0ce034a943372c573d3e676aaed374bb
3
  size 2641474528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0152262470e0fa88d74a3913a34decd245637de4812f52141b613411b512ddf0
3
  size 2641474528
Phi-3-mini-128k-instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a44dfac8604326d101b66d7d1b1e334d477ad779a68cd8d3987e41c50565e3e1
3
  size 3135853024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8be0ddd62144fb06dc85ba2b9198a4ff656ff393fb217955111b8499262cea35
3
  size 3135853024
Phi-3-mini-128k-instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:016e6d948d989eb38cae5b1d730df02935606d6c568d71fe5cee3b03dbdc6338
3
  size 4061222368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27c9460150837b7ccdd7ac8d843a234af8522d10dd355f2b3ed62f8bcb9cd463
3
  size 4061222368
README.md CHANGED
@@ -13,7 +13,7 @@ widget:
13
  - messages:
14
  - role: user
15
  content: Can you provide ways to eat combinations of bananas and dragonfruits?
16
- base_model: gretelai/Phi-3-mini-128k-instruct
17
  ---
18
 
19
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -27,11 +27,11 @@ base_model: gretelai/Phi-3-mini-128k-instruct
27
  </div>
28
  </div>
29
 
30
- ## gretelai/Phi-3-mini-128k-instruct - GGUF
31
 
32
- This repo contains GGUF format model files for [gretelai/Phi-3-mini-128k-instruct](https://huggingface.co/gretelai/Phi-3-mini-128k-instruct).
33
 
34
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
35
 
36
  <div style="text-align: left; margin: 20px 0;">
37
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
13
  - messages:
14
  - role: user
15
  content: Can you provide ways to eat combinations of bananas and dragonfruits?
16
+ base_model: microsoft/Phi-3-mini-128k-instruct
17
  ---
18
 
19
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
27
  </div>
28
  </div>
29
 
30
+ ## microsoft/Phi-3-mini-128k-instruct - GGUF
31
 
32
+ This repo contains GGUF format model files for [microsoft/Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct).
33
 
34
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
35
 
36
  <div style="text-align: left; margin: 20px 0;">
37
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">