Hugging Face's logo

tensorblock
/
codellama-13b-instruct-nf4-fp16-upscaled-GGUF

GGUF
text-generation-inference
TensorBlock
GGUF
Model card Files
xet
 Community
morriszms commited on
Commit
eb5db0e
·
verified ·
1 Parent(s): 27ac503

Keep Q2_K/Q3_K_M gguf only

Browse files
Files changed (10) hide show
  1. codellama-13b-instruct-nf4-fp16-upscaled-Q3_K_L.gguf +0 -3
  2. codellama-13b-instruct-nf4-fp16-upscaled-Q3_K_S.gguf +0 -3
  3. codellama-13b-instruct-nf4-fp16-upscaled-Q4_0.gguf +0 -3
  4. codellama-13b-instruct-nf4-fp16-upscaled-Q4_K_M.gguf +0 -3
  5. codellama-13b-instruct-nf4-fp16-upscaled-Q4_K_S.gguf +0 -3
  6. codellama-13b-instruct-nf4-fp16-upscaled-Q5_0.gguf +0 -3
  7. codellama-13b-instruct-nf4-fp16-upscaled-Q5_K_M.gguf +0 -3
  8. codellama-13b-instruct-nf4-fp16-upscaled-Q5_K_S.gguf +0 -3
  9. codellama-13b-instruct-nf4-fp16-upscaled-Q6_K.gguf +0 -3
  10. codellama-13b-instruct-nf4-fp16-upscaled-Q8_0.gguf +0 -3
codellama-13b-instruct-nf4-fp16-upscaled-Q3_K_L.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9f8828ac40b39434db369241e06cc7e6563cf34cf2085e1e3e921b69ece91694
3
- size 6929662784
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a496a1d4f95bc71537e4026dab7b14d63a0f66046a1b6a05c2615f1bbe4f2e8e
3
- size 5659083584
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q4_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:03142dda4a0895021b49a4c4f1181c1216a56f92d772bad49a1c02c352e0f748
3
- size 7365948864
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q4_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:40f1945d484c1db5814962ee7880eec7e51a3a55cd997f9fe77def3942d475df
3
- size 7866070464
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d901aa90b71c642a8e653fe736239b379408fd0a1aba37fbaa9eee6f15261a1
3
- size 7423292864
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q5_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:87525ab8ffe98dbcf5a4689e163d7e73852c9c567097831a595d99013a616f7b
3
- size 8972410304
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q5_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a9fe35999448e37534e48b056c8005cab28a9ee1741ab3dd8fb213d03f276c7
3
- size 9230048704
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:446333ac7dc74b9af6d8939ddf65e968e11b3074a5a163854a29603715bff99c
3
- size 8972410304
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q6_K.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:48f76d3b556b77850db7abfbdc769db9c795ea753101a4ef9d2c45f120ab2127
3
- size 10679275584
 
 
 
 
codellama-13b-instruct-nf4-fp16-upscaled-Q8_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7cd8b1f52c526ca42bd6c9bfb95b51272fdd15ca60ede9f29c22959d311470ae
3
- size 13831494464