Hugging Face's logo

tensorblock
/
Llama-3.1-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
TensorBlock
GGUF
conversational
Model card Files
xet
Community
morriszms commited on
Commit
bd21288
·
verified ·
1 Parent(s): a36e982

Keep Q2_K/Q3_K_M gguf only

Browse files
Files changed (13) hide show
  1. Llama-3.1-70B-Instruct-Q3_K_L.gguf +0 -3
  2. Llama-3.1-70B-Instruct-Q3_K_S.gguf +0 -3
  3. Llama-3.1-70B-Instruct-Q4_0.gguf +0 -3
  4. Llama-3.1-70B-Instruct-Q4_K_M.gguf +0 -3
  5. Llama-3.1-70B-Instruct-Q4_K_S.gguf +0 -3
  6. Llama-3.1-70B-Instruct-Q5_0.gguf +0 -3
  7. Llama-3.1-70B-Instruct-Q5_K_M.gguf +0 -3
  8. Llama-3.1-70B-Instruct-Q5_K_S.gguf +0 -3
  9. Llama-3.1-70B-Instruct-Q6_K/Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf +0 -3
  10. Llama-3.1-70B-Instruct-Q6_K/Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf +0 -3
  11. Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00001-of-00003.gguf +0 -3
  12. Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00002-of-00003.gguf +0 -3
  13. Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00003-of-00003.gguf +0 -3
Llama-3.1-70B-Instruct-Q3_K_L.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3049f25e959263a317b8a515c7a52f713dabdf9a25eac7b35c30a32eb95d364
3
- size 37140597376
 
 
 
 
Llama-3.1-70B-Instruct-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:92c5674a601ea808c6548efbe101077dfb2fe6bc6c75ea2016c96c425465e30b
3
- size 30912055936
 
 
 
 
Llama-3.1-70B-Instruct-Q4_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:40bfea107591d0d41d46f604a2381f3ac17f66e79fdb212176a51b44779f7a1d
3
- size 39969737344
 
 
 
 
Llama-3.1-70B-Instruct-Q4_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c7fb8050fb90385586a361285682cb763592d2d0d4ce9ac26fd701d30e0ebd2
3
- size 42520398464
 
 
 
 
Llama-3.1-70B-Instruct-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:cea7fe363999cb128507563f6803f579db7533613e8ea5b5b95dac6c99ad1af0
3
- size 40347224704
 
 
 
 
Llama-3.1-70B-Instruct-Q5_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6d202b53b7f0e1e4761c0561d6fea97fdc1dde5a60bd5a28119ad2eabfd690e
3
- size 48657451648
 
 
 
 
Llama-3.1-70B-Instruct-Q5_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd33df73ed765a5c2c03248ae0217cbd40444f663410c50f8fd899c00c069ca0
3
- size 49949821568
 
 
 
 
Llama-3.1-70B-Instruct-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a738829cd441f9330d18fa20aa9dd1134415735ce75e5d3f8fac838c50891fcc
3
- size 48657451648
 
 
 
 
Llama-3.1-70B-Instruct-Q6_K/Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a14a9d5ff3988474b59dc940fbdd2e427d141876ca4382803c08ae0f35c8aec
3
- size 34847475360
 
 
 
 
Llama-3.1-70B-Instruct-Q6_K/Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:649389c6d9b3c677c27e35b53419e7c07914541411ec69d270a9e8f4b582f6d4
3
- size 23040672928
 
 
 
 
Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00001-of-00003.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac8741354b800231ce34bcd76ae9d5c97f291c65bca0a877db52fa1f6da553a9
3
- size 34980015808
 
 
 
 
Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00002-of-00003.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b8ec6a80a97b14fa20f4695ed5ccd1192f9c1a07abcf80b0669d500035611a9c
3
- size 34949976384
 
 
 
 
Llama-3.1-70B-Instruct-Q8_0/Llama-3.1-70B-Instruct-Q8_0-00003-of-00003.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:1c90f4405c004b6bc65ab275022fe25b7024786b371362828bd95863d64f3604
3
- size 5045062560