Text Generation
MLX
Safetensors
GGUF
mixtral
35b
android
apple-silicon
attested
chain-of-custody
consumer-gpu
cryptographically-verified
edge-inference
efficient
english
expert-pruning
forge-alloy
general
instruct
llama-cpp
lm-studio
local-inference
macbook
mixture-of-experts
mobile
Mixture of Experts
moe-compaction
multilingual
ollama
on-device
optimized
pruned
q4_k_m
quantized
raspberry-pi
reproducible
sparse-moe
versatile
calibration-aware-pruning
conversational
Upload mixtral-8x7b-compacted-Q4_K_M.gguf with huggingface_hub
Browse files- .gitattributes +1 -0
- mixtral-8x7b-compacted-Q4_K_M.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
mixtral-8x7b-compacted-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
mixtral-8x7b-compacted-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb88f0ac059a807ed19c52dd19f0eb0bdad62c6bb27c1bfd625882bddf07d680
|
| 3 |
+
size 21437163872
|