matrixportalx
/

layerskip-llama3.2-1B-GGUF

Text Generation

Model card Files Files and versions

layerskip-llama3.2-1B-GGUF

12.5 GB

1 contributor

History: 26 commits

Matrix

Update README.md

fc441f7 verified 8 months ago

.gitattributes

2.42 kB

Upload layerskip-llama3.2-1b.f16.gguf with huggingface_hub 8 months ago
README.md

2.8 kB

Update README.md 8 months ago
layerskip-llama3.2-1b.f16.gguf

2.48 GB
xet

Upload layerskip-llama3.2-1b.f16.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q2_k.gguf

581 MB
xet

Upload layerskip-llama3.2-1b.q2_k.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q3_k_l.gguf

733 MB
xet

Upload layerskip-llama3.2-1b.q3_k_l.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q3_k_m.gguf

691 MB
xet

Upload layerskip-llama3.2-1b.q3_k_m.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q3_k_s.gguf

642 MB
xet

Upload layerskip-llama3.2-1b.q3_k_s.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q4_0.gguf

771 MB
xet

Upload layerskip-llama3.2-1b.q4_0.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q4_k_m.gguf

808 MB
xet

Upload layerskip-llama3.2-1b.q4_k_m.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q4_k_s.gguf

776 MB
xet

Upload layerskip-llama3.2-1b.q4_k_s.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q5_0.gguf

893 MB
xet

Upload layerskip-llama3.2-1b.q5_0.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q5_k_m.gguf

911 MB
xet

Upload layerskip-llama3.2-1b.q5_k_m.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q5_k_s.gguf

893 MB
xet

Upload layerskip-llama3.2-1b.q5_k_s.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q6_k.gguf

1.02 GB
xet

Upload layerskip-llama3.2-1b.q6_k.gguf with huggingface_hub 8 months ago
layerskip-llama3.2-1b.q8_0.gguf

1.32 GB
xet

Upload layerskip-llama3.2-1b.q8_0.gguf with huggingface_hub 8 months ago