Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
llama3-13.45b-Instruct-GGUF
like
0
Text Generation
Transformers
GGUF
PyTorch
English
llama
llama-3
mergekit
Merge
imatrix
conversational
License:
llama3
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
llama3-13.45b-Instruct-GGUF
175 GB
1 contributor
History:
2 commits
bartowski
Llamacpp quants
992bb30
verified
over 1 year ago
llama3-13.45b-Instruct-f32.gguf
Llamacpp quants
over 1 year ago
.gitattributes
Safe
3.02 kB
Llamacpp quants
over 1 year ago
README.md
Safe
7.37 kB
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ2_M.gguf
4.71 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ2_S.gguf
4.38 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ2_XS.gguf
4.15 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ3_M.gguf
6.13 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ3_XS.gguf
Safe
5.66 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ3_XXS.gguf
5.29 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-IQ4_XS.gguf
7.25 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q2_K.gguf
5.11 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q3_K_L.gguf
7.07 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q3_K_M.gguf
6.53 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q3_K_S.gguf
5.91 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q4_K_M.gguf
8.06 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q4_K_S.gguf
7.66 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q5_K_M.gguf
9.43 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q5_K_S.gguf
9.2 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q6_K.gguf
10.9 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct-Q8_0.gguf
14.1 GB
xet
Llamacpp quants
over 1 year ago
llama3-13.45b-Instruct.imatrix
8.73 MB
xet
Llamacpp quants
over 1 year ago
