prithivMLmods
/

Olmo-3-7B-Instruct-AIO-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions

Olmo-3-7B-Instruct-AIO-GGUF

194 GB

1 contributor

History: 8 commits

prithivMLmods's picture

Update README.md

3192591 verified 3 months ago

.gitattributes
4.24 kB

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.BF16.gguf
14.6 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.F16.gguf
14.6 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.F32.gguf
29.2 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.IQ4_XS.gguf
4.03 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q2_K.gguf
2.86 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q3_K_L.gguf
3.95 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q3_K_M.gguf
3.65 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q3_K_S.gguf
3.3 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q4_K_M.gguf
4.47 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q4_K_S.gguf
4.25 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q5_K_M.gguf
5.21 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q5_K_S.gguf
5.08 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q6_K.gguf
5.99 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.Q8_0.gguf
7.76 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ1_M.gguf
1.94 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ1_S.gguf
1.82 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ2_M.gguf
2.68 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ2_S.gguf
2.51 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ2_XS.gguf
2.32 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ2_XXS.gguf
2.14 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ3_M.gguf
3.47 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ3_S.gguf
3.3 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ3_XS.gguf
3.15 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ3_XXS.gguf
2.9 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ4_NL.gguf
4.22 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-IQ4_XS.gguf
4 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q2_K.gguf
2.86 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q2_K_S.gguf
2.64 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q3_K_L.gguf
3.95 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q3_K_M.gguf
3.65 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q3_K_S.gguf
3.3 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q4_0.gguf
4.23 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q4_1.gguf
4.65 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q4_K_M.gguf
4.47 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q4_K_S.gguf
4.25 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q5_K_M.gguf
5.21 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q5_K_S.gguf
5.08 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.i1-Q6_K.gguf
5.99 GB
xet

Upload folder using huggingface_hub 3 months ago
Olmo-3-7B-Instruct.imatrix.gguf
4.59 MB
xet

Upload folder using huggingface_hub 3 months ago
README.md
8.53 kB

Update README.md 3 months ago
config.json
30 Bytes

Upload folder using huggingface_hub 3 months ago