101 GB

1 contributor

History: 29 commits

eaddario

Update README.md

43f689a verified about 2 months ago

imatrix
Generate imatrix 2 months ago
logits
Generate base model logits 2 months ago
scores
Add GGUF internal file structure 2 months ago
.gitattributes
1.64 kB

Update .gitattributes 2 months ago
.gitignore
6.78 kB

Add .gitignore 2 months ago
Olmo-3-7B-Instruct-F16.gguf
14.6 GB
xet

Convert safetensor to GGUF @ F16 2 months ago
Olmo-3-7B-Instruct-IQ1_L.gguf
1.6 GB
xet

Target 1.75 bpw quantization (IQ1_L) 2 months ago
Olmo-3-7B-Instruct-IQ2_S.gguf
2.06 GB
xet

Target 2.25 bpw quantization (IQ2_S) 2 months ago
Olmo-3-7B-Instruct-IQ2_XS.gguf
1.94 GB
xet

Target 2.125 bpw quantization (IQ2_XS) 2 months ago
Olmo-3-7B-Instruct-IQ2_XXS.gguf
1.83 GB
xet

Target 2.00 bpw quantization (IQ2_XXS) 2 months ago
Olmo-3-7B-Instruct-IQ3_XXS.gguf
2.74 GB
xet

Target 3.00 bpw quantization (IQ3_XXS) 2 months ago
Olmo-3-7B-Instruct-Q2_K.gguf
2.28 GB
xet

Target 2.50 bpw quantization (Q2_K) 2 months ago
Olmo-3-7B-Instruct-Q3_K.gguf
3.2 GB
xet

Target 3.50 bpw quantization (Q3_K) 2 months ago
Olmo-3-7B-Instruct-Q3_K_L.gguf
3.42 GB
xet

Target 3.75 bpw quantization (Q3_K_L) 2 months ago
Olmo-3-7B-Instruct-Q3_K_S.gguf
2.97 GB
xet

Target 3.25 bpw quantization (Q3_K_S) 2 months ago
Olmo-3-7B-Instruct-Q4_K.gguf
4.11 GB
xet

Target 4.50 bpw quantization (Q4_K) 2 months ago
Olmo-3-7B-Instruct-Q4_K_M-bpw.gguf
4.47 GB
xet

Target bpw equivalent to standard Q4_K_M 2 months ago
Olmo-3-7B-Instruct-Q4_K_S.gguf
3.88 GB
xet

Target 4.25 bpw quantization (Q4_K_S) 2 months ago
Olmo-3-7B-Instruct-Q5_K.gguf
5.02 GB
xet

Target 5.50 bpw quantization (Q5_K) 2 months ago
Olmo-3-7B-Instruct-Q5_K_S.gguf
4.79 GB
xet

Target 5.25 bpw quantization (Q5_K_S) 2 months ago
Olmo-3-7B-Instruct-Q6_K.gguf
5.93 GB
xet

Target 6.50 bpw quantization (Q6_K) 2 months ago
Olmo-3-7B-Instruct-Q8_0.gguf
7.76 GB
xet

Target 8.50 bpw quantization (Q8_0) 2 months ago
Olmo_3_7B_Instruct-9ae8fd725171c639.bpw_state
70.9 kB
xet

Generate BPW computation checkpoint 2 months ago
README.md
24.3 kB

Update README.md about 2 months ago