Luth-Instruct-GGUF / Luth-0.6B-Instruct-GGUF

11.4 GB

Ctrl+K

1 contributor

History: 1 commit

prithivMLmods

Upload folder using huggingface_hub

d266dbf verified 8 months ago

Luth-0.6B-Instruct.BF16.gguf

1.2 GB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.F16.gguf

1.2 GB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.F32.gguf

2.39 GB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q2_K.gguf

296 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q3_K_L.gguf

368 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q3_K_M.gguf

347 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q3_K_S.gguf

323 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q4_0.gguf

382 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q4_1.gguf

409 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q4_K.gguf

397 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q4_K_M.gguf

397 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q4_K_S.gguf

383 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q5_0.gguf

437 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q5_1.gguf

464 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q5_K.gguf

444 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q5_K_M.gguf

444 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q5_K_S.gguf

437 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q6_K.gguf

495 MB
xet

Upload folder using huggingface_hub 8 months ago
Luth-0.6B-Instruct.Q8_0.gguf

639 MB
xet

Upload folder using huggingface_hub 8 months ago