Severian
/

Jamba-Bagel-GGUF

Model card Files Files and versions

Q6_K Version of the Jamba-Bagel fine-tune: https://huggingface.co/jondurbin/bagel-jamba-v05

(Q4_K_M and Q8 are in the works, just takes a bit to upload)

Can only be used with this fork until the merge is complete: https://github.com/ggerganov/llama.cpp/pull/7531

Downloads last month: 54

GGUF

Model size

52B params

Architecture

jamba

Hardware compatibility

Log In to add your hardware

6-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Severian/Jamba-Bagel-GGUF

Jamba GGUF

Current GGUF's conversion of the Jamba models. Will be updated as support in llama.cpp merges/ https://github.com/ggerganov/llama.cpp/pull/7531 • 4 items • Updated May 30, 2024 • 2