Sujan42024/dlite-v2-355m-bi4tQuantization
Text Generation • 0.4B • Updated • 5
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
48,307
Active filters: 4-bit
TheBloke/psyonic-cetacean-20B-AWQ
Text Generation • 20B • Updated • 5
Ferrxni/finetuned_gw_mistral_GPTQ
Updated • 3
TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-GPTQ
Text Generation • 11B • Updated • 18 • 1
TheBloke/psyonic-cetacean-20B-GPTQ
Text Generation • 20B • Updated • 5
TheBloke/SauerkrautLM-7B-HerO-GPTQ
Text Generation • 7B • Updated • 27 • 1
TheBloke/tigerbot-70B-chat-v2-AWQ
Text Generation • 69B • Updated • 11 • 2
TheBloke/deepseek-llm-67b-chat-AWQ
Text Generation • 67B • Updated • 136 • 5
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation • 67B • Updated • 8 • 8
NobodyExistsOnTheInternet/mistral-7b-airoboros-chatml
Updated • 5
TheBloke/Iambe-20B-DARE-AWQ
Text Generation • 20B • Updated • 7 • 1
TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ
Text Generation • 3B • Updated • 8 • 1
vachonni/falcon-1b-tech-level-fr
Text Generation • Updated • 6
TheBloke/deepseek-llm-7B-base-AWQ
Text Generation • 7B • Updated • 80 • 2
TheBloke/deepseek-llm-67b-base-AWQ
Text Generation • 67B • Updated • 17 • 2
TheBloke/deepseek-llm-67b-base-GPTQ
Text Generation • 67B • Updated • 7 • 1
TheBloke/deepseek-llm-7B-chat-AWQ
Text Generation • 7B • Updated • 155 • 3
TheBloke/LLaMA2-13B-Psyfighter2-AWQ
Text Generation • 13B • Updated • 10 • 4
TheBloke/Iambe-20B-DARE-GPTQ
Text Generation • 20B • Updated • 5 • 1
TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ
Text Generation • 7B • Updated • 72 • 7
TheBloke/deepseek-llm-7B-base-GPTQ
Text Generation • 7B • Updated • 203 • 2
TheBloke/deepseek-llm-7B-chat-GPTQ
Text Generation • 7B • Updated • 29 • 1
TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GPTQ
Text Generation • 3B • Updated • 9 • 2
TheBloke/LLaMA2-13B-Psyfighter2-GPTQ
Text Generation • 13B • Updated • 172 • 17
TheBloke/NeuralHermes-2.5-Mistral-7B-GPTQ
Text Generation • 7B • Updated • 19 • 8
TheBloke/SG-Raccoon-Yi-55B-GPTQ
Text Generation • 56B • Updated • 5 • 1
TheBloke/SG-Raccoon-Yi-55B-AWQ
Text Generation • 56B • Updated • 6 • 2
Qwen/Qwen-1_8B-Chat-Int4
Text Generation • 2B • Updated • 287 • 36
Qwen/Qwen-72B-Chat-Int4
Text Generation • 72B • Updated • 136 • 47
TheBloke/tigerbot-70B-chat-v2-GPTQ
Text Generation • 69B • Updated • 10 • 5