-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
Sujan42024/dlite-v2-355m-bi4tQuantization
Text Generation
• 0.4B • Updated
• 1
TheBloke/psyonic-cetacean-20B-AWQ
Text Generation
• 20B • Updated
• 5
Ferrxni/finetuned_gw_mistral_GPTQ
Updated
TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-GPTQ
Text Generation
• 11B • Updated
• 2
• 1
TheBloke/psyonic-cetacean-20B-GPTQ
Text Generation
• 20B • Updated
TheBloke/SauerkrautLM-7B-HerO-GPTQ
Text Generation
• 7B • Updated
• 8
• 1
TheBloke/tigerbot-70B-chat-v2-AWQ
Text Generation
• 69B • Updated
• 2
TheBloke/deepseek-llm-67b-chat-AWQ
Text Generation
• 67B • Updated
• 251
• 5
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation
• 67B • Updated
• 9
• 8
NobodyExistsOnTheInternet/mistral-7b-airoboros-chatml
TheBloke/Iambe-20B-DARE-AWQ
Text Generation
• 20B • Updated
• 3
• 1
TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ
Text Generation
• 3B • Updated
• 161
• 1
vachonni/falcon-1b-tech-level-fr
Text Generation
• Updated
TheBloke/deepseek-llm-7B-base-AWQ
Text Generation
• 7B • Updated
• 9
• 2
TheBloke/deepseek-llm-67b-base-AWQ
Text Generation
• 67B • Updated
• 14
• 2
TheBloke/deepseek-llm-67b-base-GPTQ
Text Generation
• 67B • Updated
• 12
• 1
TheBloke/deepseek-llm-7B-chat-AWQ
Text Generation
• 7B • Updated
• 223
• 3
TheBloke/LLaMA2-13B-Psyfighter2-AWQ
Text Generation
• 13B • Updated
• 20
• 4
TheBloke/Iambe-20B-DARE-GPTQ
Text Generation
• 20B • Updated
• 5
• 1
TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ
Text Generation
• 7B • Updated
• 11
• 7
TheBloke/deepseek-llm-7B-base-GPTQ
Text Generation
• 7B • Updated
• 8
• 2
TheBloke/deepseek-llm-7B-chat-GPTQ
Text Generation
• 7B • Updated
• 21
• 1
TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GPTQ
Text Generation
• 3B • Updated
• 8
• 2
TheBloke/LLaMA2-13B-Psyfighter2-GPTQ
Text Generation
• 13B • Updated
• 7
• 16
TheBloke/NeuralHermes-2.5-Mistral-7B-GPTQ
Text Generation
• 7B • Updated
• 11
• 8
TheBloke/SG-Raccoon-Yi-55B-GPTQ
Text Generation
• 56B • Updated
• 1
TheBloke/SG-Raccoon-Yi-55B-AWQ
Text Generation
• 56B • Updated
• 2
Text Generation
• Updated
• 451
• 36
Text Generation
• 72B • Updated
• 335
• 47
TheBloke/tigerbot-70B-chat-v2-GPTQ
Text Generation
• 69B • Updated
• 1
• 5