Inference Providers
Active filters: 4-bit
TheBloke/SynthIA-7B-v2.0-GPTQ
Text Generation
• 7B • Updated • 5
• 1
TheBloke/SynthIA-7B-v2.0-AWQ
Text Generation
• 7B • Updated • 7
q-allen/Taiwan-LLaMa-v1.0-4bits-GPTQ
Text Generation
• Updated • 8
• 1
jackkira/fb-opt-125m-gptq-4bit
Text Generation
• Updated • 5
deuswoof/adapter_ingredients_ivan
Updated • 28
MaxZabarka/classifier-7b-v9
Text Generation
• Updated • 5
codegood/Mistral_new_data
codegood/Mistral_model_old_data
heka-ai/mistral-test-GPTQ
Text Generation
• Updated • 5
ybelkada/test-mistral-7b-v0.1-awq
Text Generation
• 7B • Updated • 4
TheBloke/HornyEchidna-13B-v0.1-GPTQ
Text Generation
• 13B • Updated • 66
• 12
TheBloke/HornyEchidna-13B-v0.1-AWQ
Text Generation
• 13B • Updated • 5
• 3
TheBloke/Vigostral-7B-Chat-AWQ
Text Generation
• 7B • Updated • 8
• 1
TheBloke/Vigostral-7B-Chat-GPTQ
Text Generation
• 7B • Updated • 7
• 3
TheBloke/Augmental-13B-AWQ
Text Generation
• 13B • Updated • 5
• 1
TheBloke/Augmental-13B-GPTQ
Text Generation
• 13B • Updated • 19
• 6
TRAC-MTRY/traclm-v2-7b-instruct-GPTQ
Text Generation
• 7B • Updated TheBloke/Dolphin-2.1-70B-GPTQ
Text Generation
• 69B • Updated • 5
• 7
TheBloke/Dolphin-2.1-70B-AWQ
Text Generation
• 69B • Updated • 5
• 4
TKDKid1000/pythia-2.8b-deduped-GPTQ
Text Generation
• Updated • 7
Text Generation
• 13B • Updated • 7
• 1
TheBloke/Cat-13B-0.5-GPTQ
Text Generation
• 13B • Updated • 8
• 1
Text Generation
• 69B • Updated • 388
• 2
Text Generation
• 69B • Updated • 7
• 9
TheBloke/SynthIA-70B-v1.5-AWQ
Text Generation
• 69B • Updated • 1.59k
• 2
TheBloke/SynthIA-70B-v1.5-GPTQ
Text Generation
• 69B • Updated • 5
• 4
Plaban81/codegen-int4-GPTQ-python-code
Text Generation
• Updated • 7
Text Generation
• Updated • 8