-
-
-
-
-
-
Inference Providers
Active filters:
4bit
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
2
•
2
A2H0H0R1/Qwen-7B-Chat-Int4-Qlora-biology
Text Generation
•
Updated
•
2
kingabzpro/phi-2-role-play
Text Generation
•
Updated
•
5
ecastera/eva-mistral-7b-spanish-GGUF
7B
•
Updated
•
52
•
9
BioMistral/BioMistral-7B-BnB.4
Text Generation
•
7B
•
Updated
•
25
•
1
ProphetOfBostrom/opus-v1-34b-4b8h-8192l-EXL2
Text Generation
•
Updated
•
2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-4bit
Text Generation
•
7B
•
Updated
•
22
•
1
alokabhishek/Llama-2-7b-chat-hf-bnb-4bit
Text Generation
•
7B
•
Updated
•
6
•
2
alokabhishek/falcon-7b-instruct-bnb-4bit
Text Generation
•
7B
•
Updated
•
19
•
1
alokabhishek/Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
16
•
2
kingabzpro/gemma-7b-it-v2-role-play
Text Generation
•
Updated
kingabzpro/gemma-7b-it-v1-role-play
Text Generation
•
Updated
alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ
Text Generation
•
7B
•
Updated
•
3
•
1
alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ
Text Generation
•
7B
•
Updated
•
3
•
1
alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2
Text Generation
•
Updated
•
3
•
1
alokabhishek/Llama-2-7b-chat-hf-4.0-bpw-exl2
Text Generation
•
Updated
•
6
•
1
alokabhishek/gemma-7b-it-GGUF
Text Generation
•
9B
•
Updated
•
30
•
1
alokabhishek/gemma-1.1-7b-it-GGUF
Text Generation
•
9B
•
Updated
•
64
•
1
Labagaite/gemma-Summarizer-2b-it-bnb-4bit
Text Generation
•
3B
•
Updated
Labagaite/mistral-Summarizer-7b-instruct-v0.2-bnb-4bit
Text Generation
•
7B
•
Updated
Labagaite/llama-Summarizer-2-7b-chat-bnb-4bit
Text Generation
•
7B
•
Updated
•
2
tgey/neuredia_neuropsys_mistral_7B_4bit
Text Generation
•
4B
•
Updated
•
1
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-4bit
Text Generation
•
8B
•
Updated
•
4
•
1
alokabhishek/Meta-Llama-3-8B-Instruct-4.0-bpw-exl2
Text Generation
•
Updated
•
2
•
1
Text Generation
•
5B
•
Updated
•
1
cropinailab/aksara_v1_GGUF
Text Generation
•
7B
•
Updated
•
4
•
1
legraphista/Yuan2-M32-hf-IMat-GGUF
Text Generation
•
40B
•
Updated
•
411
•
3
legraphista/K2-Chat-IMat-GGUF
Text Generation
•
65B
•
Updated
•
129
•
5
Text Generation
•
65B
•
Updated
•
259
•
3
legraphista/neo_7b_instruct_v0.1-IMat-GGUF
Text Generation
•
8B
•
Updated
•
152