-
-
-
-
-
-
Inference Providers
Active filters:
2-bit
Xu-Ouyang/Llama-2-13b-hf-int2-GPTQ-wikitext2
Text Generation
•
13B
•
Updated
•
2
Xu-Ouyang/Qwen2-0.5B-int2-GPTQ-wikitext2
Text Generation
•
0.5B
•
Updated
•
1
Xu-Ouyang/Qwen2-1.5B-int2-GPTQ-wikitext2
Text Generation
•
2B
•
Updated
•
2
Xu-Ouyang/Qwen2-7B-int2-GPTQ-wikitext2
Text Generation
•
8B
•
Updated
•
2
Xu-Ouyang/Llama-3.1-8B-int2-GPTQ-wikitext2
Text Generation
•
8B
•
Updated
DaraV/LLaMA-3.1-8B-Instruct-INT2-GPTQ
8B
•
Updated
BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_2.0bpw_h6
mlx-community/SorcererLM-8x22b-2bit
MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
Text Generation
•
71B
•
Updated
•
35
•
3
MaziyarPanahi/Meraj-Mini-GGUF
Text Generation
•
8B
•
Updated
•
47
•
2
MaziyarPanahi/llama-3.2-Korean-Bllossom-3B-GGUF
Text Generation
•
3B
•
Updated
•
225
•
1
MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF
Text Generation
•
4B
•
Updated
•
301
•
3
MaziyarPanahi/Llama-3.2-3B-Overthinker-GGUF
Text Generation
•
3B
•
Updated
•
11
•
1
MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUF
Text Generation
•
4B
•
Updated
•
359
•
2
MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF
Text Generation
•
8B
•
Updated
•
240
•
2
MaziyarPanahi/Llama3.1-8B-Chinese-Chat-GGUF
Text Generation
•
8B
•
Updated
•
18
•
1
MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF
Text Generation
•
4B
•
Updated
•
111
MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF
Text Generation
•
4B
•
Updated
•
11
MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF
Text Generation
•
4B
•
Updated
•
3
MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF
Text Generation
•
4B
•
Updated
•
33
•
1
MaziyarPanahi/granite-3.0-2b-instruct-GGUF
Text Generation
•
3B
•
Updated
•
16
MaziyarPanahi/granite-3.0-8b-instruct-GGUF
Text Generation
•
8B
•
Updated
•
33
•
1
Xu-Ouyang/Qwen1.5-7B-int2-GPTQ-wikitext2
Text Generation
•
8B
•
Updated
•
1
MatthijsN/Llama-3.1-70B-Instruct-GPTQ-INT2
Updated
MaziyarPanahi/L3-Nymeria-8B-GGUF
Text Generation
•
8B
•
Updated
•
7
•
3
MaziyarPanahi/L3-Nymeria-Maid-8B-GGUF
Text Generation
•
8B
•
Updated
•
10
MaziyarPanahi/L3-Nymeria-v2-8B-GGUF
Text Generation
•
8B
•
Updated
•
5
MaziyarPanahi/L3-Rhaenys-8B-GGUF
Text Generation
•
8B
•
Updated
•
16
MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF
Text Generation
•
8B
•
Updated
•
169
MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF
Text Generation
•
8B
•
Updated
•
45
•
2