Inference Providers
Active filters: 5bit
legraphista/DeepSeek-Coder-V2-Lite-Base-IMat-GGUF
Text Generation
• 16B • Updated • 483
• 2
legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF
Text Generation
• 236B • Updated • 204
• 6
legraphista/glm-4-9b-chat-IMat-GGUF
Text Generation
• 9B • Updated • 1.43k
• 5
legraphista/glm-4-9b-chat-GGUF
Text Generation
• 9B • Updated • 11.3k
• 21
legraphista/glm-4-9b-chat-1m-GGUF
Text Generation
• 9B • Updated • 4.33k
• 18
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 280
• 3
legraphista/RoGemma-7b-Instruct-IMat-GGUF
Text Generation
• 9B • Updated • 217
legraphista/Llama-3-Instruct-8B-SPPO-Iter3-IMat-GGUF
Text Generation
• 8B • Updated • 598
legraphista/Yi-9B-Coder-IMat-GGUF
Text Generation
• 9B • Updated • 297
legraphista/gemma-2-9b-it-IMat-GGUF
Text Generation
• 9B • Updated • 561
• 2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
• 27B • Updated • 692
• 20
legraphista/llm-compiler-7b-IMat-GGUF
Text Generation
• 7B • Updated • 1.95k
legraphista/llm-compiler-7b-ftd-IMat-GGUF
Text Generation
• 7B • Updated • 524
• 2
legraphista/llm-compiler-13b-IMat-GGUF
Text Generation
• 13B • Updated • 368
• 3
legraphista/llm-compiler-13b-ftd-IMat-GGUF
Text Generation
• 13B • Updated • 338
legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF
Text Generation
• 9B • Updated • 934
• 4
legraphista/Phi-3-mini-4k-instruct-update2024_07_03-IMat-GGUF
Text Generation
• 4B • Updated • 182
legraphista/internlm2_5-7b-chat-IMat-GGUF
Text Generation
• 8B • Updated • 2.75k
legraphista/internlm2_5-7b-chat-1m-IMat-GGUF
Text Generation
• 8B • Updated • 158
• 1
legraphista/codegeex4-all-9b-IMat-GGUF
Text Generation
• 9B • Updated • 5.15k
• 8
legraphista/NuminaMath-7B-TIR-IMat-GGUF
Text Generation
• 7B • Updated • 199
• 1
legraphista/mathstral-7B-v0.1-IMat-GGUF
Text Generation
• 7B • Updated • 192
legraphista/Athene-70B-IMat-GGUF
Text Generation
• 71B • Updated • 389
• 3
legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF
Text Generation
• 12B • Updated • 226
• 2
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 312
• 6
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
• 71B • Updated • 306
• 11
legraphista/Llama-Guard-3-8B-IMat-GGUF
Text Generation
• 8B • Updated • 578
• 5
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
• 123B • Updated • 252
• 29
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF
Text Generation
• 8B • Updated • 311
• 1
legraphista/gemma-2-2b-it-IMat-GGUF
Text Generation
• 3B • Updated • 279
• 2