Inference Providers
Active filters: 5bit
legraphista/DeepSeek-Coder-V2-Lite-Base-IMat-GGUF
Text Generation
• 16B • Updated • 402
• 2
legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF
Text Generation
• 236B • Updated • 115
• 6
legraphista/glm-4-9b-chat-IMat-GGUF
Text Generation
• 9B • Updated • 426
• 5
legraphista/glm-4-9b-chat-GGUF
Text Generation
• 9B • Updated • 9.2k
• 21
legraphista/glm-4-9b-chat-1m-GGUF
Text Generation
• 9B • Updated • 3k
• 18
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 297
• 3
legraphista/RoGemma-7b-Instruct-IMat-GGUF
Text Generation
• 9B • Updated • 106
legraphista/Llama-3-Instruct-8B-SPPO-Iter3-IMat-GGUF
Text Generation
• 8B • Updated • 84
legraphista/Yi-9B-Coder-IMat-GGUF
Text Generation
• 9B • Updated • 340
legraphista/gemma-2-9b-it-IMat-GGUF
Text Generation
• 9B • Updated • 433
• 2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
• 27B • Updated • 877
• 20
legraphista/llm-compiler-7b-IMat-GGUF
Text Generation
• 7B • Updated • 1.75k
legraphista/llm-compiler-7b-ftd-IMat-GGUF
Text Generation
• 7B • Updated • 456
• 2
legraphista/llm-compiler-13b-IMat-GGUF
Text Generation
• 13B • Updated • 262
• 3
legraphista/llm-compiler-13b-ftd-IMat-GGUF
Text Generation
• 13B • Updated • 229
legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF
Text Generation
• 9B • Updated • 201
• 4
legraphista/Phi-3-mini-4k-instruct-update2024_07_03-IMat-GGUF
Text Generation
• 4B • Updated • 118
legraphista/internlm2_5-7b-chat-IMat-GGUF
Text Generation
• 8B • Updated • 162
legraphista/internlm2_5-7b-chat-1m-IMat-GGUF
Text Generation
• 8B • Updated • 145
• 1
legraphista/codegeex4-all-9b-IMat-GGUF
Text Generation
• 9B • Updated • 405
• 8
legraphista/NuminaMath-7B-TIR-IMat-GGUF
Text Generation
• 7B • Updated • 79
• 1
legraphista/mathstral-7B-v0.1-IMat-GGUF
Text Generation
• 7B • Updated • 164
legraphista/Athene-70B-IMat-GGUF
Text Generation
• 71B • Updated • 333
• 3
legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF
Text Generation
• 12B • Updated • 120
• 2
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 276
• 6
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
• 71B • Updated • 257
• 11
legraphista/Llama-Guard-3-8B-IMat-GGUF
Text Generation
• 8B • Updated • 704
• 5
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
• 123B • Updated • 283
• 29
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF
Text Generation
• 8B • Updated • 146
• 1
legraphista/gemma-2-2b-it-IMat-GGUF
Text Generation
• 3B • Updated • 242
• 2