Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

885

Base only

Active filters: ggml

Bluckr/llama-7B-ggml-q4_0-Pofi-Assistant

Text Generation • Updated Aug 13, 2023 • 2

Araki/Bacchus-22B-GGML

Text Generation • Updated Aug 14, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ-trained-adapters

Text Generation • Updated Aug 14, 2023

Trelis/Llama-2-7b-hf-function-calling

Text Generation • Updated Aug 15, 2023 • 11 •

Trelis/Llama-2-13b-chat-hf-function-calling-adapters-v2

Text Generation • Updated Oct 11, 2023

Trelis/Llama-2-13b-chat-hf-function-calling-v2

Text Generation • 13B • Updated Oct 11, 2023 • 4

haouarin/noon-7b-GGML-4bit

Updated Aug 25, 2023 • 3

clibrain/lince-zero-f16-ggml-q4_0

Updated Aug 30, 2023 • 5

Trelis/Llama-2-70b-chat-hf-function-calling-adapters-v2

Text Generation • Updated Oct 11, 2023 • 3

Trelis/Llama-2-70b-chat-hf-function-calling-v2

Text Generation • 69B • Updated Mar 26, 2024 • 3

PathOr/PathOr_LLama_70B_CHAT

Text Generation • Updated Sep 13, 2023 • 1

PathOr/PathOr_Llama-2-70b-chat-hf-function-calling-adapters-v2

Text Generation • Updated Sep 15, 2023 • 4

mys/ggml_CLIP-ViT-B-32-laion2B-s34B-b79K

0.2B • Updated Sep 27, 2023 • 301 • 7

mys/ggml_CLIP-ViT-H-14-laion2B-s32B-b79K

1.0B • Updated Sep 28, 2023 • 236 • 3

mys/ggml_CLIP-ViT-L-14-laion2B-s32B-b82K

0.4B • Updated Sep 27, 2023 • 360 • 3

mys/ggml_clip-vit-base-patch32

0.2B • Updated Sep 27, 2023 • 234 • 2

mys/ggml_clip-vit-large-patch14

0.4B • Updated Sep 29, 2023 • 409 • 3

mys/ggml_llava-v1.5-7b

7B • Updated Oct 9, 2023 • 2.46k • 113

mys/ggml_llava-v1.5-13b

13B • Updated Oct 10, 2023 • 289 • 55

mys/ggml_bakllava-1

7B • Updated Oct 19, 2023 • 616 • 75

npc0/DISC-MedLLM-ggml

Text Generation • Updated Nov 1, 2023

npc0/chatglm3-6b-int4

Updated Dec 24, 2023 • 2

npc0/chatglm3-6b-int8

Updated Dec 24, 2023 • 1

afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF

1B • Updated Nov 4, 2023 • 101

afrideva/tinyllama-colorist-v2-GGUF

Text Generation • 1B • Updated Nov 4, 2023 • 87

afrideva/stablelm-3b-4e1t-GGUF

Text Generation • 3B • Updated Nov 5, 2023 • 350

afrideva/tiny-llama-miniguanaco-1.5T-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 199

afrideva/Hermes-Trismegistus-Mistral-7B-GGUF

Text Generation • 7B • Updated Nov 5, 2023 • 324

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 116 • 2

afrideva/bling-sheared-llama-1.3b-0.1-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 205 • 1