Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

860

Base only

Active filters: ggml

mverrilli/dolly-v2-7b-ggml

Updated May 18, 2023 • 1

Green-Sky/ggml-mpt-7b-storywriter

Updated May 20, 2023 • 14

ShadowPower/ggml-alpaca-chatgpt-new

Text Generation • Updated May 27, 2023 • 7

rustformers/mpt-7b-ggml

Text Generation • Updated Jun 9, 2023 • 17 • 46

digitous/13B-HyperMantis_GGML

Updated May 24, 2023 • 1

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 15 • 7

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 59 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 10 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 13 • 6

rustformers/gpt-j-ggml

Text Generation • Updated Jun 9, 2023 • 9 • 2

rustformers/stablelm-ggml

Text Generation • Updated Jun 9, 2023 • 17 • 3

rustformers/dolly-v2-ggml

Text Generation • Updated Oct 19, 2023 • 13 • 2

rustformers/gpt4all-j-ggml

Text Generation • Updated Jun 9, 2023 • 12 • 11

rustformers/redpajama-7b-ggml

Text Generation • Updated Jun 9, 2023 • 8 • 3

rustformers/open-llama-ggml

Text Generation • Updated Jun 11, 2023 • 17 • 9

phi0112358/Zicklein-7B-german_Alpaca-ggml

Updated Jun 19, 2023 • 4

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 3

mukowaty/ggml-whisper

Updated Jul 15, 2024 • 5

Green-Sky/ggml_openai_clip-vit-base-patch32

Updated Jun 25, 2023

Araki/airoboros-33b-gpt4-1.4.1-PI-8192-GGML

Text Generation • Updated Jul 16, 2023 • 2

Araki/Luna-AI-Llama2-Uncensored-GGML

Text Generation • Updated Jul 23, 2023 • 3

richardr1126/spider-skeleton-wizard-coder-ggml

Updated Aug 20, 2023 • 4

jphme/Llama-2-13b-chat-german-GGML

Text Generation • Updated Jul 22, 2023 • 13

Araki/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML

Text Generation • Updated Jul 22, 2023 • 1

Trelis/Llama-2-7b-chat-hf-function-calling

Text Generation • Updated Aug 22, 2023 • 30 • • 48

Trelis/Llama-2-13b-chat-hf-function-calling

Text Generation • Updated Aug 23, 2023 • 4

bornjre/btlm-3b-ggml

Updated Aug 21, 2023 • 8

gorkemgoknar/llama2-7f-moviechatbot-ggml-q4

Text Generation • Updated Oct 11, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GGML

Text Generation • Updated Aug 11, 2023 • 6