Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,678

Full-text search

Active filters: 4-bit

TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 2 • 9

TheBloke/OpenOrca-Preview1-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 1 • 8

blakeho/flan-t5-critical-constructive-translator

Updated Jul 13, 2023 • 1

Leon68/falcon7b-openassistant

Text Generation • Updated Jul 13, 2023 • 1

Leon68/falcon-7b-openassistant

Text Generation • Updated Jul 14, 2023 • 2

TheBloke/openchat_v2_openorca_preview-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 859 • 15

TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-7b-v3-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 9 • 4

TheBloke/WizardCoder-Guanaco-15B-V1.1-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 9 • 12

TheBloke/LLaMa-65B-GPTQ

Text Generation • 65B • Updated Sep 20, 2023 • 7 • 5

TheBloke/LLaMa-13B-GPTQ

Text Generation • 13B • Updated Sep 20, 2023 • 22 • 5

TheBloke/LLaMa-30B-GPTQ

Text Generation • 33B • Updated Sep 20, 2023 • 19 • 5

TheBloke/LLaMa-7B-GPTQ

Text Generation • 7B • Updated Sep 20, 2023 • 166 • 5

TheBloke/MythoLogic-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 8 • 15

shirsh10mall/First_LLM_Project

Updated Dec 17, 2023 • 6

TheBloke/Codegen25-7B-mono-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 8

TheBloke/Llama-2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 7.9k • 81

TheBloke/Llama-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 281 • 120

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 19.4k • 267

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 13.2k • 363

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 3.33k • 258

TheBloke/Llama-2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 599 • 83

subset-data/falcon-testing

Text Generation • Updated Jul 20, 2023 • 11

TheBloke/Redmond-Puffin-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 17 • 26

TheBloke/Luna-AI-Llama2-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 69 • 86

TheBloke/llama-2-7B-Guanaco-QLoRA-GPTQ

Text Classification • 7B • Updated Sep 27, 2023 • 4 • 17

TheBloke/upstage-llama-30b-instruct-2048-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 15 • 22

TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ

Text Classification • 13B • Updated Sep 27, 2023 • 13 • 21

TheBloke/llama-2-13B-German-Assistant-v2-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 16 • 12

subset-data/falcon-7b-bt

Text Generation • Updated Jul 21, 2023 • 13

TheBloke/LLongMA-2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 28 • 12