Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,744

Base only

Active filters: 8-bit

laishram/bloom-560m-lora-merged-tagger

Text Generation • 0.6B • Updated Feb 27, 2024 • 6

Lambent/CosmoAlpacaLight-1b

Updated Mar 6, 2024

OrHaifler3/bloom1b-forms

Text Generation • Updated Feb 27, 2024 • 12

NexaAI/Octopus-v1-llama-7b

Text Generation • 7B • Updated Apr 3, 2024 • 4 • 2

rfernand/phi2_ft4

Text Generation • 3B • Updated Feb 28, 2024 • 5

rfernand/phi2_ft5

Text Generation • 3B • Updated Feb 28, 2024 • 4

MaziyarPanahi/StructLM-7B-GGUF

Text Generation • 7B • Updated Feb 28, 2024 • 33 • 3

MaziyarPanahi/StructLM-13B-GGUF

Text Generation • 13B • Updated Feb 28, 2024 • 467 • 4

MaziyarPanahi/TIGERScore-13B-GGUF

Text Generation • 13B • Updated Feb 28, 2024 • 89 • 3

MaziyarPanahi/Mistral-7B-Instruct-KhanAcademy-v0.2-GGUF

Text Generation • 7B • Updated Feb 28, 2024 • 322 • 5

MaziyarPanahi/StructLM-34B-GGUF

Text Generation • 34B • Updated Feb 28, 2024 • 192 • 2

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • 7B • Updated Feb 28, 2024 • 913 • 12

NexaAI/Octopus-v1-gemma-7B

Text Generation • 9B • Updated Apr 3, 2024 • 11 • 3

solomonpm/my-owlvit-8bit

Zero-Shot Object Detection • Updated Feb 29, 2024 • 6

Lightricks/T5-XXL-8bit

5B • Updated Feb 29, 2024 • 88 • 10

MaziyarPanahi/OpenCodeInterpreter-DS-6.7B-GGUF

Text Generation • 7B • Updated Mar 1, 2024 • 799 • 2

jspr/bts_mistral_7b_v3_32k_LoRA

Updated Mar 2, 2024 • 5 • 1

MaziyarPanahi/ChatMusician-GGUF

Text Generation • 7B • Updated Mar 2, 2024 • 731 • 15

cmarvolo/mistral-7b-instruct-fed-auto

4B • Updated Apr 11, 2024 • 7

MaziyarPanahi/Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 2, 2024 • 271 • 4

MaziyarPanahi/jaskier-7b-dpo-v5.6-GGUF

Text Generation • 7B • Updated Mar 2, 2024 • 568 • 4

wisdominanutshell/coedit-xxl-8bit

11B • Updated Mar 3, 2024 • 5

MaziyarPanahi/phi-2-logical-sft-GGUF

Text Generation • 3B • Updated Mar 3, 2024 • 106 • 2

AwAppp/q8bit

Text Generation • 7B • Updated Mar 4, 2024 • 7

MaziyarPanahi/Calme-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Mar 4, 2024 • 215 • 2

Duxiaoman-DI/XuanYuan-6B-Chat-8bit

Text Generation • 6B • Updated Mar 16, 2024 • 11

MaziyarPanahi/34b-beta-GGUF

Text Generation • 34B • Updated Mar 4, 2024 • 110 • 4

MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF

Text Generation • 7B • Updated Mar 5, 2024 • 712 • 6

Lambent/cosmo-merge-1b-v0.1

Text Generation • 2B • Updated Mar 7, 2024 • 20

crystalyu/solar_10.2b_koen_translate_finetuned

Text Generation • 11B • Updated Mar 7, 2024 • 7