Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,303

Base only

Active filters: opt

ahmeda335/opt-125m-gptq-4bit

Text Generation • 0.1B • Updated Jan 16, 2025 • 2

ahmeda335/Llama-3.2-1B-gptq-4bit

Text Generation • 0.1B • Updated Jan 16, 2025 • 5

ahmeda335/opt-350m-BitsAndBytes-4bit

Text Generation • 0.3B • Updated Jan 16, 2025 • 8

ahmeda335/opt-350m-BitsAndBytes-8bit

Text Generation • 0.3B • Updated Jan 16, 2025 • 5

prxy5607/c1bd8c41-de6d-4f1a-90ee-9c65e1e89604

Updated Jan 16, 2025 • 2

aleegis09/890226ff-5871-4f91-ad3d-b87c1f7f101c

Updated Jan 16, 2025 • 1

nhung02/d3334958-9b8d-433a-bea3-1e80c79037cc

Updated Jan 16, 2025 • 2

prxy5605/9964d343-dd12-4562-bb73-357158c13539

Updated Jan 17, 2025 • 1

prxy5608/04c5d448-b8a1-4776-b849-68de0063fc5d

Updated Jan 17, 2025 • 2

tonyshark/927_Llama_3_20250117-041208_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 10

tonyshark/927_Llama_3_20250117-044111_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 6

tonyshark/927_Llama_3_20250117-044640_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 6

tonyshark/927_Llama_3_20250117-065109_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 4

tonyshark/927_Llama_3_20250117-075726_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 4

tonyshark/927_Llama_3_20250117-081348_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 5

tonyshark/927_Llama_3_20250117-084747_aixblock

Text Generation • 0.1B • Updated Jan 17, 2025 • 5

kokovova/a5217191-4c04-4bcb-9ea5-ac5e70ba3767

Updated Jan 17, 2025 • 3

prxy5604/53759e77-b787-4098-a612-28766b43d6df

Updated Jan 17, 2025 • 1

nbninh/2d5a3def-a803-47b7-a015-d11e35b8061e

Updated Jan 17, 2025 • 1

myhaaaaaaa/fa991909-b558-4139-a412-9cc1121f19b9

Updated Jan 17, 2025 • 2

nhung01/e116f7b8-8751-4356-9920-70efc8487923

Updated Jan 17, 2025 • 2

nblinh63/66bb1444-40f8-4d36-8581-371b81f746dd

Updated Jan 17, 2025 • 2

thangla01/929469b3-d710-4fd5-a057-10f1e6f97ce2

Updated Jan 17, 2025 • 1

thaffggg/2d981fc1-50f2-4e1d-b6f9-663d0d628fb7

Updated Jan 17, 2025 • 2

adammandic87/31b47463-6052-436d-aba8-80ede3348af1

Updated Jan 17, 2025

aleegis10/c6b83881-3966-48bf-8360-98f34cc34e95

Updated Jan 17, 2025 • 1

fedovtt/389df2f9-07dd-41e4-93fc-3ceea5fb7f28

Updated Jan 18, 2025 • 1

prxy5607/00fa8aba-2d74-482e-956e-2c9d6ad6fd82

Updated Jan 18, 2025 • 1

prxy5605/4dc3caa8-73b7-4c24-87fb-406a94cdfb90

Updated Jan 18, 2025 • 1

prxy5604/2d4f23c7-0ac3-41f1-a5d4-e14668d24512

Updated Jan 18, 2025 • 1