Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

165

Base only

Active filters: float16

michaelfeil/ct2fast-mpt-30b-chat

Text Generation • Updated Jun 28, 2023 • 21 • 2

michaelfeil/ct2fast-open-llama-13b-open-instruct

Text Generation • Updated Jun 27, 2023 • 15

michaelfeil/ct2fast-Llama-2-7b-hf

Text Generation • Updated Jul 21, 2023 • 24 • 3

michaelfeil/ct2fast-Llama-2-7b-chat-hf

Text Generation • Updated Jul 21, 2023 • 26 • 4

michaelfeil/ct2fast-Llama-2-13b-chat-hf

Text Generation • Updated Jul 21, 2023 • 15 • 4

michaelfeil/ct2fast-Llama-2-13b-hf

Text Generation • Updated Jul 21, 2023 • 12 • 1

michaelfeil/ct2fast-starcoderbase-3b

Text Generation • Updated Jul 28, 2023 • 51

michaelfeil/ct2fast-starcoderbase-7b

Text Generation • Updated Jul 28, 2023 • 59

michaelfeil/ct2fast-starcoderbase-1b

Text Generation • Updated Jul 28, 2023 • 54

michaelfeil/ct2fast-CodeLlama-7b-hf

Text Generation • Updated Sep 13, 2023 • 17

michaelfeil/ct2fast-CodeLlama-34b-hf

Text Generation • Updated Sep 13, 2023 • 31 • 2

michaelfeil/ct2fast-CodeLlama-13b-hf

Text Generation • Updated Sep 13, 2023 • 17

michaelfeil/ct2fast-Phind-CodeLlama-34B-v2

Text Generation • Updated Oct 8, 2023 • 26

ctranslate2-4you/whisper-medium.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 17

ctranslate2-4you/whisper-small-ct2-float16

Automatic Speech Recognition • Updated about 15 hours ago • 34

ctranslate2-4you/whisper-small.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 37

ctranslate2-4you/whisper-base-ct2-float16

Automatic Speech Recognition • Updated about 15 hours ago • 24

ctranslate2-4you/whisper-base.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 28

ctranslate2-4you/whisper-tiny-ct2-float16

Automatic Speech Recognition • Updated about 15 hours ago • 256

ctranslate2-4you/whisper-tiny.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 52

michaelfeil/ct2fast-bge-large-en-v1.5

Feature Extraction • Updated Oct 13, 2023 • 13

michaelfeil/ct2fast-bge-base-en-v1.5

Feature Extraction • Updated Oct 13, 2023 • 14

michaelfeil/ct2fast-bge-small-en-v1.5

Feature Extraction • Updated Oct 13, 2023 • 34

michaelfeil/ct2fast-gte-large

Sentence Similarity • Updated Oct 13, 2023 • 9

michaelfeil/ct2fast-gte-base

Sentence Similarity • Updated Oct 13, 2023 • 11

KomorebiAI/nllb-200-3.3B-float16-ct2

Translation • Updated Dec 19, 2024 • 38 • 3

KomorebiAI/nllb-200-1.3B-float16-ct2

Translation • Updated Dec 19, 2024 • 39 • 1

michaelfeil/ct2fast-phi-1_5

Text Generation • Updated Nov 29, 2023 • 30

michaelfeil/ct2fast-phi-1

Text Generation • Updated Nov 30, 2023 • 18

OpenNMT/codet5p-770m-py-ct2-int8

Updated Nov 30, 2023 • 31