Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-BF16
Text Generation • Updated • 4
Edit Models filters
Apps
Inference Providers
Active filters: tensorrt-llm
Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-FP16
Text Generation • Updated • 5
Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-FP8
Text Generation • Updated • 1
Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-NVFP4
Text Generation • Updated • 4
Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-BF16
Text Generation • Updated • 5
Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP16
Text Generation • Updated • 5
Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP8
Text Generation • Updated
Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-NVFP4
Text Generation • Updated • 3
Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-FP8
Text Generation • Updated • 20
Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-NVFP4
Text Generation • Updated • 3
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 6
sbull-dell/gemma-4-26B-A4B-NVFP4
14B • Updated • 446
GumbiiDigital/DeepSeek-R1-Distill-Llama-8B-NVFP4
Text Generation • 5B • Updated • 266 • 1
SCIO911/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV
Text Generation • 8B • Updated • 101
teeofftechnologies/whisper_trt_hindi2hinglish_prime_260508_NVIDIA_A10_0_20_0
Updated
tss-deposium/gemma-4-E4B-text-only-nvfp4
Text Generation • 6B • Updated • 19
tss-deposium/PaddleOCR-VL-1.5-nvfp4
Image-Text-to-Text • 0.6B • Updated • 20
tss-deposium/PaddleOCR-VL-1.5-mxfp4
Image-Text-to-Text • 0.8B • Updated • 27
Reza2kn/mega-asr-nvfp4
Automatic Speech Recognition • Updated