rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 28 days ago • 25
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated Apr 2 • 8
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8 Text Generation • Updated Feb 8 • 4
rungalileo/xlm-roberta-base-misogyny-sexism-tweets-quantized-traced Text Classification • Updated Dec 14, 2023 • 2