RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 9.2k • 20
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 747 • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 69.5k • 45
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 36
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 27
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 1.1k • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 76 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 675 • 7
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation • 71B • Updated • 937 • 3
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 63 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • 406B • Updated • 44 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • 406B • Updated • 81 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • 406B • Updated • 3.22k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 907 • 31
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation • Updated • 82
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 741 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 35
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B • Updated • 893
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 2.57k • 6
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 4.41k • 8
RedHatAI/Llama-3.2-1B-FP8
1B • Updated • 20k • 2
RedHatAI/Llama-2-7b-chat-quantized.w8a8
Text Generation • 7B • Updated • 49 • 1
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block
Text Generation • 561B • Updated • 660
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 12.6k • 4
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 5.34k • 11
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 1.04k • 5
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation • 561B • Updated • 3.4k • 5
RedHatAI/Mistral-Medium-3.5-128B
Image-Text-to-Text • 128B • Updated • 1.06k
RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic
Image-Text-to-Text • 26B • Updated • 15.8k • 12
RedHatAI/Qwen3-VL-30B-A3B-Instruct
Image-Text-to-Text • 31B • Updated • 49