neuralmagic-ent 's Collections Granite-3.1 Quantized
updated
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
• 3B • Updated • 81
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
• 8B • Updated • 62
• 1
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
• 0.5B • Updated • 80.8k
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
• 1B • Updated • 1.34k
• 1
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
• 8B • Updated • 170
• 2
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
• 3B • Updated • 34
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
• 0.5B • Updated • 26
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
• 3B • Updated • 52
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation
• 8B • Updated • 23
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation
• 3B • Updated • 23
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
• 1B • Updated • 30
• 1
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
• 8B • Updated • 22