granite-4-micro-ov

granite-4-micro-ov is an OpenVINO int4 quantized version of granite-4-micro, providing a fast, small inference implementation, optimized for AI PCs.

Model Description

• Developed by: ibm-granite
• Quantized by: llmware
• Model type: granitemoehybrid
• Parameters: 2 billion
• Model Parent: ibm-granite/granite-4-micro
• Language(s) (NLP): English
• License: Apache 2.0
• Uses: Chat, general-purpose LLM
• Quantization: int4

Model Card Contact

llmware on hf

llmware website