metadata
base_model: qingy2024/GRMR-3B-Instruct
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- openvino
- openvino-export
license: apache-2.0
language:
- en
pipeline_tag: text-generation
This model was converted to OpenVINO from qingy2024/GRMR-3B-Instruct using optimum-intel
via the export space.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "santhosh/GRMR-3B-Instruct-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)