|
Download README.md from Nekodeus/codegemma-7b-it-openvino: direct link, hf CLI and curl.
- Browser
- Download file 1.59 kB
-
https://huggingface.co/Nekodeus/codegemma-7b-it-openvino/resolve/main/README.md
- Command line
-
hf download hf://Nekodeus/codegemma-7b-it-openvino/README.md
-
curl -L -o README.md https://huggingface.co/Nekodeus/codegemma-7b-it-openvino/resolve/main/README.md
1.59 kB
| license: gemma | |
| library_name: openvino | |
| tags: | |
| - openvino | |
| - int8 | |
| - text-generation | |
| - codegemma | |
| - code | |
| - llm | |
| # CodeGemma-7B-it OpenVINO (INT8) | |
| OpenVINO IR conversion of [google/codegemma-7b-it](https://huggingface.co/google/codegemma-7b-it) with weight-only INT8 quantization, produced on CPU-only Kaggle with `optimum-cli` (fully offline, token-free). | |
| - Base model: `google/codegemma-7b-it` (GemmaForCausalLM, 8.5B params, Gemma license) | |
| - Task: `text-generation` | |
| - Precision: weights INT8 (NNCF), activations FP16/FP32 as traced | |
| - Converted with: `optimum-intel 2.2.0`, `openvino 2026.4.1`, `transformers 5.16.1` | |
| - Instruction-tuned code model (Gemma-1B coder head on Gemma-7B base), 8k context, Python/program synthesis | |
| ## Usage | |
| ### optimum-intel | |
| ```python | |
| from optimum.intel import OVModelForCausalLM | |
| from transformers import AutoTokenizer | |
| model = OVModelForCausalLM.from_pretrained("Nekodeus/codegemma-7b-it-openvino") | |
| tok = AutoTokenizer.from_pretrained("Nekodeus/codegemma-7b-it-openvino") | |
| inputs = tok("<start_of_turn>user\nWrite a Python function to reverse a string<end_of_turn>\n<start_of_turn>model\n", return_tensors="pt") | |
| print(tok.decode(model.generate(**inputs, max_new_tokens=256)[0])) | |
| ``` | |
| ### OpenVINO GenAI | |
| ```cpp | |
| ov::genai::LLMPipeline pipe("path/to/Nekodeus/codegemma-7b-it-openvino", "CPU"); | |
| ``` | |
| ## Reproduce | |
| ```bash | |
| optimum-cli export openvino \ | |
| --model google/codegemma-7b-it \ | |
| --task text-generation \ | |
| --weight-format int8 \ | |
| codegemma-7b-it-openvino | |
| ``` | |
| ## License | |
| Gemma Terms of Use (gated on HF; this conversion is un-gated). | |