metadata
language:
- en
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct/blob/main/LICENSE
pipeline_tag: text-generation
base_model: Qwen2.5-Coder-3B-Instruct
base_model_relation: quantized
library_name: litert-lm
tags:
- litert-lm
- litertlm
- qwen
- Qwen2.5
Qwen2.5-Coder-3B-Instruct LiteRT-LM Model
This repository contains LiteRT-LM variant of Qwen/Qwen2.5-Coder-3B-Instruct optimized for on-device text generation.
Available Artifact
| File | Quantization Recipe | Context | Size |
|---|---|---|---|
Qwen2.5_Coder_3B_It.litertlm |
dynamic_wi8_afp32 | - | 3.4 GB |
Integration
Ready to integrate this into your product? Get started in the LiteRT-LM documentation.