litert-community
/

Qwen2.5-Coder-3B-Instruct

Text Generation

Model card Files Files and versions

Qwen2.5-Coder-3B-Instruct / README.md

NS1001's picture

Create README.md

a32e9f0 verified 13 days ago

|

History Blame Contribute Delete

830 Bytes

	---
	language:
	- en
	license: apache-2.0
	license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct/blob/main/LICENSE
	pipeline_tag: text-generation
	base_model: Qwen2.5-Coder-3B-Instruct
	base_model_relation: quantized
	library_name: litert-lm
	tags:
	- litert-lm
	- litertlm
	- qwen
	- Qwen2.5
	---
	# Qwen2.5-Coder-3B-Instruct LiteRT-LM Model

	This repository contains LiteRT-LM variant of [Qwen/Qwen2.5-Coder-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct) optimized for on-device text generation.

	## Available Artifact

	\| File \| Quantization Recipe \| Context \| Size \|
	\|---\|---\|---:\|---:\|
	\| `Qwen2.5_Coder_3B_It.litertlm` \| dynamic_wi8_afp32 \| - \| 3.4 GB \|

	## Integration

	Ready to integrate this into your product? Get started in the [LiteRT-LM documentation](https://ai.google.dev/edge/litert-lm/overview).