Instructions to use harvestsu/Qwen3-4B-AWQ-TensorRT-EdgeLLM-engine with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use harvestsu/Qwen3-4B-AWQ-TensorRT-EdgeLLM-engine with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
| { | |
| "model_path": "Qwen/Qwen3-4B-AWQ", | |
| "roles": { | |
| "system": { | |
| "prefix": "<|im_start|>system\n", | |
| "suffix": "<|im_end|>\n" | |
| }, | |
| "user": { | |
| "prefix": "<|im_start|>user\n", | |
| "suffix": "<|im_end|>\n" | |
| }, | |
| "assistant": { | |
| "prefix": "<|im_start|>assistant\n<think>\n\n</think>\n\n", | |
| "suffix": "<|im_end|>\n" | |
| } | |
| }, | |
| "content_types": { | |
| "image": { | |
| "format": "<|vision_start|><|image_pad|><|vision_end|>" | |
| }, | |
| "video": { | |
| "format": "<|vision_start|><|video_pad|><|vision_end|>" | |
| } | |
| }, | |
| "generation_prompt": "<|im_start|>assistant\n<think>\n\n</think>\n\n", | |
| "default_system_prompt": "", | |
| "generation_prompt_thinking": "<|im_start|>assistant\n<think>\n" | |
| } | |