Instructions to use HanzoHuang/Qwen3.5-4B-RKLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use HanzoHuang/Qwen3.5-4B-RKLLM with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
File size: 2,792 Bytes
514ceb2 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | [
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_0",
"token_nums": 241
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_1",
"token_nums": 262
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_2",
"token_nums": 257
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_3",
"token_nums": 225
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_4",
"token_nums": 323
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_5",
"token_nums": 343
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_6",
"token_nums": 146
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_7",
"token_nums": 139
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_8",
"token_nums": 296
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_9",
"token_nums": 233
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_10",
"token_nums": 143
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_11",
"token_nums": 143
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_12",
"token_nums": 201
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_13",
"token_nums": 217
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_14",
"token_nums": 184
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_15",
"token_nums": 185
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_16",
"token_nums": 234
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_17",
"token_nums": 251
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_18",
"token_nums": 285
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_19",
"token_nums": 315
}
] |