Instructions to use HanzoHuang/Qwen3.5-2B-RKLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use HanzoHuang/Qwen3.5-2B-RKLLM with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
File size: 2,792 Bytes
812f194 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | [
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_0",
"token_nums": 243
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_1",
"token_nums": 264
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_2",
"token_nums": 259
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_3",
"token_nums": 227
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_4",
"token_nums": 325
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_5",
"token_nums": 345
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_6",
"token_nums": 148
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_7",
"token_nums": 141
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_8",
"token_nums": 298
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_9",
"token_nums": 235
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_10",
"token_nums": 145
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_11",
"token_nums": 145
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_12",
"token_nums": 203
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_13",
"token_nums": 219
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_14",
"token_nums": 186
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_15",
"token_nums": 187
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_16",
"token_nums": 236
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_17",
"token_nums": 253
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_18",
"token_nums": 287
},
{
"sample": "/home/ae/hanzos_workspace/rknn-llm/examples/multimodal_model_demo/data/llm_inputs/sample_19",
"token_nums": 317
}
] |