jxke/gemma-2b-it_rkllm

gemma-2b-rkllm

This is a conversion from gemma-2b-it to the RKLLM format for chat in Rockchip devices.

Support Devices

• RK3588/RK3588s

Convert tools

To Converting LLMs for Rockchip's NPUs, please see the artical^1,2 for model details.

Converted with RKLLM runtime

• RKLLM runtime 1.0.1

License

Same as the original gemma-2b-it

Reference

1. airockchip/rknn-llm
2. Pelochus/ezrknn-llm