ReNoteTech
/

Vllm-v2

4-bit precision

Model card Files Files and versions

Vllm-v2 / generation_config.json

Commit History

Add model inference script

a238dbd
verified

ReNoteTech commited on Oct 9, 2024