poolside-laguna-hackathon
/

kv-landlords

Model card Files Files and versions

kv-landlords / vllm /docs /getting_started /installation /device.template.md

a1exxd0's picture

Upload kv-quant (INT4/NVFP4 KIVI) work + vLLM fork source

6e668dc verified 2 months ago

|

History Blame Contribute Delete

204 Bytes

Installation

Requirements

Set up using Python

Pre-built wheels

Build wheel from source

Set up using Docker

Pre-built images

Build image from source

Extra information