Kernels:

kernels-community
/

paged-attention

Trusted publisher

drbh

Migrated from kernels-community/paged-attention

54c44b9 unverified about 2 months ago

282 Bytes

	---
	license: apache-2.0
	tags:
	- kernels
	---

	![Status](https://hubwebhook.dholtz.com/shield?repo=kernels-community/paged-attention)

	## attention

	Paged attention kernels from [vLLM](https://github.com/vllm-project/) and [mistral.rs](https://github.com/EricLBuehler/mistral.rs).