YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Flash-Attention Wheels for T4 GPU
Pre-compiled .whl files for NVIDIA T4 (sm_75).
| File | Python | PyTorch | CUDA |
|---|---|---|---|
flash_attn-2.8.3-cp312-cp312-linux_x86_64.whl |
3.12 | 2.10.0+cu128 | 12.8 |
Install
pip install "https://huggingface.co/nopesadly/flash-attn-wheels/resolve/main/flash_attn-2.8.3-cp312-cp312-linux_x86_64.whl"
Compiled with
TORCH_CUDA_ARCH_LIST=7.5— only compatible with T4 GPUs.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support