Collecting flash-attn
  Downloading flash_attn-2.8.2.tar.gz (8.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.2/8.2 MB 54.0 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: torch in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from flash-attn) (2.7.1)
Requirement already satisfied: einops in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from flash-attn) (0.8.1)
Requirement already satisfied: filelock in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (3.18.0)
Requirement already satisfied: typing-extensions>=4.10.0 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (4.14.0)
Requirement already satisfied: setuptools in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (80.9.0)
Requirement already satisfied: sympy>=1.13.3 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (1.14.0)
Requirement already satisfied: networkx in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (3.5)
Requirement already satisfied: jinja2 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (3.1.6)
Requirement already satisfied: fsspec in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (2025.3.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.77)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.77)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.80)
Requirement already satisfied: nvidia-cudnn-cu12==9.5.1.17 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (9.5.1.17)
Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (11.3.0.4)
Requirement already satisfied: nvidia-curand-cu12==10.3.7.77 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (10.3.7.77)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (11.7.1.2)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.5.4.2)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.6.77 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.77)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (12.6.85)
Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (1.11.1.6)
Requirement already satisfied: triton==3.3.1 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from torch->flash-attn) (3.3.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from sympy>=1.13.3->torch->flash-attn) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/liblibai-models/user-workspace/miniconda3/envs/refiner_liuyaoli/lib/python3.12/site-packages (from jinja2->torch->flash-attn) (3.0.2)
Building wheels for collected packages: flash-attn
  Building wheel for flash-attn (setup.py): started
  Building wheel for flash-attn (setup.py): finished with status 'done'
  Created wheel for flash-attn: filename=flash_attn-2.8.2-cp312-cp312-linux_x86_64.whl size=255943293 sha256=9df465b955acdc158c0ca6638d4589c32be2ac6e28d9506f9c7439949364b95e
  Stored in directory: /root/.cache/pip/wheels/78/3c/b4/ffda66c302456e29ccfec29ca86de99482e6c27a43662c30ea
Successfully built flash-attn
Installing collected packages: flash-attn
Successfully installed flash-attn-2.8.2