# Extra deps for the GPU training/inference path (Colab / Modal / RunPod). # Install on top of requirements.txt on a CUDA box: # pip install -r requirements.txt -r requirements-gpu.txt # # NOTE: install a CUDA build of torch first (Colab ships one). The CPU box uses # torch==*+cpu, which cannot run 4-bit QLoRA. bitsandbytes>=0.43 # 4-bit NF4 kernels for QLoRA (requires CUDA) # Optional speedup (UNCONFIRMED against transformers 5.13 — pin transformers down if you use it): # pip install unsloth