mathcompose / requirements-gpu.txt
42e's picture
Upload folder using huggingface_hub
014b14c verified
Raw
History Blame Contribute Delete
511 Bytes
# Extra deps for the GPU training/inference path (Colab / Modal / RunPod).
# Install on top of requirements.txt on a CUDA box:
# pip install -r requirements.txt -r requirements-gpu.txt
#
# NOTE: install a CUDA build of torch first (Colab ships one). The CPU box uses
# torch==*+cpu, which cannot run 4-bit QLoRA.
bitsandbytes>=0.43 # 4-bit NF4 kernels for QLoRA (requires CUDA)
# Optional speedup (UNCONFIRMED against transformers 5.13 — pin transformers down if you use it):
# pip install unsloth