# Install SGLang-Diffusion You can install SGLang-Diffusion using one of the methods below. ## Standard Installation (NVIDIA GPUs) ### Method 1: With pip or uv It is recommended to use uv for a faster installation: ```bash pip install --upgrade pip pip install uv uv pip install "sglang[diffusion]" --prerelease=allow ``` ### Method 2: From source ```bash # Use the latest release branch git clone https://github.com/sgl-project/sglang.git cd sglang # Install the Python packages pip install --upgrade pip pip install -e "python[diffusion]" # With uv uv pip install -e "python[diffusion]" --prerelease=allow ``` ### Method 3: Using Docker The Docker images are available on Docker Hub at [lmsysorg/sglang](https://hub.docker.com/r/lmsysorg/sglang), built from the [Dockerfile](https://github.com/sgl-project/sglang/blob/main/docker/Dockerfile). Replace `` below with your HuggingFace Hub [token](https://huggingface.co/docs/hub/en/security-tokens). ```bash docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=" \ --ipc=host \ lmsysorg/sglang:dev \ zsh -c '\ echo "Installing diffusion dependencies..." && \ pip install -e "python[diffusion]" && \ echo "Starting SGLang-Diffusion..." && \ sglang generate \ --model-path black-forest-labs/FLUX.1-dev \ --prompt "A logo With Bold Large text: SGL Diffusion" \ --save-output \ ' ``` ## Platform-Specific: ROCm (AMD GPUs) For AMD Instinct GPUs (e.g., MI300X), you can use the ROCm-enabled Docker image: ```bash docker run --device=/dev/kfd --device=/dev/dri --ipc=host \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env HF_TOKEN= \ lmsysorg/sglang:v0.5.5.post2-rocm700-mi30x \ sglang generate --model-path black-forest-labs/FLUX.1-dev --prompt "A logo With Bold Large text: SGL Diffusion" --save-output ``` For detailed ROCm system configuration and installation from source, see [AMD GPUs](../../platforms/amd_gpu.md). ## Platform-Specific: MUSA (Moore Threads GPUs) For Moore Threads GPUs (MTGPU) with the MUSA software stack: ```bash # Clone the repository git clone https://github.com/sgl-project/sglang.git cd sglang # Install the Python packages pip install --upgrade pip rm -f python/pyproject.toml && mv python/pyproject_other.toml python/pyproject.toml pip install -e "python[all_musa]" ``` ## Platform-Specific: Ascend NPU For Ascend NPU, please follow the [NPU installation guide](../platforms/ascend_npu.md). Quick test: ```bash sglang generate --model-path black-forest-labs/FLUX.1-dev \ --prompt "A logo With Bold Large text: SGL Diffusion" \ --save-output ```