## Caching Acceleration These variables configure caching acceleration for Diffusion Transformer (DiT) models. SGLang supports multiple caching strategies - see [caching documentation](performance/cache/index.md) for an overview. ### Cache-DiT Configuration See [cache-dit documentation](performance/cache/cache_dit.md) for detailed configuration. | Environment Variable | Default | Description | |-------------------------------------|---------|------------------------------------------| | `SGLANG_CACHE_DIT_ENABLED` | false | Enable Cache-DiT acceleration | | `SGLANG_CACHE_DIT_FN` | 1 | First N blocks to always compute | | `SGLANG_CACHE_DIT_BN` | 0 | Last N blocks to always compute | | `SGLANG_CACHE_DIT_WARMUP` | 4 | Warmup steps before caching | | `SGLANG_CACHE_DIT_RDT` | 0.24 | Residual difference threshold | | `SGLANG_CACHE_DIT_MC` | 3 | Max continuous cached steps | | `SGLANG_CACHE_DIT_TAYLORSEER` | false | Enable TaylorSeer calibrator | | `SGLANG_CACHE_DIT_TS_ORDER` | 1 | TaylorSeer order (1 or 2) | | `SGLANG_CACHE_DIT_SCM_PRESET` | none | SCM preset (none/slow/medium/fast/ultra) | | `SGLANG_CACHE_DIT_SCM_POLICY` | dynamic | SCM caching policy | | `SGLANG_CACHE_DIT_SCM_COMPUTE_BINS` | not set | Custom SCM compute bins | | `SGLANG_CACHE_DIT_SCM_CACHE_BINS` | not set | Custom SCM cache bins | ## Cloud Storage These variables configure S3-compatible cloud storage for automatically uploading generated images and videos. | Environment Variable | Default | Description | |---------------------------------|---------|--------------------------------------------------------| | `SGLANG_CLOUD_STORAGE_TYPE` | not set | Set to `s3` to enable cloud storage | | `SGLANG_S3_BUCKET_NAME` | not set | The name of the S3 bucket | | `SGLANG_S3_ENDPOINT_URL` | not set | Custom endpoint URL (for MinIO, OSS, etc.) | | `SGLANG_S3_REGION_NAME` | us-east-1 | AWS region name | | `SGLANG_S3_ACCESS_KEY_ID` | not set | AWS Access Key ID | | `SGLANG_S3_SECRET_ACCESS_KEY` | not set | AWS Secret Access Key |