Update README.md
Browse files
README.md
CHANGED
|
@@ -42,6 +42,7 @@ python -m sglang.launch_server \
|
|
| 42 |
```
|
| 43 |
|
| 44 |
## Notes:
|
|
|
|
| 45 |
- `--kt-cpuinfer` should be set to the total number of physical CPU cores across all NUMA nodes
|
| 46 |
- `--tensor-parallel-size 1` should be set to the number of GPUs
|
| 47 |
- The optimal choices for `--attention-backend` and `--fp8-gemm-backend` depend on the CUDA architecture of your GPUs - please check the sglang documentation
|
|
|
|
| 42 |
```
|
| 43 |
|
| 44 |
## Notes:
|
| 45 |
+
- At the time of writing, `MiniMaxM2ForCausalLM` produces significantly degraded output with `transformers` 5.0.0+
|
| 46 |
- `--kt-cpuinfer` should be set to the total number of physical CPU cores across all NUMA nodes
|
| 47 |
- `--tensor-parallel-size 1` should be set to the number of GPUs
|
| 48 |
- The optimal choices for `--attention-backend` and `--fp8-gemm-backend` depend on the CUDA architecture of your GPUs - please check the sglang documentation
|