Doctor-Shotgun commited on
Commit
fa0ed6d
·
verified ·
1 Parent(s): 13300b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -42,6 +42,7 @@ python -m sglang.launch_server \
42
  ```
43
 
44
  ## Notes:
 
45
  - `--kt-cpuinfer` should be set to the total number of physical CPU cores across all NUMA nodes
46
  - `--tensor-parallel-size 1` should be set to the number of GPUs
47
  - The optimal choices for `--attention-backend` and `--fp8-gemm-backend` depend on the CUDA architecture of your GPUs - please check the sglang documentation
 
42
  ```
43
 
44
  ## Notes:
45
+ - At the time of writing, `MiniMaxM2ForCausalLM` produces significantly degraded output with `transformers` 5.0.0+
46
  - `--kt-cpuinfer` should be set to the total number of physical CPU cores across all NUMA nodes
47
  - `--tensor-parallel-size 1` should be set to the number of GPUs
48
  - The optimal choices for `--attention-backend` and `--fp8-gemm-backend` depend on the CUDA architecture of your GPUs - please check the sglang documentation