# Required patches (fish-speech main e5e2926 / sglang-omni main, 2026-07-18) ## fish-speech (training) 1. fish_speech/models/text2semantic/llama.py: both `checkpoint(...)` calls -> use_reentrant=False 2. fish_speech/models/text2semantic/lit_module.py: add `strict_loading = False` to TextToSemantic 3. (optional) lora_slow_patch.py adds slow_* target names that do NOT imply fast_* ## sglang-omni (serving on Blackwell/sm_120) 1. rm -r site-packages/deep_gemm (import-time assert without CUDA toolkit) 2. apt: cuda-nvcc-13-0 libcublas-dev-13-0 libcusparse-dev-13-0 libcusolver-dev-13-0 libcurand-dev-13-0 ninja-build (torch cu130) 3. sglang_omni/models/fishaudio_s2_pro/engine_builder.py: attention_backend "fa3" -> "triton"; disable_cuda_graph True; mem_fraction_static 0.55 4. run patch_audio_decoder.py (adds FISH_FORCE_SDPA env gate replacing sgl_kernel flash_attn_with_kvcache) Launch env: CUDA_HOME=/usr/local/cuda-13.0 SGLANG_ENABLE_JIT_DEEPGEMM=0 FISH_FORCE_SDPA=1