mumbai-local / frontend /server /gpu_llm.py

Commit History

GPU tuning: @spaces.GPU duration 90->60, max_new_tokens 768->320, remove diagnostic logging
4a9c11e
verified

geekwrestler commited on

Shim legacy generation output classes so the mamba-ssm hub kernel imports on transformers 5.x
42f808d
verified

geekwrestler commited on

Nemotron-3-Nano fast Mamba path: native NemotronH (transformers>=5.8) + hub kernels, drop mamba_ssm wheel (fixes NVML fork assert)
21c40a0
verified

geekwrestler commited on

Load Nemotron on CPU, move to GPU inside @spaces.GPU (fixes NVML fork assert)
91c94f9
verified

geekwrestler commited on

Disable Nemotron thinking (enable_thinking=False) so the dispatcher emits clean JSON
5b242e8
verified

geekwrestler commited on

Deploy Mumbai Local Panic — Nemotron(ZeroGPU) dispatcher + VoxCPM2 voice
d4a1b20
verified

geekwrestler commited on