fix: use eager attention for MiniCPM4.1-8B to prevent SDPA crash, fix Nemotron Parse processor format 32bc132 Kunalv commited on Jun 6
fix: switch Core Router to AutoModelForCausalLM for generate support, fix Nemotron Parse inference with AutoProcessor bb9bc8a Kunalv commited on Jun 6
fix: block flash_attn at runtime with sys.modules=None to prevent FA2 on HF ZeroGPU where flash_attn is pre-installed 9fc5c52 Kunalv commited on Jun 6
fix: resolve infinite recursion in flash_attn patch by capturing original get_imports before patching 70f54cc Kunalv commited on Jun 6
fix: replace flash_attn mock with get_imports patch to properly disable FA2 for MiniCPM4.1-8B and Nemotron Parse d006ae4 Kunalv commited on Jun 6
fix: correct vision model dtype, Nemotron Parse model ID, and patch missing is_torch_fx_available 4e3a057 Kunalv commited on Jun 6
feat: add Parallel Vision Engine — MiniCPM-V and Nemotron Parse fire async with confidence-score arbiter 96f4123 Kunalv commited on Jun 6