Commit History

chore: add smoke test and debug logs requested by christian
b1713fd

Kunalv commited on

fix: replace buggy native chat method with custom generate pipeline
d597a14

Kunalv commited on

fix: switch back to native chat method to avoid generation bugs
11467f8

Kunalv commited on

fix: logic error in response parsing and add debug logs
c8ef672

Kunalv commited on

fix: remove forced ChatML template and parse native tags
a5bc998

Kunalv commited on

fix: set use_cache=False to prevent kv-cache tensor shape mismatch crashes
860c4e6

Kunalv commited on

fix: replace buggy model.chat() regex with custom generation pipeline
873c1dd

Kunalv commited on

fix: update chat template to use ChatML format instead of legacy tags
3bdcc9b

Kunalv commited on

fix: inject official MiniCPM chat template to prevent garbage hallucinated outputs
3078db7

Kunalv commited on

fix: switch to official MiniCPM .chat() method to fix gibberish output
f3ca13a

Kunalv commited on

fix: use returned input_ids length for slicing position_ids in monkeypatch
2ea4cde

Kunalv commited on

fix: monkeypatch MiniCPM prepare_inputs_for_generation to prevent position_ids broadcasting crash
762c3ac

Kunalv commited on

fix: correctly extract input_ids from BatchEncoding UserDict to prevent generate shape crash
5dbfbb6

Kunalv commited on

fix: pass only input_ids to Core Router generate to prevent PyTorch attention shape mismatch
3c0b10f

Kunalv commited on

fix: use eager attention for MiniCPM4.1-8B to prevent SDPA crash, fix Nemotron Parse processor format
32bc132

Kunalv commited on

fix: add cv2/albumentations for Nemotron Parse, fix Core Router generate kwargs shape error
7d2d8f9

Kunalv commited on

fix: switch Core Router to AutoModelForCausalLM for generate support, fix Nemotron Parse inference with AutoProcessor
bb9bc8a

Kunalv commited on

fix: block flash_attn at runtime with sys.modules=None to prevent FA2 on HF ZeroGPU where flash_attn is pre-installed
9fc5c52

Kunalv commited on

fix: resolve infinite recursion in flash_attn patch by capturing original get_imports before patching
70f54cc

Kunalv commited on

fix: replace flash_attn mock with get_imports patch to properly disable FA2 for MiniCPM4.1-8B and Nemotron Parse
d006ae4

Kunalv commited on

fix: use correct AutoModelForImageTextToText+AutoProcessor for MiniCPM-V-4.6, eager attn for Core Router
ed8a9e5

Kunalv commited on

fix: use AutoModelForCausalLM for vision, add sdpa attn for Core Router, add open_clip_torch dep
4816f79

Kunalv commited on

fix: correct vision model dtype, Nemotron Parse model ID, and patch missing is_torch_fx_available
4e3a057

Kunalv commited on

fix: implement lazy loading for Core Router to prevent Space startup timeout
a81525d

Kunalv commited on

fix: correct MiniCPM-V-4.6 model ID and switch Core Router to AutoModel to resolve ModelWrapper crash
b0584e4

Kunalv commited on

fix: resolve Core Router crash by removing attn_implementation override on MiniCPM4.1-8B
1dbf78e

Kunalv commited on

feat: add OpenBMB Core Router (MiniCPM4.1-8B) and wire it to Gradio UI
e074efd

Kunalv commited on