vivamais / tests /unit /adapters /test_llama_cpp.py

Commit History

Update vision GGUF variant test to v1 fine-tune defaults
5d9d524

marinarosa commited on

Shrink QA context to fit the T4 alongside other models
87bb93a

marinarosa commited on

Raise Q&A max output tokens to 2048
c7d2fe9

marinarosa commited on

Delete the legacy trip/payment/document model and instructor
49321ce

marinarosa commited on

Extract reasoning-strip helpers out of the llama.cpp adapter
8e0632f

marinarosa commited on

Force llama.cpp to CPU whenever SPACES_ZERO_GPU is set
3fa468f

marinarosa commited on

Enable flash attention on GPU to fix NaN logits on the T4
7b1a0eb

marinarosa commited on

Auto-offload llama.cpp layers when a CUDA build is present
9e8f6a7

marinarosa commited on

Serialize model inference; cut Q&A cost to shorten lock holds
2fc9900

marinarosa commited on

Drop ZeroGPU: llama.cpp on CPU is the only runtime
9b0692a

marinarosa commited on

Tune MiniCPM5 Q&A: low temperature, 32k context, filtered thinking
79ca53e

marinarosa commited on

Apply ruff format across the repository
70b9afb

marinarosa commited on

Harden OCR parsing with JSON grammar, payer rule, and doc detection
59b6937

marinarosa commited on

Improve extraction quality with higher resolution, better ordering, and text enrichment
3c9d2f2

marinarosa commited on

Revert hallucination reduction layers 2-6
77f326d

marinarosa commited on

Add logit-based confidence flag for vision extraction observability
eec3111

marinarosa commited on

Add two-pass verification for low-confidence extractions
d47f02d

marinarosa commited on

Re-enable Instructor retries for vision extraction
64bc597

marinarosa commited on

Fix vision thinking blocks with raw JSON fallback (T9)
235f9d9

marinarosa commited on

Skip local GGUF integration tests unless explicitly enabled
892690e

marinarosa commited on

Add Instructor JSON schema vision extraction
f2d7be8

marinarosa commited on

Recover trips with ticket-first vision extraction
fe91b33

marinarosa commited on

Ship CUDA runtime libs for llama-cpp on ZeroGPU
f4de321

marinarosa commited on

Enable CUDA llama-cpp in ZeroGPU vision workers
8e0eeee

marinarosa commited on

Remove MiniCPM-V 4.5 backend entirely
479248b

marinarosa commited on

Fix ZeroGPU vision timeout with per-image GPU slots
b7ba3af

marinarosa commited on

Drop progress callback from ZeroGPU vision batch
3af2825

marinarosa commited on

Fix ZeroGPU batch duration arg order on upload
32923bb

marinarosa commited on

Add dual-variant llama.cpp adapter for MiniCPM-V 4.6 and 4.5
090d639

marinarosa commited on

Pivot to CPU-only: transformers_cpu adapter, streaming UI, remove legacy backends
b761c48

marinarosa commited on

Switch to MiniCPM-V-4.6-Thinking GGUF across all adapters (A6 / T11)
9d9d52c

marinarosa commited on

Bind batch_process to LlamaCppVisionModel (A1)
95e3b97

marinarosa commited on

Lazy-load LlamaCppBackend: defer model download to first use
a1d43a5

marinarosa commited on

Add llama.cpp adapter tests: unit helpers + guarded integration
af8446f

marinarosa commited on