Production-ready: VRAM-sized batches, frontend API URL fix, repo hygiene 7ac44e4 Luturtun Claude Opus 4.8 commited on 22 days ago
Add temporary /api/debug/gpu to read real VRAM for batch sizing 0e61f52 Luturtun Claude Opus 4.8 commited on 22 days ago
Symmetric encoder batching: ENC_BATCH cap + chunking + GPU probe 0204ef7 Luturtun Claude Opus 4.8 commited on 23 days ago
Encoder: use batch word_ids (drop per-sentence re-tokenize); per-model DEC_BATCH + GPU probe 7dc0517 Luturtun Claude Opus 4.8 commited on 23 days ago
Fix encoder LoRA scaling (read alpha from ckpt); chunk decoder batch 246db50 Luturtun Claude Opus 4.8 commited on 23 days ago
Replace models: new encoder + gemma-3-1b/qwen3 decoders, drop llama3 34cc2e8 Luturtun commited on 23 days ago