add mmproj vision support

increase batch size

bring verbosity back

some experimental

increase batch size

bring back flash attention

experimental flash attention

fix verbose

fix balanced profile

fix balanced profile

update batch size

fix flash attention

max optimisation

optimised cpu

minor fixes

experimental boosting changes

remove parallel support for faster inference

Fix llama-server startup and enable LangSearch via shell tool

Optimize inference performance: add continuous-batching, NO_WARMUP support, improve thread/batch recommendations

Update start.sh

Add REASONING env toggle for llama-server reasoning mode

Save models using repo filename, set MODEL_PATH from marker, ensure HF xet log dirs writable

Auto-tune ctx-size, batch and cache types for low-memory (<=16GB) Spaces; export CACHE_TYPE_{K,V}

Add QUANT_PREFERENCE and PERF_PROFILE (low_latency/balanced/throughput) with server defaults

Add startup phase logs and avoid recursive permission setup

Support CONTEXT_LENGTH env var (default 4096) for ctx-size

Add optimized llama.cpp CPU inference backend