inference / download_model.py

Commit History

add mmproj vision support
b704285

0xarchit commited on

experimental boosting changes
434da24

0xarchit commited on

Use temp download dir and robust rmtree handler to avoid permission errors on cleanup
b3c9994

0xarchit commited on

Save models using repo filename, set MODEL_PATH from marker, ensure HF xet log dirs writable
885a74c

0xarchit commited on

Allow MODEL_FILE override; improve diagnostics when no .gguf files present
f237530

0xarchit commited on

Add QUANT_PREFERENCE and PERF_PROFILE (low_latency/balanced/throughput) with server defaults
f5bcacf

0xarchit commited on

Add model list and download progress logging
4f49659

0xarchit commited on

Speed up model download by selecting one GGUF
3a93362

0xarchit commited on

Add optimized llama.cpp CPU inference backend
8ebf335

0xarchit commited on