Spaces:
Sleeping
Sleeping
Commit History
-
Complete CPU GGUF serving + docs + minimal UI redesign
Serving: - Serve fine-tuned Phi-3 as a 4-bit Q4_K_M GGUF via llama.cpp (source-built llama-cpp-python 0.3.19); cap n_threads to the container's vCPU count. - Dockerfile builds llama-cpp-python from source against glibc (prebuilt wheels are musl-only for phi3-capable versions) with single-threaded compile to avoid build OOM. Frontend: - Redesign the web UI as a flat, minimal layout (no gradients/glass/glow), with a project stats panel, schema row counts, and an on-page FAQ. - Remove the unreliable base-model comparison; single fine-tuned result with a wall-clock timer and an accurate CPU banner. Docs + eval: - Add fine-tuning + quantization + deployment blog and HF model cards (docs/). - Add the execution-accuracy eval harness (scripts/eval_execution_accuracy.py). - Update repo README to reflect GGUF/CPU serving. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1d8be28
-
Revert "Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)"
This reverts commit 564ad28ca5effbb5f2390da477c1915c03fbc8ad.d031aeb -
Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)
564ad28