AndrewRqy commited on
Commit
fd741cf
Β·
1 Parent(s): 05d71bb

Claim πŸ¦™ Llama Champion badge β€” GGUF + llama-cpp-python path is shipped

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -70,6 +70,7 @@ models:
70
  | 🎨 **Off-Brand** | ~2000 lines of bespoke CSS, Press Start 2P + VT323 fonts, hand-painted pixel-art sprites, custom story-tree visualization, custom ending banner. No stock Gradio chrome reaches the page. |
71
  | πŸ““ **Field Notes** | Blog post: https://huggingface.co/blog/AndrewRqy/apprentice-blog-url β‹… Repo mirror: [`docs/FIELD_NOTES_apprentice.md`](../docs/FIELD_NOTES_apprentice.md) β€” a build diary covering what we designed and what broke. |
72
  | πŸ“‘ **Sharing-is-Caring** | [`traces/sample/`](traces/sample/) β€” JSONL captures of every LLM call from a real playthrough (prompts, responses, latency, token usage, both requested and returned model id). LLM-call tracing is default-on; opt out with `ORACLES_TRACE_DISABLE=1`. |
 
73
  | ⚑ **Tiny Titan** | Same 23k corpus trained into a Qwen2.5-1.5B LoRA (~$5.50, ~1.5h on H100). Eligible for the ≀4B prize. |
74
 
75
  ## Running it
 
70
  | 🎨 **Off-Brand** | ~2000 lines of bespoke CSS, Press Start 2P + VT323 fonts, hand-painted pixel-art sprites, custom story-tree visualization, custom ending banner. No stock Gradio chrome reaches the page. |
71
  | πŸ““ **Field Notes** | Blog post: https://huggingface.co/blog/AndrewRqy/apprentice-blog-url β‹… Repo mirror: [`docs/FIELD_NOTES_apprentice.md`](../docs/FIELD_NOTES_apprentice.md) β€” a build diary covering what we designed and what broke. |
72
  | πŸ“‘ **Sharing-is-Caring** | [`traces/sample/`](traces/sample/) β€” JSONL captures of every LLM call from a real playthrough (prompts, responses, latency, token usage, both requested and returned model id). LLM-call tracing is default-on; opt out with `ORACLES_TRACE_DISABLE=1`. |
73
+ | πŸ¦™ **Llama Champion** | The LoRA-merged Qwen2.5-14B is exported to GGUF (Q4_K_M, ~8.4 GB) via the conversion job in [`modal_backend/modal_gguf_convert.py`](../modal_backend/modal_gguf_convert.py) and runs locally through `llama-cpp-python`'s OpenAI-compatible server. Launch with `./run.sh --local-llama` β€” no Modal call required. |
74
  | ⚑ **Tiny Titan** | Same 23k corpus trained into a Qwen2.5-1.5B LoRA (~$5.50, ~1.5h on H100). Eligible for the ≀4B prize. |
75
 
76
  ## Running it