AndrewRqy commited on
Commit Β·
fd741cf
1
Parent(s): 05d71bb
Claim π¦ Llama Champion badge β GGUF + llama-cpp-python path is shipped
Browse files
README.md
CHANGED
|
@@ -70,6 +70,7 @@ models:
|
|
| 70 |
| π¨ **Off-Brand** | ~2000 lines of bespoke CSS, Press Start 2P + VT323 fonts, hand-painted pixel-art sprites, custom story-tree visualization, custom ending banner. No stock Gradio chrome reaches the page. |
|
| 71 |
| π **Field Notes** | Blog post: https://huggingface.co/blog/AndrewRqy/apprentice-blog-url β
Repo mirror: [`docs/FIELD_NOTES_apprentice.md`](../docs/FIELD_NOTES_apprentice.md) β a build diary covering what we designed and what broke. |
|
| 72 |
| π‘ **Sharing-is-Caring** | [`traces/sample/`](traces/sample/) β JSONL captures of every LLM call from a real playthrough (prompts, responses, latency, token usage, both requested and returned model id). LLM-call tracing is default-on; opt out with `ORACLES_TRACE_DISABLE=1`. |
|
|
|
|
| 73 |
| β‘ **Tiny Titan** | Same 23k corpus trained into a Qwen2.5-1.5B LoRA (~$5.50, ~1.5h on H100). Eligible for the β€4B prize. |
|
| 74 |
|
| 75 |
## Running it
|
|
|
|
| 70 |
| π¨ **Off-Brand** | ~2000 lines of bespoke CSS, Press Start 2P + VT323 fonts, hand-painted pixel-art sprites, custom story-tree visualization, custom ending banner. No stock Gradio chrome reaches the page. |
|
| 71 |
| π **Field Notes** | Blog post: https://huggingface.co/blog/AndrewRqy/apprentice-blog-url β
Repo mirror: [`docs/FIELD_NOTES_apprentice.md`](../docs/FIELD_NOTES_apprentice.md) β a build diary covering what we designed and what broke. |
|
| 72 |
| π‘ **Sharing-is-Caring** | [`traces/sample/`](traces/sample/) β JSONL captures of every LLM call from a real playthrough (prompts, responses, latency, token usage, both requested and returned model id). LLM-call tracing is default-on; opt out with `ORACLES_TRACE_DISABLE=1`. |
|
| 73 |
+
| π¦ **Llama Champion** | The LoRA-merged Qwen2.5-14B is exported to GGUF (Q4_K_M, ~8.4 GB) via the conversion job in [`modal_backend/modal_gguf_convert.py`](../modal_backend/modal_gguf_convert.py) and runs locally through `llama-cpp-python`'s OpenAI-compatible server. Launch with `./run.sh --local-llama` β no Modal call required. |
|
| 74 |
| β‘ **Tiny Titan** | Same 23k corpus trained into a Qwen2.5-1.5B LoRA (~$5.50, ~1.5h on H100). Eligible for the β€4B prize. |
|
| 75 |
|
| 76 |
## Running it
|