optiquant Claude Opus 4.8 (1M context) commited on
Commit
b5dee12
Β·
1 Parent(s): d11afff

README/write-up: surface demo CTA, claim Tiny Titan, link field notes

Browse files

Address the friendly-review feedback: promote the live-demo link to a
prominent CTA under the title, foreground the Tiny Titan (<=4B) claim in
the badge line and merit-badges section, and add a closing field-notes
pointer. Launch-post link confirmed correct (review's "broken" flag was
an X bot-wall false positive).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

README.md CHANGED
@@ -20,9 +20,11 @@ tags:
20
 
21
  **Dump everything on your mind β€” get back what to do *first*, with the math shown.**
22
 
23
- [**β–Ά Live demo**](https://huggingface.co/spaces/build-small-hackathon/whatfirst-small) &nbsp;Β·&nbsp; [πŸ“£ Launch post](https://x.com/tbd_ntbd/status/2066222870657692128) &nbsp;Β·&nbsp; [what-first.com](https://what-first.com) &nbsp;Β·&nbsp; Apache-2.0
24
 
25
- 🀏 **3B params** (≀ 4B) &nbsp;Β·&nbsp; πŸ”Œ **runs 100% offline** β€” no internet required &nbsp;Β·&nbsp; πŸ¦™ llama.cpp
 
 
26
 
27
  A small **local** vision-language model (Qwen2.5-VL-3B, ~2 GB, running on
28
  llama.cpp) reads a messy brain-dump or a photo of a to-do list and turns each
@@ -104,3 +106,8 @@ python -m pytest test_score.py # or: python test_score.py
104
  (Q4_K_M + f16 mmproj), ≀ 32B and laptop-runnable.
105
  - **Off the grid:** all inference is local llama.cpp over localhost; nothing
106
  leaves the box at runtime.
 
 
 
 
 
 
20
 
21
  **Dump everything on your mind β€” get back what to do *first*, with the math shown.**
22
 
23
+ ### [β–Ά Try the live demo](https://huggingface.co/spaces/build-small-hackathon/whatfirst-small)
24
 
25
+ 🀏 **3B params** (≀ 4B β€” *Tiny Titan*) &nbsp;Β·&nbsp; πŸ”Œ **runs 100% offline** β€” no internet required &nbsp;Β·&nbsp; πŸ¦™ llama.cpp
26
+
27
+ [πŸ“£ Launch post](https://x.com/tbd_ntbd/status/2066222870657692128) &nbsp;Β·&nbsp; [what-first.com](https://what-first.com) &nbsp;Β·&nbsp; Apache-2.0
28
 
29
  A small **local** vision-language model (Qwen2.5-VL-3B, ~2 GB, running on
30
  llama.cpp) reads a messy brain-dump or a photo of a to-do list and turns each
 
106
  (Q4_K_M + f16 mmproj), ≀ 32B and laptop-runnable.
107
  - **Off the grid:** all inference is local llama.cpp over localhost; nothing
108
  leaves the box at runtime.
109
+
110
+ ---
111
+
112
+ πŸ““ **See the full story in our [field notes](submission/whatfirst-small-writeup.md)** β€”
113
+ what worked, where a 3B model wobbles, and how the design absorbs it.
submission/whatfirst-small-writeup.md CHANGED
@@ -79,6 +79,8 @@ Disagree with a score? Drag a slider and the list **re-ranks live** β€” the mode
79
 
80
  ## Merit badges
81
 
 
 
82
  **πŸ”Œ Off the Grid.** All inference is local llama.cpp over localhost. Nothing leaves the box at runtime β€” no cloud, no API keys. Your to-do list, including a photo of it, never travels.
83
 
84
  **πŸ¦™ Llama Champion.** The whole language stack is a llama.cpp `llama-server`, built from source in the container, serving a Qwen2.5-VL GGUF (text **and** vision) behind an OpenAI-compatible API.
 
79
 
80
  ## Merit badges
81
 
82
+ **🀏 Tiny Titan.** The entire app β€” brain-dump parsing, image reading, and live re-scoring β€” runs on a single 3B model (Qwen2.5-VL-3B), comfortably under the 4B line, on CPU.
83
+
84
  **πŸ”Œ Off the Grid.** All inference is local llama.cpp over localhost. Nothing leaves the box at runtime β€” no cloud, no API keys. Your to-do list, including a photo of it, never travels.
85
 
86
  **πŸ¦™ Llama Champion.** The whole language stack is a llama.cpp `llama-server`, built from source in the container, serving a Qwen2.5-VL GGUF (text **and** vision) behind an OpenAI-compatible API.