Spaces:
Runtime error
Runtime error
README/write-up: surface demo CTA, claim Tiny Titan, link field notes
Browse filesAddress the friendly-review feedback: promote the live-demo link to a
prominent CTA under the title, foreground the Tiny Titan (<=4B) claim in
the badge line and merit-badges section, and add a closing field-notes
pointer. Launch-post link confirmed correct (review's "broken" flag was
an X bot-wall false positive).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
- README.md +9 -2
- submission/whatfirst-small-writeup.md +2 -0
README.md
CHANGED
|
@@ -20,9 +20,11 @@ tags:
|
|
| 20 |
|
| 21 |
**Dump everything on your mind β get back what to do *first*, with the math shown.**
|
| 22 |
|
| 23 |
-
[
|
| 24 |
|
| 25 |
-
π€ **3B params** (β€ 4B) Β· π **runs 100% offline** β no internet required Β· π¦ llama.cpp
|
|
|
|
|
|
|
| 26 |
|
| 27 |
A small **local** vision-language model (Qwen2.5-VL-3B, ~2 GB, running on
|
| 28 |
llama.cpp) reads a messy brain-dump or a photo of a to-do list and turns each
|
|
@@ -104,3 +106,8 @@ python -m pytest test_score.py # or: python test_score.py
|
|
| 104 |
(Q4_K_M + f16 mmproj), β€ 32B and laptop-runnable.
|
| 105 |
- **Off the grid:** all inference is local llama.cpp over localhost; nothing
|
| 106 |
leaves the box at runtime.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
**Dump everything on your mind β get back what to do *first*, with the math shown.**
|
| 22 |
|
| 23 |
+
### [βΆ Try the live demo](https://huggingface.co/spaces/build-small-hackathon/whatfirst-small)
|
| 24 |
|
| 25 |
+
π€ **3B params** (β€ 4B β *Tiny Titan*) Β· π **runs 100% offline** β no internet required Β· π¦ llama.cpp
|
| 26 |
+
|
| 27 |
+
[π£ Launch post](https://x.com/tbd_ntbd/status/2066222870657692128) Β· [what-first.com](https://what-first.com) Β· Apache-2.0
|
| 28 |
|
| 29 |
A small **local** vision-language model (Qwen2.5-VL-3B, ~2 GB, running on
|
| 30 |
llama.cpp) reads a messy brain-dump or a photo of a to-do list and turns each
|
|
|
|
| 106 |
(Q4_K_M + f16 mmproj), β€ 32B and laptop-runnable.
|
| 107 |
- **Off the grid:** all inference is local llama.cpp over localhost; nothing
|
| 108 |
leaves the box at runtime.
|
| 109 |
+
|
| 110 |
+
---
|
| 111 |
+
|
| 112 |
+
π **See the full story in our [field notes](submission/whatfirst-small-writeup.md)** β
|
| 113 |
+
what worked, where a 3B model wobbles, and how the design absorbs it.
|
submission/whatfirst-small-writeup.md
CHANGED
|
@@ -79,6 +79,8 @@ Disagree with a score? Drag a slider and the list **re-ranks live** β the mode
|
|
| 79 |
|
| 80 |
## Merit badges
|
| 81 |
|
|
|
|
|
|
|
| 82 |
**π Off the Grid.** All inference is local llama.cpp over localhost. Nothing leaves the box at runtime β no cloud, no API keys. Your to-do list, including a photo of it, never travels.
|
| 83 |
|
| 84 |
**π¦ Llama Champion.** The whole language stack is a llama.cpp `llama-server`, built from source in the container, serving a Qwen2.5-VL GGUF (text **and** vision) behind an OpenAI-compatible API.
|
|
|
|
| 79 |
|
| 80 |
## Merit badges
|
| 81 |
|
| 82 |
+
**π€ Tiny Titan.** The entire app β brain-dump parsing, image reading, and live re-scoring β runs on a single 3B model (Qwen2.5-VL-3B), comfortably under the 4B line, on CPU.
|
| 83 |
+
|
| 84 |
**π Off the Grid.** All inference is local llama.cpp over localhost. Nothing leaves the box at runtime β no cloud, no API keys. Your to-do list, including a photo of it, never travels.
|
| 85 |
|
| 86 |
**π¦ Llama Champion.** The whole language stack is a llama.cpp `llama-server`, built from source in the container, serving a Qwen2.5-VL GGUF (text **and** vision) behind an OpenAI-compatible API.
|