gowtham0992 commited on
Commit
86b65d8
·
verified ·
1 Parent(s): 1437c23

Add HF community evidence thread

Browse files
Files changed (1) hide show
  1. docs/hf-community-discussion.md +69 -0
docs/hf-community-discussion.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Jawbreaker Submission Package
2
+
3
+ Jawbreaker is a private scam-defense app for someone you love.
4
+
5
+ It is built for the moment before someone clicks a suspicious link, replies to an impersonator, shares a code, calls an unknown number, or sends money. The motivating user is a friend's grandmother who had already been affected by scam messages; private identity and message details are intentionally omitted.
6
+
7
+ ## Main Links
8
+
9
+ - Live Space: https://huggingface.co/spaces/build-small-hackathon/jawbreaker
10
+ - Final model adapter: https://huggingface.co/build-small-hackathon/jawbreaker-minicpm5-1b-lora-v8
11
+ - Dataset/eval bundle: https://huggingface.co/datasets/build-small-hackathon/jawbreaker-scam-defense-data
12
+ - Collection: https://huggingface.co/collections/build-small-hackathon/jawbreaker-6a263632dcd0b6d41ca914ff
13
+ - GitHub repo: https://github.com/gowtham0992/jawbreaker
14
+ - Article draft: https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/docs/huggingface-article-draft.md
15
+
16
+ ## Model + Runtime
17
+
18
+ - Base model: `openbmb/MiniCPM5-1B`
19
+ - Adapter: `build-small-hackathon/jawbreaker-minicpm5-1b-lora-v8`
20
+ - Runtime: Hugging Face ZeroGPU, direct Transformers inference
21
+ - Training/eval: Modal A100 PEFT/LoRA runs
22
+ - No external hosted LLM API is used in the scam-analysis path
23
+
24
+ ## Final Eval Evidence
25
+
26
+ Final guarded hard-suite report:
27
+
28
+ https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/eval/reports/jawbreaker-minicpm5-1b-lora-v8-hard632-safetyguard-v4.json
29
+
30
+ Headline metrics:
31
+
32
+ - Cases: 632
33
+ - Risk accuracy: 579/632, 91.61%
34
+ - Scam type accuracy: 561/632, 88.77%
35
+ - Mean tactic recall: 90.69%
36
+ - Dangerous as safe: 0
37
+ - Dangerous as needs_check: 0
38
+ - Safe as dangerous or suspicious: 0
39
+ - Unsafe action violations: 0
40
+ - Invalid predictions: 0
41
+ - Model errors: 0
42
+
43
+ ## Evidence Docs
44
+
45
+ - Field notes: https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/FIELD_NOTES.md
46
+ - Codex evidence: https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/CODEX_JUDGE_EVIDENCE.md
47
+ - Build log: https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/CODEX_BUILD_LOG.md
48
+ - Honest submission guardrails: https://huggingface.co/spaces/build-small-hackathon/jawbreaker/blob/main/HONEST_SUBMISSION.md
49
+
50
+ ## Claimed Fit
51
+
52
+ - Backyard AI: real family-safety workflow for scam defense
53
+ - Best MiniCPM Build: MiniCPM5-1B is the live model family
54
+ - Well-Tuned: published MiniCPM5-1B LoRA adapter and eval suite
55
+ - Tiny Titan: 1B model under the 4B threshold
56
+ - Off the Grid: no external hosted LLM API in the analysis path
57
+ - Off Brand: custom Gradio Server UI, not stock component layout
58
+ - Sharing is Caring: public model, dataset/evals, collection, build docs
59
+ - Field Notes: product/model/runtime decisions documented
60
+ - Modal: training and guarded eval runs on Modal A100
61
+ - Codex/OpenAI: public GitHub with Codex-attributed commits and file-level evidence
62
+
63
+ ## Remaining Public Story Work
64
+
65
+ - Demo video: pending
66
+ - Social post: pending
67
+ - Hugging Face Article: drafted, pending publication through the Articles UI
68
+
69
+ The current submission is intended to be judged from the live Space plus the public model/dataset/collection/GitHub evidence above.