DiabeticDaily-9B / README.md
SwarmandBee's picture
Upload README.md with huggingface_hub
b2ef912 verified
|
Raw
History Blame Contribute Delete
1.5 kB
metadata
license: apache-2.0
base_model: Qwen/Qwen3.5-9B
tags:
  - diabetes
  - medical
  - healthcare
  - diabetic-lifestyle
  - edge-ai
  - sovereign
library_name: transformers
pipeline_tag: text-generation

DiabeticDaily-9B 🐝🏠

The home-box tier of the OpenDiabetic ladder β€” distilled-class diabetic intelligence sized to run on a home appliance (NAS + a low-power GPU like the RTX PRO 2000 Blackwell, ~70W). Cooked by Swarm and Bee LLC.

Beat-base β€” proven

Held-out perplexity vs base Qwen3.5-9B (text never trained on):

held-out loss perplexity
Base Qwen3.5-9B 1.3625 3.906
DiabeticDaily-9B 0.8079 2.243
Ξ” βˆ’0.555 (+40.7% better)

Verdict: BEAT BASE βœ…. Models the domain ~41% better than base β€” and its perplexity (2.24) is nearly the 27B anchor's (2.05): the knowledge survives the shrink. That's the distillation-ladder thesis, proven.

How it was cooked

  • Base: Qwen/Qwen3.5-9B (Apache-2.0). Data: the same deeded OpenDiabetic corpus as the 27B anchor.
  • Recipe: LoRA r64/Ξ±32 on attn+mlp, LR 1e-5, cosine, early-stop overcook guard. Merged bf16.

The ladder: 🐝 27B anchor (+57%) β†’ 🏠 9B home (+40.7%) β†’ πŸ›οΈ 4B edge (+40.4%)

⚠️ Not medical advice β€” diabetic lifestyle/education/organization only. Not a diagnosis. Emergencies β†’ 911.

© 2026 Swarm and Bee LLC · opendiabetic.com · Apache-2.0 · We slow cook the truth. 🐝