STomoya/nyannyan_blip2_captions
Viewer โข Updated โข 296 โข 25
Tomoya Sawada
STomoya
ยท
AI & ML interests
CV, illustration.
Recent Activity
liked a Space 27 days ago
llm-jp/open-japanese-llm-leaderboard-v2 reacted to SeaWolf-AI's post with ๐ about 1 month ago
Why This Matters โ David Defeats Goliath
MODEL: https://huggingface.co/FINAL-Bench/Darwin-4B-David
SPACE: https://huggingface.co/spaces/FINAL-Bench/Darwin-4B-david
We're releasing Darwin-4B-David, the first second-generation model in the Darwin Opus family. By evolving an already-evolved model, it achieves 85.0% on GPQA Diamond โ surpassing its 58.6% original ancestor and even gemma-4-31B (84.3%) โ with just 4.5B parameters.
Second-Generation Evolution
Most merges start from a base model and produce a single offspring. Darwin-4B-David breaks this pattern. The Father (Darwin-4B-Opus) was already evolved from gemma-4-E4B-it with Claude Opus reasoning distillation โ a Gen-1 model. The Mother (DavidAU's DECKARD-Expresso-Universe) brings Unsloth deep tuning across 5 in-house datasets with thinking mode by default. Crossbreeding these two produced the first Gen-2 Darwin model.
Darwin V6's Model MRI scanned both parents across all 42 layers, assigning independent optimal ratios per layer. The Mother's creativity and Korean language hotspot (Layer 22-25, weight 0.95) was maximally absorbed, while the Father's reasoning core (Layer 30-40, weight 0.48) was preserved. This is "Merge = Evolve" applied recursively โ evolution of evolution.
Benchmarks
Darwin-4B-David scores 85.0% on GPQA Diamond (+26.4%p over original 58.6%), evaluated generatively with maj@8 (8 generations per question, majority vote), Epoch AI prompt format, thinking mode enabled, 50 sampled questions. On ARC-Challenge (25-shot, loglikelihood), both score 64.93% โ expected, as loglikelihood doesn't capture thinking-mode reasoning differences.
Why This Matters
gemma-4-31B (30.7B) scores 84.3%. Darwin-4B-David surpasses it at 1/7th the size โ no training, no RL, just 45 minutes of MRI-guided DARE-TIES on one H100. The name "David" honors Mother creator DavidAU and evokes David vs. Goliath.
liked a dataset 2 months ago
nvidia/Nemotron-Cascade-2-SFT-DataOrganizations
None yet