PhysiQuanty's picture

PhysiQuanty PRO

PhysiQuanty

AI & ML interests

Theoretical Physics, Invariant Tokenization, Standard Model of Particle Physics Applied ML (coming soon)

Recent Activity

reacted to SeaWolf-AI's post with 🔥 about 1 hour ago
🧬 Darwin Family: Zero Gradient Steps, GPQA Diamond 88.89% How far can we push LLM reasoning *without* training? Our team at VIDRAFT submitted this paper to Daily Papers yesterday, and it's currently #3. Huge thanks to everyone who upvoted — sharing the core ideas below. 🔗 Paper: https://huggingface.co/papers/2605.14386 🔗 arXiv: https://arxiv.org/abs/2605.14386 🔗 Model: https://huggingface.co/FINAL-Bench/Darwin-28B-Opus --- TL;DR Darwin Family is a training-free evolutionary merging framework. By recombining the weight spaces of existing LLM checkpoints — with zero gradient-based training — it reaches frontier-level reasoning. - 🏆 Darwin-28B-Opus: GPQA Diamond 88.89% - 💸 Zero gradient steps — not a single B200 or H200 hour needed - 🧬 Consistent gains across 4B → 35B scale - 🔀 Cross-architecture breeding between Transformer and Mamba families - 🔁 Stable recursive multi-generation evolution #Three Core Mechanisms ① 14-dim Adaptive Merge Genome — fine-grained recombination at both component level (Attention / FFN / MLP / LayerNorm / Embedding) and block level, expanding the prior evolutionary-merge search space. ② MRI-Trust Fusion — we diagnose each layer's reasoning contribution via an **MRI (Model Reasoning Importance)** signal and fuse it with evolutionary search through a **learnable trust parameter**. Trust the diagnostic too much and search collapses; ignore it and search becomes inefficient — Darwin learns the balance from data. ③ Architecture Mapper — weight-space breeding across heterogeneous families. Attention × SSM crossover actually works. Why It Matters > Diagnose latent capabilities already encoded in open checkpoints, > and recombine them — no gradients required. Replies and critiques welcome 🙌
View all activity

Organizations

Sorbonne Université's profile picture scikit-learn's profile picture Tamazight NLP's profile picture Hugging Face Discord Community's profile picture Reasoning datasets competition 's profile picture MCP-1st-Birthday's profile picture PhysiAI's profile picture INPI-France's profile picture Patenty-1-DataSet's profile picture Patenty1-DataSet-US's profile picture Physi-Wiki's profile picture SKT AI LABS's profile picture Humanity's Last Hackathon's profile picture SpiceeChat's profile picture