Hugging Face's logo
Batuhan S's picture

Batuhan S

Ba2han
6 4 198
ersintarhan's profile picture emirkaanozdemr's profile picture Limbicnation's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model about 10 hours ago
nvidia/Kimodo-SOMA-RP-v1.2
reacted to Avifenesh's post with 👀 2 days ago
I added a small gate to the Gated DeltaNet layers of Qwen3.5 and trained it with GRPO under a length penalty. On Qwen3.5-4B it reasons 48% shorter than LoRA on MATH-500, and anytime accuracy goes from 0.786 to 0.852. A LoRA with about the same parameter count barely moves. The gate sits on beta, the per-token write strength. One matrix per layer, zero init, so it starts as a no-op. It started as a negative eigenvalue experiment. The negative range turned out not to matter. The gate did. Write-up: https://huggingface.co/blog/Avifenesh/beta-gate-qwen35 Adapters: https://huggingface.co/collections/Avifenesh/gate-qwen35-6accb63081800b2f2d583b80 Code: https://github.com/avifenesh/gdn-beta-gatehttps://huggingface.co/collections/Avifenesh/gate-qwen35
updated a model 8 days ago
Ba2han/mini-qwen-next-model3-short-2b
View all activity

Organizations

None yet