Running on CPU Upgrade Featured 3.35k The Smol Training Playbook 📚 3.35k The secrets to building world-class LLMs
Falcon-H1 Collection Falcon-H1 Family of Hybrid-Head Language Models (Transformer-SSM), including 0.5B, 1.5B, 1.5B-Deep, 3B, 7B, and 34B (pretrained & instruction-tuned). • 33 items • Updated Aug 13 • 60
Running on CPU Upgrade 14.2k Open LLM Leaderboard 🏆 14.2k Track, rank and evaluate open LLMs and chatbots
Falcon3 Collection Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters. • 40 items • Updated Aug 13 • 95
Falcon Mamba: The First Competitive Attention-free 7B Language Model Paper • 2410.05355 • Published Oct 7, 2024 • 38
Falcon Mamba: The First Competitive Attention-free 7B Language Model Paper • 2410.05355 • Published Oct 7, 2024 • 38
Runtime error Agents Featured 65 Falcon Mamba Playground 🐍 65 Generate chat responses using FalconMamba-7b model
FalconMamba 7B Collection This collection features the FalconMamba 7B base model, the instruction-tuned version, their 4-bit and GGUF variants, and the demo. • 15 items • Updated Aug 13 • 35
view article Article Welcome Falcon Mamba: The first strong attention-free 7B model +4 JingweiZuo, yellowvm, DhiyaEddine, IChahed, ybelkada, Gkunsch • Aug 12, 2024 • 114