Hugging Face's logo
s3nh's picture
šŸ¤ Open to Collab

s3nh

s3nh
87 18 296
drak-hf's profile picture merve's profile picture icedreamot's profile picture
Ā·

AI & ML interests

Quantization, LLMs, Deep Learning for good. Follow me if you like my work. Patreon.com/s3nh

Recent Activity

reacted to raincandy-u's post with šŸ‘ 12 days ago
20K parameters can tell a story. šŸš€ šŸ¤— We trained a ~20k-parameter Transformer that can actually write stories! https://huggingface.co/raincandy-u/MacroStories ā†’ ~50Ɨ smaller than the 1M-parameter TinyStories model ā†’ ~3,000Ɨ smaller than AlexNet ā†’ 81 KB in FP32 yayyy the whole model. ą«® Ė¶įµ” įµ• įµ”Ė¶ įƒ She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block ā€” recurrently applied 4 times with shared weights. Despite having only 19,969 parameters, she can maintain a simple narrative across 100ā€“300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome. She runs extremely fast on CPU ā€” no GPU required. The entire model is tiny enough to load almost instantly! ā˜ŗļø
reacted to raincandy-u's post with šŸ”„ 12 days ago
20K parameters can tell a story. šŸš€ šŸ¤— We trained a ~20k-parameter Transformer that can actually write stories! https://huggingface.co/raincandy-u/MacroStories ā†’ ~50Ɨ smaller than the 1M-parameter TinyStories model ā†’ ~3,000Ɨ smaller than AlexNet ā†’ 81 KB in FP32 yayyy the whole model. ą«® Ė¶įµ” įµ• įµ”Ė¶ įƒ She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block ā€” recurrently applied 4 times with shared weights. Despite having only 19,969 parameters, she can maintain a simple narrative across 100ā€“300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome. She runs extremely fast on CPU ā€” no GPU required. The entire model is tiny enough to load almost instantly! ā˜ŗļø
liked a model about 1 month ago
LBH-123-AI/Minimax_h3_latent_Upscaler
View all activity

Organizations

ESPnet's profile picture Gradio-Blocks-Party's profile picture Lajonbot's profile picture Blog-explorers's profile picture AblateIt's profile picture CyberHarem's profile picture HydraLM's profile picture The Waifu Research Department's profile picture BangumiBase's profile picture ZeroGPU Explorers's profile picture Social Post Explorers's profile picture That Time I got Reincarnated as a Hugging Face Organization's profile picture Spinner-GPT-4's profile picture Hugging Face Discord Community's profile picture open/ acc's profile picture Smol Community's profile picture Blue Collard Hard Working Class's profile picture Hugging Science's profile picture Slayer - Applied Research Lab's profile picture