Hugging Face's logo
fahrizalfarid's picture
In a Training Loop 🔄
13 14 93

fahrizalfarid

akahana
sundarshanmu's profile picture 21world's profile picture piercus's profile picture
·

AI & ML interests

NLP

Recent Activity

upvoted an article 4 days ago
Reverse Engineering a $500M Mystery: From HashHop to Memory-Augmented Language Models
reacted to codelion's post with 🔥 4 days ago
Reverse Engineering a $500M Mystery: From HashHop to Memory-Augmented Language Models I wrote a deep dive into how Magic AI's 100M token context window might work, starting from their HashHop benchmark and building up to MALM - a Memory-Augmented Language Model. Key insight: treating each key as a single token enables perfect retrieval at unlimited context lengths. The article covers: - How HashHop works and why its perfect accuracy is suspicious - Building a tokenized solver that achieves 100% accuracy - Scaling to MALM for real code search tasks - Why this approach could handle 100M+ tokens Read the full article: https://huggingface.co/blog/codelion/reverse-engineering-magic-hashhop Try the model: https://huggingface.co/codelion/malm-165m Code: https://github.com/codelion/hash-hop
updated a model 9 days ago
akahana/indo-psikologi-sft
View all activity

Organizations

None yet