The Ultra-Scale Playbook
🌌
3.9k
The ultimate guide to training LLM on large GPU Clusters
Anshuman Mishra
shivance
AI & ML interests
NLP;
Recent Activity
liked a Space 1 day ago
nanotron/ultrascale-playbook upvoted an article 10 months ago
Thinking Outside the Attention Box: Introducing Gated Associative Memory (GAM) published a model 10 months ago
shivance/trained-flux-loraOrganizations
liked a
Space 1 day ago
upvoted an article 10 months ago
Article
Thinking Outside the Attention Box: Introducing Gated Associative Memory (GAM)
rishiraj
• • 5 published 2
models 10 months ago
published an article 11 months ago
Article
Post training a LLM for reasoning with GRPO using Unsloth
shivance
• • 2 posted an update about 1 year ago
Post
1747
The AI Memory Layer Will Change Everything ‼️
Why do even the smartest AIs like OpenAI's o3 and GPT-4o, Google's Gemini and Anthropic's Claude forget?
In this blog we unpack this challenge and explore how building a real memory into AI will redefine personalization and agent capabilities!
https://fullstackagents.substack.com/p/forget-me-not-the-ai-memory-layer
Why do even the smartest AIs like OpenAI's o3 and GPT-4o, Google's Gemini and Anthropic's Claude forget?
In this blog we unpack this challenge and explore how building a real memory into AI will redefine personalization and agent capabilities!
https://fullstackagents.substack.com/p/forget-me-not-the-ai-memory-layer
upvoted a paper almost 2 years ago
replied to their post over 2 years ago
Flutter is not only cool but also widely used! The perks are similar to JS and easy to pick up. The part I love the most about it is programming interfaces without the usage of UI templating like XML. The cross-platform thing is another big plus.
I've been thinking about bringing quantized models to edge for inference and trying some stuff around it. If it's a success, then it might change the game at edge enabling developers to leverage power of HF.
replied to their post over 2 years ago
Awesome! I too learnt Flutter ~3 yrs ago during a hackathon :P
posted an update over 2 years ago
Post
Hi Community!
I'm ecstatic to announce Flutter SDK for HuggingFace Inference APIs. The project is open-source and can be found at https://github.com/shivance/huggingface.dart . I have also created a sample Flutter App that does language translation using HuggingFace's Helsinki-NLP/opus-mt-ru-en" model. Below is the video demo.
## Why Flutter?
Flutter is an open-source UI software development kit created by Google. It is used to develop cross-platform applications from a single codebase for any Web Browser, Android, iOS, Linux, macOS, and Windows.
Over the past few years, the framework has grown a lot of popularity.
## Mission
This is a small step-stone to bring Open Source Machine Learning to the edge and thus make AI more accessible. This project, at the time of writing, supports only NLP APIs, I'll slowly add other modalities too.
I'm ecstatic to announce Flutter SDK for HuggingFace Inference APIs. The project is open-source and can be found at https://github.com/shivance/huggingface.dart . I have also created a sample Flutter App that does language translation using HuggingFace's Helsinki-NLP/opus-mt-ru-en" model. Below is the video demo.
## Why Flutter?
Flutter is an open-source UI software development kit created by Google. It is used to develop cross-platform applications from a single codebase for any Web Browser, Android, iOS, Linux, macOS, and Windows.
Over the past few years, the framework has grown a lot of popularity.
## Mission
This is a small step-stone to bring Open Source Machine Learning to the edge and thus make AI more accessible. This project, at the time of writing, supports only NLP APIs, I'll slowly add other modalities too.
- 7 replies
haha
liked a
model over 2 years ago
published an article over 2 years ago
Article
Illustrated LLM OS: An Implementational Perspective
shivance
• • 31 liked a
dataset over 2 years ago
liked a
model over 2 years ago
