Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 60
Hemanth Sai Garladinne
HemanthSai7
AI & ML interests
Audio ML and Natural Language Processing
Recent Activity
upvoted a paper about 19 hours ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention liked a model 26 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT liked a model about 1 month ago
FrontiersMind/Nandi-Mini-600M-GuardRailsOrganizations
upvoted a paper about 19 hours ago
liked a
model 26 days ago
liked 2
models about 1 month ago
liked a
model 2 months ago
upvoted an article 2 months ago
Article
How I contributed a new model to the Transformers library using Codex
nielsr
• • 52 liked a
model 2 months ago
liked a
model 3 months ago
updated a
model 3 months ago
liked a
Space 3 months ago
Unsafe File
#7 opened 4 months ago
by HemanthSai7
upvoted an article 4 months ago
Article
The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix
codelion
• • 65 updated a
dataset 5 months ago
published a
dataset 5 months ago
liked 3
Spaces 6 months ago
upvoted a paper 6 months ago
liked a
Space 8 months ago
commented on Deploying Your FastAPI Applications on Huggingface Via Docker 10 months ago
You don't really have to clone the repo. The FastAPI code is just there for demonstration, and you can code the way you like. The main takeaway is the Dockerfile.