Scaling Embeddings Outperforms Scaling Experts in Language Models
Paper
• 2601.21204 • Published
• 102
zunhaisu
zunhai
·
AI & ML interests
None yet
Recent Activity
upvoted a paper about 1 month ago
Scaling Embeddings Outperforms Scaling Experts in Language Models authored
a paper
about 2 months ago
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models upvoted a paper about 2 months ago
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models Organizations
None yet
upvoted a paper about 1 month ago
authored a paper about 2 months ago
upvoted a paper about 2 months ago
liked a model about 2 months ago
upvoted a paper 2 months ago
authored 4 papers 4 months ago
RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations
Paper
• 2501.16383 • Published
AKVQ-VL: Attention-Aware KV Cache Adaptive 2-Bit Quantization for Vision-Language Models
Paper
• 2501.15021 • Published
LongCat-Flash Technical Report
Paper
• 2509.01322 • Published
• 7
DoPE: Denoising Rotary Position Embedding
Paper
• 2511.09146 • Published
• 97
upvoted 2 papers 4 months ago
commented a paper 4 months ago
upvoted a paper 6 months ago
authored a paper 7 months ago