MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression
Paper • 2406.14909 • Published • 16
AI & ML interests
None defined yet.
hwang595
authored a
paper over 2 years ago
hwang595
authored 7
papers almost 3 years ago
Federated Learning with Matched Averaging
Paper • 2002.06440 • Published • 2
MPCFormer: fast, performant and private Transformer inference with MPC
Paper • 2211.01452 • Published • 1
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition
Paper • 2308.14929 • Published • 1
Cuttlefish: Low-Rank Model Training without All the Tuning
Paper • 2305.02538 • Published • 1
Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs
Paper • 2310.16355 • Published
TrustLLM: Trustworthiness in Large Language Models
Paper • 2401.05561 • Published • 69
LLM360: Towards Fully Transparent Open-Source LLMs
Paper • 2312.06550 • Published • 57