UIUC-SSAIL/gemma4-26b-a4b-XPress-b16
0.6B ā¢ Updated ā¢ 13
AI & ML interests
None defined yet.
Recent Activity
View all activity
ZhengVictorWangĀ
updated a
model 5 minutes ago
ZhengVictorWangĀ
updated a
model 6 minutes ago
ZhengVictorWangĀ
updated a
model 7 minutes ago
MinjiaĀ
published 3
models 8 days ago
ZhengVictorWangĀ
updated a
model 8 days ago
MinjiaĀ
published 2
models about 1 month ago
ZhengVictorWangĀ
updated a
model about 2 months ago
MinjiaĀ
updated a
Space about 2 months ago
MinjiaĀ
published a
Space about 2 months ago
MinjiaĀ
authored 8
papers over 1 year ago
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Paper ā¢ 2310.01801 ā¢ Published ā¢ 3
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Paper ā¢ 2310.04610 ā¢ Published ā¢ 1
ZeRO-Offload: Democratizing Billion-Scale Model Training
Paper ā¢ 2101.06840 ā¢ Published ā¢ 1
Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native
Paper ā¢ 2401.12230 ā¢ Published ā¢ 2
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
Paper ā¢ 2308.01320 ā¢ Published ā¢ 46
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
Paper ā¢ 2201.05596 ā¢ Published ā¢ 2
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Paper ā¢ 2211.05100 ā¢ Published ā¢ 40
Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers
Paper ā¢ 2211.11586 ā¢ Published ā¢ 1