Michael Goin's picture

Michael Goin

mgoin

·

mgoin_
mgoin

AI & ML interests

LLM inference optimization, compression, quantization, pruning, distillation

Recent Activity

updated a model 12 days ago

inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4

new activity 12 days ago

inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4:Fix invalid config

new activity 12 days ago

inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4:Fix invalid config

View all activity

Organizations

authored 2 papers over 1 year ago

Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization

Paper • 2409.00492 • Published Aug 31, 2024 • 11

Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment

Paper • 2405.03594 • Published May 6, 2024 • 7

authored 2 papers over 2 years ago

Sparse Finetuning for Inference Acceleration of Large Language Models

Paper • 2310.06927 • Published Oct 10, 2023 • 15

The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models

Paper • 2203.07259 • Published Mar 14, 2022 • 4