Collection by 
Dec 21, 2023
Collections
Discover the best community collections!
Collections trending this week
Collection by 
Dec 21, 2023
Collection by 
Jun 27, 2024
-
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 264 -
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Paper • 2312.12456 • Published • 46 -
Accelerating LLM Inference with Staged Speculative Decoding
Paper • 2308.04623 • Published • 26 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 5
Collection by 
Dec 21, 2023
Collection by 
Dec 21, 2023
Collection by May 31, 2024
-
QuIP: 2-Bit Quantization of Large Language Models With Guarantees
Paper • 2307.13304 • Published • 2 -
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
Paper • 2306.03078 • Published • 3 -
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
Paper • 2308.13137 • Published • 20 -
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 14
Collection by 
Mar 2
Collection by 
Dec 21, 2023
Collection by 
Mar 9, 2024
Collection by 
Dec 21, 2023
Collection by Dec 21, 2023
Collection by May 31, 2024
-
QuIP: 2-Bit Quantization of Large Language Models With Guarantees
Paper • 2307.13304 • Published • 2 -
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
Paper • 2306.03078 • Published • 3 -
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
Paper • 2308.13137 • Published • 20 -
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 14
Collection by Dec 21, 2023
Collection by Mar 2
Collection by Jun 27, 2024
-
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 264 -
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Paper • 2312.12456 • Published • 46 -
Accelerating LLM Inference with Staged Speculative Decoding
Paper • 2308.04623 • Published • 26 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 5
Collection by Dec 21, 2023
Collection by Dec 21, 2023
Collection by Mar 9, 2024
Collection by Dec 21, 2023
Collection by Dec 21, 2023