McGill-NLP 's Collections

EchoMoE

Models from Communicate the Change: Efficient Expert Parallelism via Activation Compression (EchoMoE).