MAGI-2-preview-FP8 / quantization_config.json

Commit History

15 days ago

  1. W8A8 expert kernel (FP8 x FP8 tensor cores, K-major weights at load): 11.4 ms vs 17.7 bf16 per call; A/B results

    Verified signature
    ab8889c
  2. FP8 routed experts for MAGI-2 Preview

    Verified signature
    21fe007