Hugging Face's logo

RedHatAI
/
quantization

kernel
Model card Files
xet
 Community
3
quantization

Commit History

  1. Update flake.lock

    danieldk HF Staff
    613a874

  1. Build

    danieldk HF Staff
    d636d53

  2. Sync with vLLM⁠

    danieldk HF Staff
    0da5bf5

  1. Build

    danieldk HF Staff
    0bc428e

  2. Adjust for latest kernel-builder changes

    danieldk HF Staff
    f44baaa

  1. Build

    danieldk HF Staff
    2e44e8c

  1. Simplify `flake.nix`

    danieldk HF Staff
    88883b3

  1. Build

    danieldk HF Staff
    d62ac09

  2. Expose ops (handy for tests etc.)

    danieldk HF Staff
    e3a7455

  1. Add a `flake.nix` for convenience

    danieldk HF Staff
    be218ea

  1. Build

    danieldk HF Staff
    a6c77d7

  2. Add full Marlin support and tests for Marlin/CUTLASS

    danieldk HF Staff
    165b25c

  1. Import CUTLASS tests and add missing scaled mm with zp signature

    danieldk HF Staff
    2dd62c9

  2. Add missing `scalar_type.hpp`

    danieldk HF Staff
    9d045c3

  3. Build

    danieldk HF Staff
    439141b

  4. Add GPTQ-Marlin

    danieldk HF Staff
    c31b5ce

  1. Build

    danieldk HF Staff
    c5018b2

  2. Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm`

    danieldk HF Staff
    5c6fb68

  3. Build

    danieldk HF Staff
    a77838d

  4. Fixup metadata

    danieldk HF Staff
    c7e38f0

  5. Add cutlass_w8a8

    danieldk HF Staff
    b4cad21

  6. initial commit

    danieldk HF Staff
    Verified signature
    e87d8e6