curiousmind147

/

microsoft-phi-4-AWQ-4bit-GEMM

like 1

CompilationError: at 108:22:
masks_s = masks_sk[:, None] & masks_sn[None, :]
scales_ptrs = scales_ptr + offsets_s
scales = tl.load(scales_ptrs, mask=masks_s)
scales = tl.broadcast_to(scales, (BLOCK_SIZE_K, BLOCK_SIZE_N))

    b = (b >> shifts) & 0xF
    zeros = (zeros >> shifts) & 0xF
    b = (b - zeros) * scales
    b = b.to(c_ptr.type.element_ty)

    # Accumulate results.
    accumulator = tl.dot(a, b, accumulator, out_dtype=accumulator_dtype)