Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

RedHatAI
/

quantization

Model card Files Files and versions

1.08 GB

2 contributors

History: 20 commits

danieldk's picture

danieldk HF Staff

Sync with vLLM

0da5bf5 about 1 year ago

build
Build about 1 year ago
compressed_tensors
Sync with vLLM about 1 year ago
core
Sync with vLLM about 1 year ago
cutlass_extensions
Sync with vLLM about 1 year ago
cutlass_w8a8
Sync with vLLM about 1 year ago
ext-torch
Adjust for latest kernel-builder changes about 1 year ago
fp8
Sync with vLLM about 1 year ago
gptq_marlin
Sync with vLLM about 1 year ago
marlin
Add full Marlin support and tests for Marlin/CUTLASS about 1 year ago
tests
Add full Marlin support and tests for Marlin/CUTLASS about 1 year ago
.gitattributes
1.56 kB

Build about 1 year ago
LICENSE
11.4 kB

Add cutlass_w8a8 about 1 year ago
README.md
181 Bytes

Fixup metadata about 1 year ago
build.toml
2.82 kB

Sync with vLLM about 1 year ago
dispatch_utils.h
1.49 kB

Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` about 1 year ago
flake.nix
257 Bytes

Simplify `flake.nix` about 1 year ago
vectorization.cuh
778 Bytes

Sync with vLLM about 1 year ago