RedHatAI
/

Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

Phi-3-mini-128k-instruct-quantized.w8a8

Commit History

Update README.md

92facde
verified

alexmarques commited on 27 days ago

Updated compression_config to quantization_config

0ab444b
verified

mgoin commited on Oct 9, 2024

Update README.md

791a361
verified

alexmarques commited on Jul 18, 2024

Update README.md

4bafd06
verified

alexmarques commited on Jul 18, 2024

Create README.md

25992a4
verified

alexmarques commited on Jul 17, 2024

Upload folder using huggingface_hub

a35502e
verified

alexmarques commited on Jul 11, 2024

initial commit

4a30faf
verified

alexmarques commited on Jul 11, 2024